2023-06-09T10:52:38.549 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T10:52:38.550 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --archive /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879 --owner scheduled_rishabh@teuthology --name rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/orig.config.yaml 2023-06-09T10:52:38.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-09T10:52:38.703 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879 branch: wip-rishabh-2023Jun9-1308 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7299879' kernel: client: branch: testing flavor: default kdb: true sha1: 10b2f20a4f46c803bb730efc73498f97d45082e7 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-2023Jun9-1308 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 034108821cde95ca1c56d458dfccc7ef9e0d964d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 034108821cde95ca1c56d458dfccc7ef9e0d964d kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jun9-1308 sha1: 034108821cde95ca1c56d458dfccc7ef9e0d964d owner: scheduled_rishabh@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 034108821cde95ca1c56d458dfccc7ef9e0d964d sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jun9-1308 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 034108821cde95ca1c56d458dfccc7ef9e0d964d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-09_10:19:22 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-09T10:52:38.703 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa; will attempt to use it 2023-06-09T10:52:38.704 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks 2023-06-09T10:52:38.704 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-09T10:52:38.709 INFO:teuthology.task.internal:Checking packages... 2023-06-09T10:52:38.739 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '034108821cde95ca1c56d458dfccc7ef9e0d964d' 2023-06-09T10:52:38.739 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-09T10:52:38.740 INFO:teuthology.packaging:ref: None 2023-06-09T10:52:38.740 INFO:teuthology.packaging:tag: None 2023-06-09T10:52:38.740 INFO:teuthology.packaging:branch: wip-rishabh-2023Jun9-1308 2023-06-09T10:52:38.740 INFO:teuthology.packaging:sha1: 034108821cde95ca1c56d458dfccc7ef9e0d964d 2023-06-09T10:52:38.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-2023Jun9-1308 2023-06-09T10:52:39.022 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3924-g03410882-1focal 2023-06-09T10:52:39.022 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-09T10:52:39.029 INFO:teuthology.task.internal:no buildpackages task found 2023-06-09T10:52:39.029 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-09T10:52:39.052 INFO:teuthology.task.internal:Saving configuration 2023-06-09T10:52:39.071 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-09T10:52:39.076 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T10:52:39.106 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 10:19:56.358789', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-09T10:52:39.128 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 10:19:56.356904', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-09T10:52:39.128 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-09T10:52:39.134 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-09T10:52:39.134 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-09T10:52:39.134 INFO:teuthology.run_tasks:Running task console_log... 2023-06-09T10:52:39.219 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe470d51f70>, signals=[15]) 2023-06-09T10:52:39.221 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-09T10:52:39.229 INFO:teuthology.task.internal:Opening connections... 2023-06-09T10:52:39.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T10:52:39.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:52:39.284 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T10:52:39.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:52:39.336 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-09T10:52:39.342 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-06-09T10:52:39.362 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-06-09T10:52:39.362 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-06-09T10:52:39.369 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2023-06-09T10:52:39.369 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-09T10:52:39.369 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2023-06-09T10:52:39.369 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2023-06-09T10:52:39.369 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-09T10:52:39.369 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="20.04" 2023-06-09T10:52:39.370 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T10:52:39.370 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T10:52:39.370 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T10:52:39.370 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T10:52:39.370 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=focal 2023-06-09T10:52:39.370 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=focal 2023-06-09T10:52:39.371 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-06-09T10:52:39.485 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-06-09T10:52:39.491 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-06-09T10:52:39.492 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-06-09T10:52:39.498 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2023-06-09T10:52:39.498 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-09T10:52:39.498 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2023-06-09T10:52:39.498 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2023-06-09T10:52:39.499 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-09T10:52:39.499 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="20.04" 2023-06-09T10:52:39.499 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T10:52:39.499 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T10:52:39.499 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T10:52:39.499 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T10:52:39.499 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=focal 2023-06-09T10:52:39.500 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=focal 2023-06-09T10:52:39.500 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-06-09T10:52:39.534 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-09T10:52:39.545 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-09T10:52:39.594 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-09T10:52:39.594 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-06-09T10:52:39.597 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-06-09T10:52:39.602 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-09T10:52:39.608 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-09T10:52:39.608 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-06-09T10:52:39.611 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-06-09T10:52:39.629 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-09T10:52:39.691 INFO:teuthology.run_tasks:Running task kernel... 2023-06-09T10:52:39.713 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '10b2f20a4f46c803bb730efc73498f97d45082e7'} 2023-06-09T10:52:39.714 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-06-09T10:52:39.714 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-06-09T10:52:39.715 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T10:52:39.715 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T10:52:39.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T10:52:39.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-06-09T10:52:39.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T10:52:39.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-06-09T10:52:39.877 DEBUG:teuthology.task.kernel:sha1 for client.0 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T10:52:39.877 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-09T10:52:39.877 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-06-09T10:52:39.884 INFO:teuthology.orchestra.run.smithi078.stdout:5.4.0-124-generic 2023-06-09T10:52:39.884 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T10:52:39.884 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-09T10:52:39.885 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-06-09T10:52:39.885 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-06-09T10:52:39.888 DEBUG:teuthology.task.kernel:sha1 for client.1 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T10:52:39.888 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-09T10:52:39.888 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-06-09T10:52:39.894 INFO:teuthology.orchestra.run.smithi187.stdout:5.4.0-124-generic 2023-06-09T10:52:39.894 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T10:52:39.895 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-09T10:52:39.895 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-06-09T10:52:39.895 DEBUG:teuthology.orchestra.run.smithi187:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-06-09T10:52:39.908 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-06-09T10:52:39.920 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-06-09T10:52:40.014 INFO:teuthology.orchestra.run.smithi078.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-06-09T10:52:40.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-06-09T10:52:40.037 INFO:teuthology.orchestra.run.smithi187.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-06-09T10:52:40.039 DEBUG:teuthology.orchestra.run.smithi187:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-06-09T10:52:40.071 DEBUG:teuthology.orchestra.run.smithi187:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-06-09T10:52:40.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-06-09T10:52:40.121 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-06-09T10:52:40.129 DEBUG:teuthology.orchestra.run.smithi187:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-06-09T10:56:04.873 INFO:teuthology.orchestra.run.smithi078.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-06-09T10:56:04.874 INFO:teuthology.orchestra.run.smithi078.stderr: * [new branch] main -> origin/main 2023-06-09T10:56:04.926 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190312 -> 20190312 2023-06-09T10:56:04.926 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190416 -> 20190416 2023-06-09T10:56:04.926 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190514 -> 20190514 2023-06-09T10:56:04.927 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190618 -> 20190618 2023-06-09T10:56:04.927 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190717 -> 20190717 2023-06-09T10:56:04.928 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190815 -> 20190815 2023-06-09T10:56:04.928 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190923 -> 20190923 2023-06-09T10:56:04.929 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191022 -> 20191022 2023-06-09T10:56:04.929 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191215 -> 20191215 2023-06-09T10:56:04.929 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200122 -> 20200122 2023-06-09T10:56:04.929 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200316 -> 20200316 2023-06-09T10:56:04.929 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200421 -> 20200421 2023-06-09T10:56:04.929 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200519 -> 20200519 2023-06-09T10:56:04.929 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200619 -> 20200619 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200721 -> 20200721 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200817 -> 20200817 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200918 -> 20200918 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201022 -> 20201022 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201118 -> 20201118 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201218 -> 20201218 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210208 -> 20210208 2023-06-09T10:56:04.930 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210315 -> 20210315 2023-06-09T10:56:04.931 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210511 -> 20210511 2023-06-09T10:56:04.931 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210716 -> 20210716 2023-06-09T10:56:04.932 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210818 -> 20210818 2023-06-09T10:56:04.932 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210919 -> 20210919 2023-06-09T10:56:04.933 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211027 -> 20211027 2023-06-09T10:56:04.933 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211216 -> 20211216 2023-06-09T10:56:04.933 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220209 -> 20220209 2023-06-09T10:56:04.933 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220310 -> 20220310 2023-06-09T10:56:04.933 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220411 -> 20220411 2023-06-09T10:56:04.933 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220509 -> 20220509 2023-06-09T10:56:04.933 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220610 -> 20220610 2023-06-09T10:56:04.934 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220708 -> 20220708 2023-06-09T10:56:04.934 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220815 -> 20220815 2023-06-09T10:56:04.934 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220913 -> 20220913 2023-06-09T10:56:04.934 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221012 -> 20221012 2023-06-09T10:56:04.934 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221109 -> 20221109 2023-06-09T10:56:04.934 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221214 -> 20221214 2023-06-09T10:56:04.934 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230117 -> 20230117 2023-06-09T10:56:04.935 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230210 -> 20230210 2023-06-09T10:56:04.935 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230310 -> 20230310 2023-06-09T10:56:04.935 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230404 -> 20230404 2023-06-09T10:56:04.935 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230515 -> 20230515 2023-06-09T10:56:08.155 INFO:teuthology.orchestra.run.smithi078.stderr:Updating files: 51% (1517/2971) Updating files: 52% (1545/2971) Updating files: 53% (1575/2971) Updating files: 54% (1605/2971) Updating files: 55% (1635/2971) Updating files: 56% (1664/2971) Updating files: 57% (1694/2971) Updating files: 58% (1724/2971) Updating files: 59% (1753/2971) Updating files: 60% (1783/2971) Updating files: 61% (1813/2971) Updating files: 62% (1843/2971) Updating files: 63% (1872/2971) Updating files: 64% (1902/2971) Updating files: 65% (1932/2971) Updating files: 65% (1952/2971) Updating files: 66% (1961/2971) Updating files: 67% (1991/2971) Updating files: 68% (2021/2971) Updating files: 69% (2050/2971) Updating files: 70% (2080/2971) Updating files: 71% (2110/2971) Updating files: 72% (2140/2971) Updating files: 73% (2169/2971) Updating files: 74% (2199/2971) Updating files: 75% (2229/2971) Updating files: 76% (2258/2971) Updating files: 77% (2288/2971) Updating files: 78% (2318/2971) Updating files: 79% (2348/2971) Updating files: 80% (2377/2971) Updating files: 81% (2407/2971) Updating files: 82% (2437/2971) Updating files: 82% (2448/2971) Updating files: 83% (2466/2971) Updating files: 84% (2496/2971) Updating files: 85% (2526/2971) Updating files: 86% (2556/2971) Updating files: 87% (2585/2971) Updating files: 88% (2615/2971) Updating files: 89% (2645/2971) Updating files: 90% (2674/2971) Updating files: 91% (2704/2971) Updating files: 92% (2734/2971) Updating files: 93% (2764/2971) Updating files: 94% (2793/2971) Updating files: 95% (2823/2971) Updating files: 96% (2853/2971) Updating files: 97% (2882/2971) Updating files: 98% (2912/2971) Updating files: 99% (2942/2971) Updating files: 100% (2971/2971) Updating files: 100% (2971/2971), done. 2023-06-09T10:56:08.159 INFO:teuthology.orchestra.run.smithi078.stdout:HEAD is now at fc90c59b Merge branch 'db410c' of https://github.com/lumag/linux-firmware 2023-06-09T10:56:08.173 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-09T10:56:08.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T10:56:08.452 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T10:56:08.453 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ --input-file=- 2023-06-09T10:56:08.455 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-06-09T10:56:21.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09 10:56:21 URL:https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb [38539740/38539740] -> "/tmp/linux-image.deb" [1] 2023-06-09T10:56:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:FINISHED --2023-06-09 10:56:21-- 2023-06-09T10:56:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:Total wall clock time: 13s 2023-06-09T10:56:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:Downloaded: 1 files, 37M in 13s (2.90 MB/s) 2023-06-09T10:56:21.392 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-09T10:56:21.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo dpkg -i /tmp/linux-image.deb 2023-06-09T10:56:21.730 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-6.4.0-rc2-g10b2f20a4f46. 2023-06-09T10:56:23.463 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-06-09T10:56:23.467 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-06-09T10:56:23.638 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T10:56:25.543 INFO:teuthology.orchestra.run.smithi187.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-06-09T10:56:25.544 INFO:teuthology.orchestra.run.smithi187.stderr: * [new branch] main -> origin/main 2023-06-09T10:56:25.594 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190312 -> 20190312 2023-06-09T10:56:25.594 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190416 -> 20190416 2023-06-09T10:56:25.595 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190514 -> 20190514 2023-06-09T10:56:25.595 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190618 -> 20190618 2023-06-09T10:56:25.595 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190717 -> 20190717 2023-06-09T10:56:25.595 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190815 -> 20190815 2023-06-09T10:56:25.595 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190923 -> 20190923 2023-06-09T10:56:25.597 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20191022 -> 20191022 2023-06-09T10:56:25.597 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20191215 -> 20191215 2023-06-09T10:56:25.597 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200122 -> 20200122 2023-06-09T10:56:25.597 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200316 -> 20200316 2023-06-09T10:56:25.597 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200421 -> 20200421 2023-06-09T10:56:25.597 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200519 -> 20200519 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200619 -> 20200619 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200721 -> 20200721 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200817 -> 20200817 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200918 -> 20200918 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20201022 -> 20201022 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20201118 -> 20201118 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20201218 -> 20201218 2023-06-09T10:56:25.598 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210208 -> 20210208 2023-06-09T10:56:25.599 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210315 -> 20210315 2023-06-09T10:56:25.599 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210511 -> 20210511 2023-06-09T10:56:25.599 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210716 -> 20210716 2023-06-09T10:56:25.599 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210818 -> 20210818 2023-06-09T10:56:25.600 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210919 -> 20210919 2023-06-09T10:56:25.601 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20211027 -> 20211027 2023-06-09T10:56:25.601 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20211216 -> 20211216 2023-06-09T10:56:25.601 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220209 -> 20220209 2023-06-09T10:56:25.601 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220310 -> 20220310 2023-06-09T10:56:25.601 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220411 -> 20220411 2023-06-09T10:56:25.601 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220509 -> 20220509 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220610 -> 20220610 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220708 -> 20220708 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220815 -> 20220815 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220913 -> 20220913 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20221012 -> 20221012 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20221109 -> 20221109 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20221214 -> 20221214 2023-06-09T10:56:25.602 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230117 -> 20230117 2023-06-09T10:56:25.603 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230210 -> 20230210 2023-06-09T10:56:25.603 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230310 -> 20230310 2023-06-09T10:56:25.603 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230404 -> 20230404 2023-06-09T10:56:25.603 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230515 -> 20230515 2023-06-09T10:56:26.680 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T10:56:26.801 INFO:teuthology.orchestra.run.smithi078.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:28.820 INFO:teuthology.orchestra.run.smithi187.stderr:Updating files: 51% (1517/2971) Updating files: 52% (1545/2971) Updating files: 53% (1575/2971) Updating files: 54% (1605/2971) Updating files: 55% (1635/2971) Updating files: 56% (1664/2971) Updating files: 57% (1694/2971) Updating files: 58% (1724/2971) Updating files: 59% (1753/2971) Updating files: 60% (1783/2971) Updating files: 61% (1813/2971) Updating files: 62% (1843/2971) Updating files: 63% (1872/2971) Updating files: 64% (1902/2971) Updating files: 65% (1932/2971) Updating files: 65% (1952/2971) Updating files: 66% (1961/2971) Updating files: 67% (1991/2971) Updating files: 68% (2021/2971) Updating files: 69% (2050/2971) Updating files: 70% (2080/2971) Updating files: 71% (2110/2971) Updating files: 72% (2140/2971) Updating files: 73% (2169/2971) Updating files: 74% (2199/2971) Updating files: 75% (2229/2971) Updating files: 76% (2258/2971) Updating files: 77% (2288/2971) Updating files: 78% (2318/2971) Updating files: 79% (2348/2971) Updating files: 80% (2377/2971) Updating files: 81% (2407/2971) Updating files: 82% (2437/2971) Updating files: 82% (2448/2971) Updating files: 83% (2466/2971) Updating files: 84% (2496/2971) Updating files: 85% (2526/2971) Updating files: 86% (2556/2971) Updating files: 87% (2585/2971) Updating files: 88% (2615/2971) Updating files: 89% (2645/2971) Updating files: 90% (2674/2971) Updating files: 91% (2704/2971) Updating files: 92% (2734/2971) Updating files: 93% (2764/2971) Updating files: 94% (2793/2971) Updating files: 95% (2823/2971) Updating files: 96% (2853/2971) Updating files: 97% (2882/2971) Updating files: 98% (2912/2971) Updating files: 99% (2942/2971) Updating files: 100% (2971/2971) Updating files: 100% (2971/2971), done. 2023-06-09T10:56:28.824 INFO:teuthology.orchestra.run.smithi187.stdout:HEAD is now at fc90c59b Merge branch 'db410c' of https://github.com/lumag/linux-firmware 2023-06-09T10:56:28.838 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-09T10:56:28.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T10:56:29.206 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T10:56:29.207 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ --input-file=- 2023-06-09T10:56:29.209 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi187.front.sepia.ceph.com to complete... 2023-06-09T10:56:33.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09 10:56:33 URL:https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb [38539740/38539740] -> "/tmp/linux-image.deb" [1] 2023-06-09T10:56:33.053 INFO:teuthology.orchestra.run.smithi187.stderr:FINISHED --2023-06-09 10:56:33-- 2023-06-09T10:56:33.054 INFO:teuthology.orchestra.run.smithi187.stderr:Total wall clock time: 3.8s 2023-06-09T10:56:33.054 INFO:teuthology.orchestra.run.smithi187.stderr:Downloaded: 1 files, 37M in 3.6s (10.3 MB/s) 2023-06-09T10:56:33.055 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-09T10:56:33.055 DEBUG:teuthology.orchestra.run.smithi187:> sudo dpkg -i /tmp/linux-image.deb 2023-06-09T10:56:33.394 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-6.4.0-rc2-g10b2f20a4f46. 2023-06-09T10:56:35.166 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-06-09T10:56:35.171 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-06-09T10:56:35.336 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T10:56:38.296 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T10:56:38.454 INFO:teuthology.orchestra.run.smithi187.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:46.630 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-06-09T10:56:46.634 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T10:56:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-06-09T10:56:47.017 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:47.042 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T10:56:47.480 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T10:56:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-06-09T10:56:50.311 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-deb -c /tmp/linux-image.deb 2023-06-09T10:56:50.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./ 2023-06-09T10:56:50.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./boot/ 2023-06-09T10:56:50.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4322013 2023-06-01 02:19 ./boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:50.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 167348 2023-06-01 02:19 ./boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:50.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11235616 2023-06-01 02:19 ./boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:50.356 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/ 2023-06-09T10:56:50.356 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/ 2023-06-09T10:56:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postinst.d/ 2023-06-09T10:56:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postrm.d/ 2023-06-09T10:56:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/preinst.d/ 2023-06-09T10:56:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/prerm.d/ 2023-06-09T10:56:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/ 2023-06-09T10:56:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/ 2023-06-09T10:56:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T10:56:50.358 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/ 2023-06-09T10:56:50.358 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/ 2023-06-09T10:56:50.358 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/ 2023-06-09T10:56:50.358 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ 2023-06-09T10:56:50.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 490273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/aesni-intel.ko 2023-06-09T10:56:50.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-09T10:56:50.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-09T10:56:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-09T10:56:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 92281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-09T10:56:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-09T10:56:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-09T10:56:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-09T10:56:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-09T10:56:50.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-09T10:56:50.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-09T10:56:50.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-09T10:56:50.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-09T10:56:50.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-09T10:56:50.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-09T10:56:50.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-09T10:56:50.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-09T10:56:50.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-09T10:56:50.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-09T10:56:50.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-09T10:56:50.364 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/ 2023-06-09T10:56:50.364 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/ 2023-06-09T10:56:50.364 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/ 2023-06-09T10:56:50.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-09T10:56:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpuid.ko 2023-06-09T10:56:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/msr.ko 2023-06-09T10:56:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/ 2023-06-09T10:56:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 346401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-09T10:56:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 972121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-09T10:56:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2209361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-09T10:56:50.374 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ 2023-06-09T10:56:50.374 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/af_alg.ko 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_hash.ko 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_skcipher.ko 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/ 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-06-09T10:56:50.375 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/ 2023-06-09T10:56:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-09T10:56:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-09T10:56:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-09T10:56:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-09T10:56:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-09T10:56:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-09T10:56:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-09T10:56:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-09T10:56:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-09T10:56:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-09T10:56:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-09T10:56:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-09T10:56:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-09T10:56:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cryptd.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_simd.ko 2023-06-09T10:56:50.378 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-09T10:56:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-09T10:56:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-09T10:56:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-09T10:56:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-09T10:56:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-09T10:56:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-09T10:56:50.379 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lrw.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-09T10:56:50.380 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-09T10:56:50.381 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-09T10:56:50.381 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-09T10:56:50.381 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 149081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-09T10:56:50.381 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-09T10:56:50.381 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-09T10:56:50.381 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-09T10:56:50.381 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xts.ko 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ 2023-06-09T10:56:50.382 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_extlog.ko 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/ 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/einj.ko 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-09T10:56:50.383 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-09T10:56:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-09T10:56:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ 2023-06-09T10:56:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-09T10:56:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci.ko 2023-06-09T10:56:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-09T10:56:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci.ko 2023-06-09T10:56:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-09T10:56:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-09T10:56:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-09T10:56:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-09T10:56:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-09T10:56:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-09T10:56:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-09T10:56:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-09T10:56:50.386 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-09T10:56:50.387 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-09T10:56:50.387 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-09T10:56:50.387 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_legacy.ko 2023-06-09T10:56:50.387 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-09T10:56:50.387 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-09T10:56:50.387 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-09T10:56:50.387 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-09T10:56:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-09T10:56:50.389 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-09T10:56:50.389 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_radisys.ko 2023-06-09T10:56:50.389 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-09T10:56:50.389 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rz1000.ko 2023-06-09T10:56:50.389 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-09T10:56:50.389 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-09T10:56:50.389 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-09T10:56:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-09T10:56:50.391 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-09T10:56:50.392 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-09T10:56:50.392 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ 2023-06-09T10:56:50.392 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-09T10:56:50.392 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/ 2023-06-09T10:56:50.392 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 121569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-09T10:56:50.392 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/ 2023-06-09T10:56:50.392 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/ 2023-06-09T10:56:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-09T10:56:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/ 2023-06-09T10:56:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 968017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-09T10:56:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-09T10:56:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/ 2023-06-09T10:56:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-09T10:56:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-09T10:56:50.427 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/ 2023-06-09T10:56:50.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-09T10:56:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-09T10:56:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 254273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-09T10:56:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/ 2023-06-09T10:56:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-09T10:56:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/ 2023-06-09T10:56:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-09T10:56:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ 2023-06-09T10:56:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/applicom.ko 2023-06-09T10:56:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-09T10:56:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/ 2023-06-09T10:56:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-09T10:56:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-09T10:56:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-09T10:56:50.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 147521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 138881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-09T10:56:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-09T10:56:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-09T10:56:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/ 2023-06-09T10:56:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-09T10:56:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/nvram.ko 2023-06-09T10:56:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-09T10:56:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-09T10:56:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/ 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-06-09T10:56:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/ 2023-06-09T10:56:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_class.ko 2023-06-09T10:56:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_core.ko 2023-06-09T10:56:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-06-09T10:56:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/ 2023-06-09T10:56:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-palmas.ko 2023-06-09T10:56:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-si5351.ko 2023-06-09T10:56:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-twl6040.ko 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-wm831x.ko 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/ 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ 2023-06-09T10:56:50.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-09T10:56:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 231545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-09T10:56:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/ 2023-06-09T10:56:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/ 2023-06-09T10:56:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/ 2023-06-09T10:56:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 396281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-09T10:56:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-06-09T10:56:50.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-09T10:56:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-09T10:56:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-09T10:56:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/ 2023-06-09T10:56:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-09T10:56:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/ 2023-06-09T10:56:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-09T10:56:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/ 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-09T10:56:50.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-09T10:56:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-09T10:56:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-09T10:56:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-09T10:56:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-09T10:56:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-09T10:56:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-09T10:56:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-09T10:56:50.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-09T10:56:50.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-09T10:56:50.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-09T10:56:50.439 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/ 2023-06-09T10:56:50.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-gpio.ko 2023-06-09T10:56:50.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max14577.ko 2023-06-09T10:56:50.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max77693.ko 2023-06-09T10:56:50.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max8997.ko 2023-06-09T10:56:50.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-palmas.ko 2023-06-09T10:56:50.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-rt8973a.ko 2023-06-09T10:56:50.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-sm5502.ko 2023-06-09T10:56:50.440 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/ 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/dmi-sysfs.ko 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/ 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/efi-pstore.ko 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/ 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-adp5520.ko 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-amd8111.ko 2023-06-09T10:56:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-arizona.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9052.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9055.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-dln2.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-f7188x.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-generic.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-06-09T10:56:50.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-kempld.ko 2023-06-09T10:56:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-lp3943.ko 2023-06-09T10:56:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max7300.ko 2023-06-09T10:56:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max730x.ko 2023-06-09T10:56:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max732x.ko 2023-06-09T10:56:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-06-09T10:56:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pca953x.ko 2023-06-09T10:56:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pcf857x.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-rdc321x.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch311x.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-tps65912.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl4030.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl6040.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-09T10:56:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-vx855.ko 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm831x.ko 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8350.ko 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8994.ko 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/ 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-a4tech.ko 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-apple.ko 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-09T10:56:50.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-09T10:56:50.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-09T10:56:50.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-belkin.ko 2023-06-09T10:56:50.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cherry.ko 2023-06-09T10:56:50.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-chicony.ko 2023-06-09T10:56:50.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cp2112.ko 2023-06-09T10:56:50.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cypress.ko 2023-06-09T10:56:50.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ezkey.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-generic.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-09T10:56:50.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-09T10:56:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-09T10:56:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-09T10:56:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-09T10:56:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-09T10:56:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-09T10:56:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kensington.ko 2023-06-09T10:56:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lg-g15.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-09T10:56:50.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech.ko 2023-06-09T10:56:50.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-magicmouse.ko 2023-06-09T10:56:50.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-microsoft.ko 2023-06-09T10:56:50.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-monterey.ko 2023-06-09T10:56:50.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-09T10:56:50.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ntrig.ko 2023-06-09T10:56:50.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-09T10:56:50.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-09T10:56:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-09T10:56:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-09T10:56:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-09T10:56:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-09T10:56:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-09T10:56:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-09T10:56:50.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-09T10:56:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-09T10:56:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-09T10:56:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-09T10:56:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-09T10:56:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-09T10:56:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-09T10:56:50.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-09T10:56:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-09T10:56:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-09T10:56:50.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-09T10:56:50.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-09T10:56:50.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-09T10:56:50.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-09T10:56:50.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-09T10:56:50.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-09T10:56:50.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 261777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid.ko 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/ 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbhid.ko 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbkbd.ko 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbmouse.ko 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-09T10:56:50.456 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/ 2023-06-09T10:56:50.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-09T10:56:50.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-09T10:56:50.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 292521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-09T10:56:50.457 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ 2023-06-09T10:56:50.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-09T10:56:50.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-09T10:56:50.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-09T10:56:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-09T10:56:50.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-09T10:56:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-09T10:56:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-09T10:56:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-09T10:56:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-09T10:56:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-09T10:56:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-09T10:56:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9052-hwmon.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9055-hwmon.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc2103.ko 2023-06-09T10:56:50.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-09T10:56:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-09T10:56:50.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-09T10:56:50.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hih6130.ko 2023-06-09T10:56:50.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-09T10:56:50.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-09T10:56:50.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-09T10:56:50.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-09T10:56:50.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-09T10:56:50.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-09T10:56:50.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-09T10:56:50.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-09T10:56:50.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/jc42.ko 2023-06-09T10:56:50.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-09T10:56:50.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-09T10:56:50.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-09T10:56:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-09T10:56:50.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-09T10:56:50.467 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-09T10:56:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-09T10:56:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-09T10:56:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-09T10:56:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-09T10:56:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-09T10:56:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mc13783-adc.ko 2023-06-09T10:56:50.468 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-09T10:56:50.469 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-09T10:56:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-09T10:56:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-09T10:56:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-09T10:56:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-09T10:56:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-09T10:56:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-09T10:56:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-09T10:56:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smm665.ko 2023-06-09T10:56:50.472 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-09T10:56:50.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-09T10:56:50.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-09T10:56:50.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-09T10:56:50.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-09T10:56:50.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-09T10:56:50.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-09T10:56:50.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-09T10:56:50.474 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-06-09T10:56:50.475 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/ 2023-06-09T10:56:50.476 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/ 2023-06-09T10:56:50.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-09T10:56:50.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-09T10:56:50.476 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/ 2023-06-09T10:56:50.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-06-09T10:56:50.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-06-09T10:56:50.476 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-09T10:56:50.477 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-09T10:56:50.478 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-06-09T10:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-09T10:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-09T10:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-06-09T10:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-09T10:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-09T10:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-09T10:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-06-09T10:56:50.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-09T10:56:50.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-09T10:56:50.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-06-09T10:56:50.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-06-09T10:56:50.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-09T10:56:50.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-06-09T10:56:50.480 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-09T10:56:50.481 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/ 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 264409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 849113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-09T10:56:50.482 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-09T10:56:50.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 320185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-09T10:56:50.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-09T10:56:50.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 272097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-09T10:56:50.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-09T10:56:50.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ 2023-06-09T10:56:50.483 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/ 2023-06-09T10:56:50.483 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 492377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/ 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 419097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/ 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 733385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 296481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ 2023-06-09T10:56:50.484 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 153561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/ 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 168905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-09T10:56:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ 2023-06-09T10:56:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-09T10:56:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ 2023-06-09T10:56:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-09T10:56:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ 2023-06-09T10:56:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-09T10:56:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ 2023-06-09T10:56:50.486 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/evbug.ko 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ff-memless.ko 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-09T10:56:50.487 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-09T10:56:50.488 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/ 2023-06-09T10:56:50.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-06-09T10:56:50.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-06-09T10:56:50.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-06-09T10:56:50.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-06-09T10:56:50.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-09T10:56:50.488 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lkkbd.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8323.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8333.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-06-09T10:56:50.489 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/newtonkbd.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt1070.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt2160.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/stowaway.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/sunkbd.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-06-09T10:56:50.490 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-06-09T10:56:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-06-09T10:56:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/xtkbd.ko 2023-06-09T10:56:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/matrix-keymap.ko 2023-06-09T10:56:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/ 2023-06-09T10:56:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-09T10:56:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-09T10:56:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/gpio_mouse.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 334393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/psmouse.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-09T10:56:50.492 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/ 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ct82c710.ko 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/parkbd.ko 2023-06-09T10:56:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/pcips2.ko 2023-06-09T10:56:50.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ps2mult.ko 2023-06-09T10:56:50.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-09T10:56:50.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serport.ko 2023-06-09T10:56:50.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-09T10:56:50.494 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/ 2023-06-09T10:56:50.494 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/ 2023-06-09T10:56:50.494 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/ 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-88pm860x.ko 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-adp5520.ko 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-bd2802.ko 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da903x.ko 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da9052.ko 2023-06-09T10:56:50.495 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-gpio.ko 2023-06-09T10:56:50.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-09T10:56:50.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3533.ko 2023-06-09T10:56:50.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm355x.ko 2023-06-09T10:56:50.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3642.ko 2023-06-09T10:56:50.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-09T10:56:50.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp8788.ko 2023-06-09T10:56:50.496 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-max8997.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-mc13783.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-menf21bmc.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca9532.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca955x.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca963x.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-tca6507.ko 2023-06-09T10:56:50.497 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm831x-status.ko 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm8350.ko 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-09T10:56:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-09T10:56:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-09T10:56:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-09T10:56:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/ 2023-06-09T10:56:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/ 2023-06-09T10:56:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 631713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-09T10:56:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-09T10:56:50.499 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bufio.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 154097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 105553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-era.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-09T10:56:50.500 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log.ko 2023-06-09T10:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-mirror.ko 2023-06-09T10:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-09T10:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-09T10:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-09T10:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-region-hash.ko 2023-06-09T10:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-09T10:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-snapshot.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 182017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-zero.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-09T10:56:50.502 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/ 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 192737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 157873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 392777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/ 2023-06-09T10:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/ 2023-06-09T10:56:50.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 174329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-09T10:56:50.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-09T10:56:50.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-09T10:56:50.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-09T10:56:50.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-09T10:56:50.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-09T10:56:50.504 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm800.ko 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm805.ko 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm80x.ko 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona-i2c.ko 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 121721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona.ko 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/bcm590xx.ko 2023-06-09T10:56:50.505 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/cros_ec_dev.ko 2023-06-09T10:56:50.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/dln2.ko 2023-06-09T10:56:50.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/janz-cmodio.ko 2023-06-09T10:56:50.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/kempld-core.ko 2023-06-09T10:56:50.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-core.ko 2023-06-09T10:56:50.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-06-09T10:56:50.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lp3943.ko 2023-06-09T10:56:50.506 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/max8907.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-core.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/menf21bmc.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-adc.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-gpio.ko 2023-06-09T10:56:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633.ko 2023-06-09T10:56:50.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-06-09T10:56:50.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/retu-mfd.ko 2023-06-09T10:56:50.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/si476x-core.ko 2023-06-09T10:56:50.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-09T10:56:50.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-06-09T10:56:50.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps65010.ko 2023-06-09T10:56:50.508 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps6507x.ko 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wm8994.ko 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot.ko 2023-06-09T10:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/ 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/ 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/core.ko 2023-06-09T10:56:50.510 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/ 2023-06-09T10:56:50.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-09T10:56:50.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ds1682.ko 2023-06-09T10:56:50.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/dummy-irq.ko 2023-06-09T10:56:50.511 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/ 2023-06-09T10:56:50.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/echo.ko 2023-06-09T10:56:50.511 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/ 2023-06-09T10:56:50.511 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/ 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 151953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hmc6352.ko 2023-06-09T10:56:50.512 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ics932s401.ko 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/ 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-09T10:56:50.513 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-09T10:56:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/ 2023-06-09T10:56:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-09T10:56:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-09T10:56:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 304353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-09T10:56:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/phantom.ko 2023-06-09T10:56:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/ 2023-06-09T10:56:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/st_drv.ko 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/ 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 180697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ 2023-06-09T10:56:50.515 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/ 2023-06-09T10:56:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 487817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-09T10:56:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/ 2023-06-09T10:56:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/ 2023-06-09T10:56:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-09T10:56:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-09T10:56:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-09T10:56:50.516 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/ 2023-06-09T10:56:50.517 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 447113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-09T10:56:50.559 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-09T10:56:50.559 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-09T10:56:50.559 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ 2023-06-09T10:56:50.559 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/ 2023-06-09T10:56:50.559 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-09T10:56:50.559 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-09T10:56:50.560 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-09T10:56:50.560 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-09T10:56:50.560 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ 2023-06-09T10:56:50.560 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-09T10:56:50.560 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-09T10:56:50.560 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-09T10:56:50.560 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/ 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/ 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/ 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/ 2023-06-09T10:56:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-09T10:56:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/ 2023-06-09T10:56:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-09T10:56:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-09T10:56:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-09T10:56:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/ 2023-06-09T10:56:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/ 2023-06-09T10:56:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/ 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-09T10:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/ 2023-06-09T10:56:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-09T10:56:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-09T10:56:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-06-09T10:56:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1422001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-09T10:56:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 127881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-09T10:56:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/ 2023-06-09T10:56:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 311913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/ 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/ 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 323489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/ 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 193321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-09T10:56:50.565 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 345761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1038865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-09T10:56:50.566 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/ 2023-06-09T10:56:50.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/ 2023-06-09T10:56:50.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 203425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-09T10:56:50.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/ 2023-06-09T10:56:50.567 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/ 2023-06-09T10:56:50.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-09T10:56:50.567 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/ 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-09T10:56:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-09T10:56:50.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ec_bhf.ko 2023-06-09T10:56:50.569 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/ 2023-06-09T10:56:50.569 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/ 2023-06-09T10:56:50.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 280865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-09T10:56:50.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-09T10:56:50.569 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-09T10:56:50.569 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/ 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/ 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/ 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 583881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-09T10:56:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/ 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/ 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 922281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/ 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 301665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/ 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 514281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-09T10:56:50.571 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/ 2023-06-09T10:56:50.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-09T10:56:50.572 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-06-09T10:56:50.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 733977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-09T10:56:50.572 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-06-09T10:56:50.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 151753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-09T10:56:50.572 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-09T10:56:50.572 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/ 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/ 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 710297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 280409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-09T10:56:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1050633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-09T10:56:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/ 2023-06-09T10:56:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-06-09T10:56:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-09T10:56:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ 2023-06-09T10:56:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-09T10:56:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-09T10:56:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/ 2023-06-09T10:56:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 150737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-09T10:56:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/ 2023-06-09T10:56:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 136609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-09T10:56:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/ 2023-06-09T10:56:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-09T10:56:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-09T10:56:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/ 2023-06-09T10:56:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 226993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 671281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/ 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/ 2023-06-09T10:56:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/ 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/ 2023-06-09T10:56:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 893521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/ 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/ 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/ 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-09T10:56:50.579 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-09T10:56:50.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-09T10:56:50.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-09T10:56:50.580 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/ 2023-06-09T10:56:50.580 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-06-09T10:56:50.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-06-09T10:56:50.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-09T10:56:50.580 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 480697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/ 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/ 2023-06-09T10:56:50.581 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/ 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/ 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/ 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-09T10:56:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-09T10:56:50.583 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/ 2023-06-09T10:56:50.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-09T10:56:50.583 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/ 2023-06-09T10:56:50.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/defxx.ko 2023-06-09T10:56:50.583 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/ 2023-06-09T10:56:50.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/skfp.ko 2023-06-09T10:56:50.583 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/ 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 234441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/ 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-09T10:56:50.584 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-09T10:56:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-09T10:56:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/ 2023-06-09T10:56:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-09T10:56:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-09T10:56:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-gpio.ko 2023-06-09T10:56:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-09T10:56:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/ 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-09T10:56:50.586 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-09T10:56:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-09T10:56:50.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-09T10:56:50.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-09T10:56:50.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-09T10:56:50.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 92049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-09T10:56:50.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-09T10:56:50.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-09T10:56:50.588 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/ 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/plip.ko 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-09T10:56:50.589 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sb1000.ko 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/ 2023-06-09T10:56:50.590 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/ 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-09T10:56:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-09T10:56:50.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-09T10:56:50.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-09T10:56:50.592 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/ 2023-06-09T10:56:50.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-09T10:56:50.592 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/ 2023-06-09T10:56:50.592 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 290049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-09T10:56:50.592 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/ 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/ 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/ 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 255881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-09T10:56:50.593 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/ 2023-06-09T10:56:50.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-09T10:56:50.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-09T10:56:50.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-09T10:56:50.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-09T10:56:50.594 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/ 2023-06-09T10:56:50.594 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/ 2023-06-09T10:56:50.594 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pci-stub.ko 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/ 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia.ko 2023-06-09T10:56:50.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_core.ko 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/ 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/ 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/ 2023-06-09T10:56:50.596 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/ 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/ 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/ 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/ 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec.ko 2023-06-09T10:56:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-06-09T10:56:50.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-06-09T10:56:50.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-06-09T10:56:50.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-06-09T10:56:50.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-06-09T10:56:50.598 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ 2023-06-09T10:56:50.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-09T10:56:50.598 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-09T10:56:50.599 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ibm_rtl.ko 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/ 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-09T10:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-09T10:56:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-09T10:56:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-09T10:56:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-09T10:56:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-09T10:56:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-09T10:56:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-09T10:56:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/ 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_battery.ko 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_charger.ko 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq2415x_charger.ko 2023-06-09T10:56:50.602 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24190_charger.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24735-charger.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9030_battery.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9052-battery.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2760_battery.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2780_battery.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2781_battery.ko 2023-06-09T10:56:50.603 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2782_battery.ko 2023-06-09T10:56:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/gpio-charger.ko 2023-06-09T10:56:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/isp1704_charger.ko 2023-06-09T10:56:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/lp8727_charger.ko 2023-06-09T10:56:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max14577_charger.ko 2023-06-09T10:56:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17040_battery.ko 2023-06-09T10:56:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17042_battery.ko 2023-06-09T10:56:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8903_charger.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8925_power.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/pcf50633-charger.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/sbs-battery.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/test_power.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/tps65090-charger.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_backup.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_power.ko 2023-06-09T10:56:50.605 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm8350_power.ko 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/ 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/ 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/ 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-09T10:56:50.606 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-09T10:56:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-09T10:56:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ 2023-06-09T10:56:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-09T10:56:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-09T10:56:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/ 2023-06-09T10:56:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm80x.ko 2023-06-09T10:56:50.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm860x.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9052.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9055.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9063.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-09T10:56:50.608 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-09T10:56:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-09T10:56:50.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-09T10:56:50.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-09T10:56:50.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-lp8788.ko 2023-06-09T10:56:50.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-09T10:56:50.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-09T10:56:50.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-09T10:56:50.610 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t86.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8907.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8925.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8997.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8998.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-09T10:56:50.611 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-palmas.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf50633.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rc5t583.ko 2023-06-09T10:56:50.612 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-s35390a.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps6586x.ko 2023-06-09T10:56:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps65910.ko 2023-06-09T10:56:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm831x.ko 2023-06-09T10:56:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm8350.ko 2023-06-09T10:56:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-09T10:56:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ 2023-06-09T10:56:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-09T10:56:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-09T10:56:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/ 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 271033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/ 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 356081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-09T10:56:50.615 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/ 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/ 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/ 2023-06-09T10:56:50.616 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/ 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1172073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/ 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 237057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/ 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-09T10:56:50.617 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/ 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 308721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/ 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-09T10:56:50.618 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-09T10:56:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-09T10:56:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/ 2023-06-09T10:56:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 212297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-09T10:56:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-09T10:56:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/ 2023-06-09T10:56:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-09T10:56:50.619 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 154921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fdomain.ko 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/ 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 261961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 201689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/imm.ko 2023-06-09T10:56:50.620 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 266409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/ 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 317137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/ 2023-06-09T10:56:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 308257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-09T10:56:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 140057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-09T10:56:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-09T10:56:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/ 2023-06-09T10:56:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 212865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-09T10:56:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/ 2023-06-09T10:56:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2193673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-09T10:56:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/ 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/ 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 659401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/ 2023-06-09T10:56:50.623 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/ 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/ 2023-06-09T10:56:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 361249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-09T10:56:50.625 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-09T10:56:50.625 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ppa.ko 2023-06-09T10:56:50.625 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-09T10:56:50.625 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/ 2023-06-09T10:56:50.625 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1850585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-09T10:56:50.625 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-09T10:56:50.625 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/ 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 558681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qlogicfas408.ko 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 238633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 171753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 269985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-09T10:56:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-09T10:56:50.627 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-09T10:56:50.627 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-09T10:56:50.627 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-09T10:56:50.627 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-09T10:56:50.627 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/ 2023-06-09T10:56:50.627 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 161953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-09T10:56:50.627 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/xen-scsifront.ko 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 126913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/ 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/ 2023-06-09T10:56:50.628 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 731481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-09T10:56:50.629 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/ 2023-06-09T10:56:50.629 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-09T10:56:50.629 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-09T10:56:50.629 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-09T10:56:50.629 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 920681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-09T10:56:50.629 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-09T10:56:50.629 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/ 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/ 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/ 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/ 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-09T10:56:50.630 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-09T10:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-09T10:56:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-09T10:56:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-06-09T10:56:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-09T10:56:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-09T10:56:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-09T10:56:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ 2023-06-09T10:56:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/moxa.ko 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/mxser.ko 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/ 2023-06-09T10:56:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/ 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_uart.ko 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/ 2023-06-09T10:56:50.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/rp2.ko 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/sc16is7xx.ko 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/ 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 519233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ 2023-06-09T10:56:50.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-09T10:56:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-06-09T10:56:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/ 2023-06-09T10:56:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-09T10:56:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-09T10:56:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-09T10:56:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_dmem_genirq.ko 2023-06-09T10:56:50.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_mf624.ko 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_netx.ko 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/ 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/ 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/c67x00.ko 2023-06-09T10:56:50.637 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/ 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-09T10:56:50.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-09T10:56:50.639 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-09T10:56:50.639 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ 2023-06-09T10:56:50.639 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ulpi.ko 2023-06-09T10:56:50.639 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/ 2023-06-09T10:56:50.639 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-06-09T10:56:50.639 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/ 2023-06-09T10:56:50.639 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 438457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3.ko 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/ 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/ 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_ether.ko 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_serial.ko 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-06-09T10:56:50.640 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-06-09T10:56:50.641 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/ 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-06-09T10:56:50.642 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-06-09T10:56:50.643 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-06-09T10:56:50.643 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-06-09T10:56:50.643 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-06-09T10:56:50.643 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-06-09T10:56:50.643 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-06-09T10:56:50.643 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-06-09T10:56:50.643 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/libcomposite.ko 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/ 2023-06-09T10:56:50.644 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/ 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 157545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2272.ko 2023-06-09T10:56:50.645 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2280.ko 2023-06-09T10:56:50.646 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-06-09T10:56:50.646 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-06-09T10:56:50.646 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-06-09T10:56:50.646 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-06-09T10:56:50.646 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-06-09T10:56:50.646 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ 2023-06-09T10:56:50.646 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/bcma-hcd.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/isp116x-hcd.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811_cs.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ssb-hcd.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-06-09T10:56:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/ 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cytherm.ko 2023-06-09T10:56:50.648 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ehset.ko 2023-06-09T10:56:50.649 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-09T10:56:50.649 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-09T10:56:50.649 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-09T10:56:50.649 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-09T10:56:50.649 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-09T10:56:50.649 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-09T10:56:50.649 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/lvstest.ko 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/ 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-09T10:56:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbtest.ko 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/ 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/usbmon.ko 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/ 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 294937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/musb_hdrc.ko 2023-06-09T10:56:50.651 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/ 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-isp1301.ko 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-tahvo.ko 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-09T10:56:50.652 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-09T10:56:50.653 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-09T10:56:50.653 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-09T10:56:50.653 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-09T10:56:50.653 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-09T10:56:50.653 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-09T10:56:50.653 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-09T10:56:50.653 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/f81232.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 174729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 136761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-09T10:56:50.654 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-09T10:56:50.655 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-09T10:56:50.655 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-09T10:56:50.655 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-09T10:56:50.655 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-09T10:56:50.655 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-09T10:56:50.655 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/metro-usb.ko 2023-06-09T10:56:50.655 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mxuport.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 187713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-09T10:56:50.656 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-09T10:56:50.657 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-09T10:56:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-09T10:56:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-09T10:56:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-09T10:56:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-09T10:56:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usbserial.ko 2023-06-09T10:56:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-09T10:56:50.658 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/wishbone-serial.ko 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-09T10:56:50.659 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-09T10:56:50.660 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-09T10:56:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-09T10:56:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-09T10:56:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/ 2023-06-09T10:56:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-09T10:56:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-09T10:56:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 105225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-09T10:56:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/ 2023-06-09T10:56:50.662 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/ 2023-06-09T10:56:50.662 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-09T10:56:50.662 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-09T10:56:50.662 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-09T10:56:50.662 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-09T10:56:50.662 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/ 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/ 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/ 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-06-09T10:56:50.663 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/aat2870_bl.ko 2023-06-09T10:56:50.664 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp5520_bl.ko 2023-06-09T10:56:50.664 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8860_bl.ko 2023-06-09T10:56:50.664 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8870_bl.ko 2023-06-09T10:56:50.664 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-09T10:56:50.664 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/as3711_bl.ko 2023-06-09T10:56:50.664 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/bd6107.ko 2023-06-09T10:56:50.664 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da903x_bl.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da9052_bl.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/gpio_backlight.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/kb3886_bl.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3533_bl.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3639_bl.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lv5207lp.ko 2023-06-09T10:56:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/max8925_bl.ko 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pandora_bl.ko 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/wm831x_bl.ko 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/ 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-09T10:56:50.666 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-09T10:56:50.667 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/matrox_w1.ko 2023-06-09T10:56:50.667 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/w1-gpio.ko 2023-06-09T10:56:50.667 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/ 2023-06-09T10:56:50.667 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-09T10:56:50.667 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-09T10:56:50.667 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-09T10:56:50.667 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-09T10:56:50.668 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/acquirewdt.ko 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/advantechwdt.ko 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/cpu5wdt.ko 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9052_wdt.ko 2023-06-09T10:56:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9055_wdt.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9063_wdt.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/dw_wdt.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/eurotechwdt.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-09T10:56:50.670 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-09T10:56:50.671 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-09T10:56:50.671 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-09T10:56:50.671 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-09T10:56:50.671 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-09T10:56:50.671 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-09T10:56:50.671 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/kempld_wdt.ko 2023-06-09T10:56:50.671 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/mena21_wdt.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pc87413_wdt.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-09T10:56:50.672 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/retu_wdt.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sc1200wdt.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-09T10:56:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-09T10:56:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/twl4030_wdt.ko 2023-06-09T10:56:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-09T10:56:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-09T10:56:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-09T10:56:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-09T10:56:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wafer5823wdt.ko 2023-06-09T10:56:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm831x_wdt.ko 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm8350_wdt.ko 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/ 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-09T10:56:50.675 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/ 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-scsiback.ko 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/ 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/ 2023-06-09T10:56:50.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 165401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-09T10:56:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/ 2023-06-09T10:56:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/adfs.ko 2023-06-09T10:56:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/ 2023-06-09T10:56:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 162449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-09T10:56:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/ 2023-06-09T10:56:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 924617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/kafs.ko 2023-06-09T10:56:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/ 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/autofs4.ko 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/ 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/ 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/bfs.ko 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/ 2023-06-09T10:56:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 3445465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/ 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 299849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1230257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/ 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2619753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/ 2023-06-09T10:56:50.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-09T10:56:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/ 2023-06-09T10:56:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 105857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/configfs.ko 2023-06-09T10:56:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/ 2023-06-09T10:56:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-09T10:56:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/ 2023-06-09T10:56:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 631321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-09T10:56:50.707 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/ 2023-06-09T10:56:50.707 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/efs.ko 2023-06-09T10:56:50.708 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/ 2023-06-09T10:56:50.708 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1472873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-09T10:56:50.708 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/ 2023-06-09T10:56:50.708 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-09T10:56:50.708 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/ 2023-06-09T10:56:50.708 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/freevxfs.ko 2023-06-09T10:56:50.708 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/ 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 218609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/ 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/ 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1221153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/ 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-09T10:56:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/ 2023-06-09T10:56:50.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 221441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-09T10:56:50.710 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/ 2023-06-09T10:56:50.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 193465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/hpfs.ko 2023-06-09T10:56:50.710 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/ 2023-06-09T10:56:50.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-09T10:56:50.710 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/ 2023-06-09T10:56:50.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 420305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/ 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 276841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/ 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/ 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/ 2023-06-09T10:56:50.711 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/ 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/ 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/ 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1002305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv2.ko 2023-06-09T10:56:50.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-09T10:56:50.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2003321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-09T10:56:50.713 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/ 2023-06-09T10:56:50.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-09T10:56:50.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-09T10:56:50.713 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/ 2023-06-09T10:56:50.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1407361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-09T10:56:50.713 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/ 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 587585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/ 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-09T10:56:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_ascii.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-09T10:56:50.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-09T10:56:50.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-09T10:56:50.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-09T10:56:50.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-09T10:56:50.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-09T10:56:50.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-09T10:56:50.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-09T10:56:50.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-09T10:56:50.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 165641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-09T10:56:50.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-09T10:56:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-09T10:56:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-09T10:56:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-09T10:56:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-09T10:56:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-09T10:56:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-09T10:56:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ 2023-06-09T10:56:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 218905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ntfs.ko 2023-06-09T10:56:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ 2023-06-09T10:56:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ 2023-06-09T10:56:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 241057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-09T10:56:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ 2023-06-09T10:56:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 439521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-09T10:56:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ 2023-06-09T10:56:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2511193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/ 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/omfs.ko 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/ 2023-06-09T10:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 320569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/ 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/qnx4.ko 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/ 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/qnx6.ko 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/ 2023-06-09T10:56:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_tree.ko 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v1.ko 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v2.ko 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/ 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 530593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/ 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/ 2023-06-09T10:56:50.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/ 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 131513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/ 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/ 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 248145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-09T10:56:50.725 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ 2023-06-09T10:56:50.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 160753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-09T10:56:50.726 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/ 2023-06-09T10:56:50.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 3854681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-09T10:56:50.726 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/ 2023-06-09T10:56:50.726 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/ 2023-06-09T10:56:50.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/locktorture.ko 2023-06-09T10:56:50.726 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/ 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/test_udelay.ko 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc7.ko 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/ 2023-06-09T10:56:50.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-09T10:56:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-09T10:56:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/interval_tree_test.ko 2023-06-09T10:56:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-09T10:56:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-09T10:56:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/ 2023-06-09T10:56:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-09T10:56:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/ 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/memory-notifier-error-inject.ko 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/notifier-error-inject.ko 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/percpu_test.ko 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/pm-notifier-error-inject.ko 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/ 2023-06-09T10:56:50.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/rbtree_test.ko 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/ 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-kstrtox.ko 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-string_helpers.ko 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4760649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_bpf.ko 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_firmware.ko 2023-06-09T10:56:50.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_module.ko 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_user_copy.ko 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/ 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/xz_dec_test.ko 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/ 2023-06-09T10:56:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-09T10:56:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ 2023-06-09T10:56:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/ 2023-06-09T10:56:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-09T10:56:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-09T10:56:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-09T10:56:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-09T10:56:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/ 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-09T10:56:50.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/ 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/ 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 191689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-09T10:56:50.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/ 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 652649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/ 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 769721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-09T10:56:50.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-09T10:56:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-09T10:56:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-09T10:56:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-09T10:56:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-09T10:56:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-09T10:56:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-09T10:56:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-09T10:56:50.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/ 2023-06-09T10:56:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1030089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-09T10:56:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/ 2023-06-09T10:56:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-09T10:56:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/ 2023-06-09T10:56:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-09T10:56:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-09T10:56:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-09T10:56:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/ 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 380185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/ 2023-06-09T10:56:50.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/hsr.ko 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 245745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-09T10:56:50.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-09T10:56:50.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-09T10:56:50.743 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ 2023-06-09T10:56:50.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-09T10:56:50.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-09T10:56:50.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-09T10:56:50.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ip_tables.ko 2023-06-09T10:56:50.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-09T10:56:50.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-09T10:56:50.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-09T10:56:50.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-09T10:56:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-09T10:56:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-09T10:56:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-09T10:56:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-09T10:56:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-09T10:56:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-09T10:56:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-09T10:56:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-09T10:56:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_gre.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/mip6.ko 2023-06-09T10:56:50.749 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ 2023-06-09T10:56:50.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-09T10:56:50.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-06-09T10:56:50.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-09T10:56:50.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-09T10:56:50.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-09T10:56:50.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-09T10:56:50.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-09T10:56:50.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-09T10:56:50.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-09T10:56:50.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-09T10:56:50.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-09T10:56:50.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-09T10:56:50.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-09T10:56:50.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-09T10:56:50.753 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/ 2023-06-09T10:56:50.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/ 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-09T10:56:50.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/ 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/lapb.ko 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/ 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc2.ko 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/ 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 280225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-09T10:56:50.755 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/ 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 116897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-09T10:56:50.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-09T10:56:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-09T10:56:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-09T10:56:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 105017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-09T10:56:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-09T10:56:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-09T10:56:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-09T10:56:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 116097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 410481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-09T10:56:50.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-09T10:56:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 397561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-09T10:56:50.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-09T10:56:50.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-09T10:56:50.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-09T10:56:50.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-09T10:56:50.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-09T10:56:50.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-09T10:56:50.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-09T10:56:50.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 91657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-09T10:56:50.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 579473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-09T10:56:50.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-09T10:56:50.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-09T10:56:50.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-09T10:56:50.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-09T10:56:50.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-09T10:56:50.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-09T10:56:50.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-09T10:56:50.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-09T10:56:50.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_osf.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-09T10:56:50.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_synproxy.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tproxy.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/x_tables.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-09T10:56:50.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-09T10:56:50.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-09T10:56:50.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-09T10:56:50.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-09T10:56:50.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-09T10:56:50.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-09T10:56:50.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-09T10:56:50.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-09T10:56:50.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-09T10:56:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-09T10:56:50.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-09T10:56:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-09T10:56:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-09T10:56:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-09T10:56:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-09T10:56:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-09T10:56:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-09T10:56:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-09T10:56:50.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-09T10:56:50.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-09T10:56:50.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpudp.ko 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/ 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/ 2023-06-09T10:56:50.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-09T10:56:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/ 2023-06-09T10:56:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 377897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-09T10:56:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-09T10:56:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-09T10:56:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-09T10:56:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/ 2023-06-09T10:56:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/ 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/phonet.ko 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/pn_pep.ko 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/ 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 248865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 164961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-09T10:56:50.778 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/ 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 806905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/rxrpc.ko 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/ 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-09T10:56:50.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-09T10:56:50.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-09T10:56:50.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-09T10:56:50.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-09T10:56:50.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-09T10:56:50.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-09T10:56:50.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-09T10:56:50.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_cgroup.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-09T10:56:50.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq_codel.ko 2023-06-09T10:56:50.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-09T10:56:50.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-09T10:56:50.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-09T10:56:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-09T10:56:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/ 2023-06-09T10:56:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 929065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-09T10:56:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-09T10:56:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/ 2023-06-09T10:56:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/ 2023-06-09T10:56:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 327953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1427857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/ 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 681617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/ 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 853649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-09T10:56:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/ 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/ 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 92577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-09T10:56:50.787 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/ 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/x25.ko 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/ 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_algo.ko 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_user.ko 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/ 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/ 2023-06-09T10:56:50.788 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-09T10:56:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 636518 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-09T10:56:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 622189 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-09T10:56:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7605 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-09T10:56:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.alias.bin 2023-06-09T10:56:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9788 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-09T10:56:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68530 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-09T10:56:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146382 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 232620 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 210 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72719 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 251838 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 306636 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/ 2023-06-09T10:56:50.790 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/ 2023-06-09T10:56:50.791 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/ 2023-06-09T10:56:50.791 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T10:56:50.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/changelog.Debian.gz 2023-06-09T10:56:50.791 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 691 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/copyright 2023-06-09T10:56:50.792 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:50.792 INFO:teuthology.task.kernel:searching for kernel 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:50.793 DEBUG:teuthology.orchestra.run.smithi078:> egrep '(submenu|menuentry.*6.4.0-rc2-g10b2f20a4f46).*{' /boot/grub/grub.cfg 2023-06-09T10:56:50.801 INFO:teuthology.orchestra.run.smithi078.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T10:56:50.802 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T10:56:50.802 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T10:56:50.802 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-06-09T10:56:50.802 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:50.803 DEBUG:teuthology.orchestra.run.smithi078:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-06-09T10:56:50.844 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-06-09T10:56:51.554 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-06-09T10:56:51.558 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T10:56:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-06-09T10:56:51.829 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:51.841 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:56:52.228 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T10:56:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T10:56:53.880 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-06-09T10:57:02.938 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2023-06-09T10:57:02.955 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T10:57:02.982 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-06-09T10:57:03.408 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:03.432 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:03.834 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T10:57:03.846 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T10:57:06.315 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-06-09T10:57:06.490 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-deb -c /tmp/linux-image.deb 2023-06-09T10:57:06.500 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./ 2023-06-09T10:57:06.500 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./boot/ 2023-06-09T10:57:06.501 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 4322013 2023-06-01 02:19 ./boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:06.514 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 167348 2023-06-01 02:19 ./boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:06.521 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11235616 2023-06-01 02:19 ./boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:06.539 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/ 2023-06-09T10:57:06.539 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/ 2023-06-09T10:57:06.539 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postinst.d/ 2023-06-09T10:57:06.540 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postrm.d/ 2023-06-09T10:57:06.540 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/preinst.d/ 2023-06-09T10:57:06.540 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/prerm.d/ 2023-06-09T10:57:06.540 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/ 2023-06-09T10:57:06.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/ 2023-06-09T10:57:06.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T10:57:06.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/ 2023-06-09T10:57:06.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/ 2023-06-09T10:57:06.542 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/ 2023-06-09T10:57:06.542 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ 2023-06-09T10:57:06.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 490273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/aesni-intel.ko 2023-06-09T10:57:06.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-09T10:57:06.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-09T10:57:06.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-09T10:57:06.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 92281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-09T10:57:06.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-09T10:57:06.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 152065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-09T10:57:06.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-09T10:57:06.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-09T10:57:06.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-09T10:57:06.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-09T10:57:06.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-09T10:57:06.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-09T10:57:06.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-09T10:57:06.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-09T10:57:06.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-09T10:57:06.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-09T10:57:06.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-09T10:57:06.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-09T10:57:06.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-09T10:57:06.548 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/ 2023-06-09T10:57:06.548 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/ 2023-06-09T10:57:06.548 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/ 2023-06-09T10:57:06.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-09T10:57:06.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpuid.ko 2023-06-09T10:57:06.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/msr.ko 2023-06-09T10:57:06.549 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/ 2023-06-09T10:57:06.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 346401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-09T10:57:06.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 972121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-09T10:57:06.587 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2209361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-09T10:57:06.587 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ 2023-06-09T10:57:06.588 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/af_alg.ko 2023-06-09T10:57:06.588 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_hash.ko 2023-06-09T10:57:06.588 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_skcipher.ko 2023-06-09T10:57:06.588 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-09T10:57:06.588 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-09T10:57:06.588 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/ 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/ 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-09T10:57:06.589 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-09T10:57:06.590 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-09T10:57:06.590 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-09T10:57:06.590 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-09T10:57:06.590 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-09T10:57:06.590 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-09T10:57:06.590 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-09T10:57:06.591 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-09T10:57:06.591 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-09T10:57:06.591 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-09T10:57:06.591 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-09T10:57:06.591 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-09T10:57:06.591 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-09T10:57:06.591 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-09T10:57:06.592 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cryptd.ko 2023-06-09T10:57:06.592 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-09T10:57:06.592 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_simd.ko 2023-06-09T10:57:06.592 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-09T10:57:06.592 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-09T10:57:06.592 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-09T10:57:06.592 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lrw.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-09T10:57:06.593 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 149081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-09T10:57:06.594 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-09T10:57:06.595 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-09T10:57:06.595 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-09T10:57:06.595 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-09T10:57:06.595 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-09T10:57:06.595 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-09T10:57:06.595 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-09T10:57:06.595 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xts.ko 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_extlog.ko 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/ 2023-06-09T10:57:06.596 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/einj.ko 2023-06-09T10:57:06.597 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-09T10:57:06.597 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-09T10:57:06.597 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-09T10:57:06.597 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-09T10:57:06.597 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 98193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-09T10:57:06.597 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ 2023-06-09T10:57:06.598 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-09T10:57:06.598 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 88505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci.ko 2023-06-09T10:57:06.598 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-09T10:57:06.598 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 85073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci.ko 2023-06-09T10:57:06.598 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-09T10:57:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-09T10:57:06.600 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-09T10:57:06.600 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-09T10:57:06.600 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-09T10:57:06.600 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-09T10:57:06.600 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-09T10:57:06.600 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-09T10:57:06.600 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-09T10:57:06.601 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-09T10:57:06.601 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-09T10:57:06.601 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_legacy.ko 2023-06-09T10:57:06.601 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-09T10:57:06.602 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-09T10:57:06.602 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-09T10:57:06.602 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-09T10:57:06.602 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-09T10:57:06.603 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-09T10:57:06.603 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-09T10:57:06.603 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-09T10:57:06.603 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-09T10:57:06.604 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-09T10:57:06.604 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-09T10:57:06.604 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-09T10:57:06.605 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-09T10:57:06.605 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_radisys.ko 2023-06-09T10:57:06.605 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-09T10:57:06.606 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rz1000.ko 2023-06-09T10:57:06.606 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-09T10:57:06.606 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-09T10:57:06.606 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-09T10:57:06.606 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-09T10:57:06.607 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-09T10:57:06.607 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-09T10:57:06.607 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-09T10:57:06.607 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-09T10:57:06.607 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-09T10:57:06.607 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-09T10:57:06.608 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-09T10:57:06.608 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-09T10:57:06.608 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-09T10:57:06.608 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-09T10:57:06.608 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-09T10:57:06.608 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-09T10:57:06.608 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-09T10:57:06.609 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-09T10:57:06.609 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-09T10:57:06.609 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-09T10:57:06.609 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ 2023-06-09T10:57:06.609 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-09T10:57:06.609 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/ 2023-06-09T10:57:06.610 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 121569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-09T10:57:06.610 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/ 2023-06-09T10:57:06.610 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/ 2023-06-09T10:57:06.610 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 113433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-09T10:57:06.610 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/ 2023-06-09T10:57:06.610 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 968017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-09T10:57:06.610 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 173105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/ 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 94185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 114049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/ 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 110145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 254273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-09T10:57:06.611 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/ 2023-06-09T10:57:06.612 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 98017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-09T10:57:06.612 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/ 2023-06-09T10:57:06.612 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-09T10:57:06.612 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ 2023-06-09T10:57:06.612 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/applicom.ko 2023-06-09T10:57:06.612 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-09T10:57:06.612 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/ 2023-06-09T10:57:06.613 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-09T10:57:06.613 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-09T10:57:06.613 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-09T10:57:06.613 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-09T10:57:06.613 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-09T10:57:06.613 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ 2023-06-09T10:57:06.613 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-09T10:57:06.614 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 147521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-09T10:57:06.614 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-09T10:57:06.614 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 138881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-09T10:57:06.614 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-09T10:57:06.614 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-09T10:57:06.614 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-09T10:57:06.614 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/ 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/nvram.ko 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/ 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-06-09T10:57:06.615 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-06-09T10:57:06.616 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-06-09T10:57:06.616 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-09T10:57:06.616 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-09T10:57:06.616 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-06-09T10:57:06.616 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/ 2023-06-09T10:57:06.616 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_class.ko 2023-06-09T10:57:06.616 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_core.ko 2023-06-09T10:57:06.617 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-06-09T10:57:06.617 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/ 2023-06-09T10:57:06.617 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-palmas.ko 2023-06-09T10:57:06.617 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-si5351.ko 2023-06-09T10:57:06.617 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-twl6040.ko 2023-06-09T10:57:06.617 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-wm831x.ko 2023-06-09T10:57:06.617 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/ 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 231545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-09T10:57:06.618 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/ 2023-06-09T10:57:06.619 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/ 2023-06-09T10:57:06.619 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/ 2023-06-09T10:57:06.619 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 396281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-09T10:57:06.619 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-06-09T10:57:06.619 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-09T10:57:06.619 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-09T10:57:06.620 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-09T10:57:06.620 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/ 2023-06-09T10:57:06.620 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-09T10:57:06.620 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/ 2023-06-09T10:57:06.620 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-09T10:57:06.620 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ 2023-06-09T10:57:06.621 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/ 2023-06-09T10:57:06.621 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-09T10:57:06.621 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ 2023-06-09T10:57:06.621 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-09T10:57:06.621 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ 2023-06-09T10:57:06.621 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-09T10:57:06.622 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-09T10:57:06.622 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-09T10:57:06.622 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-09T10:57:06.622 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-09T10:57:06.622 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-09T10:57:06.622 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-09T10:57:06.623 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-09T10:57:06.623 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-09T10:57:06.623 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-09T10:57:06.623 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-09T10:57:06.623 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-09T10:57:06.623 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-09T10:57:06.623 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/ 2023-06-09T10:57:06.624 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-gpio.ko 2023-06-09T10:57:06.624 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max14577.ko 2023-06-09T10:57:06.624 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max77693.ko 2023-06-09T10:57:06.624 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max8997.ko 2023-06-09T10:57:06.624 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-palmas.ko 2023-06-09T10:57:06.624 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-rt8973a.ko 2023-06-09T10:57:06.624 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-sm5502.ko 2023-06-09T10:57:06.625 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/ 2023-06-09T10:57:06.625 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/dmi-sysfs.ko 2023-06-09T10:57:06.625 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/ 2023-06-09T10:57:06.625 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/efi-pstore.ko 2023-06-09T10:57:06.625 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-09T10:57:06.626 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/ 2023-06-09T10:57:06.626 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-adp5520.ko 2023-06-09T10:57:06.626 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-amd8111.ko 2023-06-09T10:57:06.626 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-arizona.ko 2023-06-09T10:57:06.626 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9052.ko 2023-06-09T10:57:06.627 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9055.ko 2023-06-09T10:57:06.627 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-dln2.ko 2023-06-09T10:57:06.627 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-f7188x.ko 2023-06-09T10:57:06.627 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-generic.ko 2023-06-09T10:57:06.628 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-09T10:57:06.628 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-06-09T10:57:06.628 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-kempld.ko 2023-06-09T10:57:06.628 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-lp3943.ko 2023-06-09T10:57:06.628 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max7300.ko 2023-06-09T10:57:06.629 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max730x.ko 2023-06-09T10:57:06.629 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max732x.ko 2023-06-09T10:57:06.629 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-06-09T10:57:06.629 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pca953x.ko 2023-06-09T10:57:06.630 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pcf857x.ko 2023-06-09T10:57:06.630 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-rdc321x.ko 2023-06-09T10:57:06.630 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch.ko 2023-06-09T10:57:06.630 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch311x.ko 2023-06-09T10:57:06.630 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-tps65912.ko 2023-06-09T10:57:06.631 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl4030.ko 2023-06-09T10:57:06.631 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl6040.ko 2023-06-09T10:57:06.631 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-09T10:57:06.631 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-vx855.ko 2023-06-09T10:57:06.632 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm831x.ko 2023-06-09T10:57:06.632 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8350.ko 2023-06-09T10:57:06.632 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8994.ko 2023-06-09T10:57:06.632 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/ 2023-06-09T10:57:06.632 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-a4tech.ko 2023-06-09T10:57:06.633 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-apple.ko 2023-06-09T10:57:06.633 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-09T10:57:06.633 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-09T10:57:06.633 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-09T10:57:06.634 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-belkin.ko 2023-06-09T10:57:06.634 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cherry.ko 2023-06-09T10:57:06.634 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-chicony.ko 2023-06-09T10:57:06.634 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cp2112.ko 2023-06-09T10:57:06.635 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cypress.ko 2023-06-09T10:57:06.635 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-09T10:57:06.635 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-09T10:57:06.635 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-09T10:57:06.635 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-09T10:57:06.635 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ezkey.ko 2023-06-09T10:57:06.635 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-09T10:57:06.636 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-generic.ko 2023-06-09T10:57:06.636 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-09T10:57:06.636 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-09T10:57:06.636 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-09T10:57:06.636 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-09T10:57:06.636 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-09T10:57:06.636 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-09T10:57:06.637 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-09T10:57:06.637 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kensington.ko 2023-06-09T10:57:06.637 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-09T10:57:06.637 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-09T10:57:06.637 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-09T10:57:06.637 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-09T10:57:06.638 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-09T10:57:06.638 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lg-g15.ko 2023-06-09T10:57:06.638 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-09T10:57:06.638 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-09T10:57:06.638 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech.ko 2023-06-09T10:57:06.638 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-magicmouse.ko 2023-06-09T10:57:06.638 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-microsoft.ko 2023-06-09T10:57:06.639 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-monterey.ko 2023-06-09T10:57:06.639 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-09T10:57:06.639 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ntrig.ko 2023-06-09T10:57:06.639 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-09T10:57:06.639 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-09T10:57:06.639 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-09T10:57:06.639 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-09T10:57:06.640 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-09T10:57:06.640 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-09T10:57:06.640 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-09T10:57:06.640 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-09T10:57:06.640 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-09T10:57:06.640 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-09T10:57:06.641 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-09T10:57:06.641 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-09T10:57:06.641 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-09T10:57:06.641 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-09T10:57:06.642 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-09T10:57:06.642 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-09T10:57:06.642 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-09T10:57:06.642 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-09T10:57:06.643 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-09T10:57:06.643 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-09T10:57:06.643 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-09T10:57:06.643 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-09T10:57:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-09T10:57:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-09T10:57:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-09T10:57:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-09T10:57:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-09T10:57:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-09T10:57:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 143417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-09T10:57:06.645 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-09T10:57:06.646 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-09T10:57:06.646 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-09T10:57:06.646 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 261777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid.ko 2023-06-09T10:57:06.646 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-09T10:57:06.646 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/ 2023-06-09T10:57:06.646 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbhid.ko 2023-06-09T10:57:06.646 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbkbd.ko 2023-06-09T10:57:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbmouse.ko 2023-06-09T10:57:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 216833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-09T10:57:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/ 2023-06-09T10:57:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-09T10:57:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-09T10:57:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 292521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-09T10:57:06.647 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ 2023-06-09T10:57:06.648 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-09T10:57:06.648 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-09T10:57:06.648 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-09T10:57:06.648 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-09T10:57:06.648 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-09T10:57:06.649 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-09T10:57:06.649 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-09T10:57:06.649 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-09T10:57:06.649 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-09T10:57:06.650 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-09T10:57:06.650 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-09T10:57:06.650 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-09T10:57:06.650 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-09T10:57:06.651 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-09T10:57:06.651 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-09T10:57:06.651 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-09T10:57:06.652 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 65145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-09T10:57:06.652 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-09T10:57:06.652 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-09T10:57:06.653 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-09T10:57:06.653 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-09T10:57:06.653 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-09T10:57:06.653 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-09T10:57:06.654 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-09T10:57:06.654 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-09T10:57:06.654 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9052-hwmon.ko 2023-06-09T10:57:06.655 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9055-hwmon.ko 2023-06-09T10:57:06.655 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-09T10:57:06.655 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 99481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-09T10:57:06.656 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-09T10:57:06.656 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-09T10:57:06.656 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-09T10:57:06.656 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc2103.ko 2023-06-09T10:57:06.656 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-09T10:57:06.657 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-09T10:57:06.657 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 94473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-09T10:57:06.657 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-09T10:57:06.657 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-09T10:57:06.658 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-09T10:57:06.658 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-09T10:57:06.658 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-09T10:57:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-09T10:57:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-09T10:57:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hih6130.ko 2023-06-09T10:57:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-09T10:57:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-09T10:57:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-09T10:57:06.659 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-09T10:57:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-09T10:57:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-09T10:57:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-09T10:57:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 128913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-09T10:57:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/jc42.ko 2023-06-09T10:57:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-09T10:57:06.660 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-09T10:57:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-09T10:57:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-09T10:57:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-09T10:57:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-09T10:57:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-09T10:57:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-09T10:57:06.661 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-09T10:57:06.662 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-09T10:57:06.663 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-09T10:57:06.664 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-09T10:57:06.664 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-09T10:57:06.664 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-09T10:57:06.664 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-09T10:57:06.664 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-09T10:57:06.664 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-09T10:57:06.664 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-09T10:57:06.665 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mc13783-adc.ko 2023-06-09T10:57:06.665 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-09T10:57:06.665 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-06-09T10:57:06.665 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-09T10:57:06.665 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 114577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-09T10:57:06.665 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-09T10:57:06.665 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 82169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-09T10:57:06.666 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-09T10:57:06.667 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-09T10:57:06.667 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-09T10:57:06.667 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-09T10:57:06.667 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 79353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-09T10:57:06.667 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-09T10:57:06.667 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-09T10:57:06.667 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-09T10:57:06.668 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-09T10:57:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-09T10:57:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smm665.ko 2023-06-09T10:57:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-09T10:57:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-09T10:57:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-09T10:57:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-09T10:57:06.669 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-09T10:57:06.670 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-09T10:57:06.671 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-09T10:57:06.671 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-09T10:57:06.671 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-09T10:57:06.671 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-09T10:57:06.671 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-09T10:57:06.671 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 119329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-09T10:57:06.671 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-09T10:57:06.672 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-09T10:57:06.672 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-06-09T10:57:06.672 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-06-09T10:57:06.672 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/ 2023-06-09T10:57:06.672 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/ 2023-06-09T10:57:06.672 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-09T10:57:06.672 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/ 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-09T10:57:06.673 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-06-09T10:57:06.674 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-06-09T10:57:06.675 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-09T10:57:06.676 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-09T10:57:06.676 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-09T10:57:06.676 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-06-09T10:57:06.676 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-09T10:57:06.676 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-09T10:57:06.676 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-06-09T10:57:06.676 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-06-09T10:57:06.677 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-09T10:57:06.677 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-06-09T10:57:06.677 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-09T10:57:06.677 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-09T10:57:06.677 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-09T10:57:06.677 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-09T10:57:06.677 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-06-09T10:57:06.678 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-09T10:57:06.678 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-09T10:57:06.678 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-09T10:57:06.678 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/ 2023-06-09T10:57:06.678 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-06-09T10:57:06.678 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-06-09T10:57:06.678 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 264409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 849113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 320185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 96801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-09T10:57:06.679 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 272097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-09T10:57:06.680 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-09T10:57:06.680 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ 2023-06-09T10:57:06.680 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/ 2023-06-09T10:57:06.680 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 492377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-09T10:57:06.680 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/ 2023-06-09T10:57:06.680 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 419097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-09T10:57:06.680 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/ 2023-06-09T10:57:06.681 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 733385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-09T10:57:06.776 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ 2023-06-09T10:57:06.776 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 296481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-09T10:57:06.776 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ 2023-06-09T10:57:06.776 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 153561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-06-09T10:57:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/ 2023-06-09T10:57:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 168905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-06-09T10:57:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ 2023-06-09T10:57:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ 2023-06-09T10:57:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 263057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-09T10:57:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ 2023-06-09T10:57:06.777 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 111049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 128961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 129385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ 2023-06-09T10:57:06.778 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/evbug.ko 2023-06-09T10:57:06.779 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ff-memless.ko 2023-06-09T10:57:06.779 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ 2023-06-09T10:57:06.779 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-09T10:57:06.779 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-09T10:57:06.779 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-09T10:57:06.779 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-09T10:57:06.779 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-09T10:57:06.780 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-09T10:57:06.780 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/ 2023-06-09T10:57:06.780 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-06-09T10:57:06.780 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-06-09T10:57:06.780 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-06-09T10:57:06.780 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-06-09T10:57:06.780 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lkkbd.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8323.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8333.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-06-09T10:57:06.781 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-06-09T10:57:06.782 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/newtonkbd.ko 2023-06-09T10:57:06.782 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-06-09T10:57:06.782 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt1070.ko 2023-06-09T10:57:06.782 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt2160.ko 2023-06-09T10:57:06.782 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-06-09T10:57:06.782 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/stowaway.ko 2023-06-09T10:57:06.782 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/sunkbd.ko 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/xtkbd.ko 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/matrix-keymap.ko 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/ 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-09T10:57:06.783 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-09T10:57:06.784 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 123497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-09T10:57:06.784 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-09T10:57:06.784 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/gpio_mouse.ko 2023-06-09T10:57:06.784 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 334393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/psmouse.ko 2023-06-09T10:57:06.784 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-09T10:57:06.784 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-09T10:57:06.785 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-09T10:57:06.785 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-09T10:57:06.785 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/ 2023-06-09T10:57:06.785 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-09T10:57:06.786 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ 2023-06-09T10:57:06.786 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-09T10:57:06.786 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-09T10:57:06.787 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ct82c710.ko 2023-06-09T10:57:06.787 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-09T10:57:06.787 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/parkbd.ko 2023-06-09T10:57:06.787 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/pcips2.ko 2023-06-09T10:57:06.788 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ps2mult.ko 2023-06-09T10:57:06.788 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-09T10:57:06.788 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serport.ko 2023-06-09T10:57:06.789 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-09T10:57:06.789 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/ 2023-06-09T10:57:06.789 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/ 2023-06-09T10:57:06.789 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-09T10:57:06.790 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/ 2023-06-09T10:57:06.790 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-88pm860x.ko 2023-06-09T10:57:06.790 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-adp5520.ko 2023-06-09T10:57:06.791 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-bd2802.ko 2023-06-09T10:57:06.791 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-09T10:57:06.791 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da903x.ko 2023-06-09T10:57:06.791 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da9052.ko 2023-06-09T10:57:06.792 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-gpio.ko 2023-06-09T10:57:06.792 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-09T10:57:06.792 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3533.ko 2023-06-09T10:57:06.792 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm355x.ko 2023-06-09T10:57:06.793 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3642.ko 2023-06-09T10:57:06.793 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-09T10:57:06.793 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp8788.ko 2023-06-09T10:57:06.793 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-max8997.ko 2023-06-09T10:57:06.793 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-mc13783.ko 2023-06-09T10:57:06.793 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-menf21bmc.ko 2023-06-09T10:57:06.794 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca9532.ko 2023-06-09T10:57:06.794 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca955x.ko 2023-06-09T10:57:06.794 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca963x.ko 2023-06-09T10:57:06.794 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-09T10:57:06.794 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-tca6507.ko 2023-06-09T10:57:06.794 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm831x-status.ko 2023-06-09T10:57:06.794 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm8350.ko 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-09T10:57:06.795 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-09T10:57:06.796 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-09T10:57:06.796 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/ 2023-06-09T10:57:06.796 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/ 2023-06-09T10:57:06.796 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 631713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-09T10:57:06.796 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-09T10:57:06.797 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 86033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bufio.ko 2023-06-09T10:57:06.797 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-09T10:57:06.797 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 154097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-09T10:57:06.797 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 105553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-09T10:57:06.797 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-09T10:57:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-era.ko 2023-06-09T10:57:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-09T10:57:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-09T10:57:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log.ko 2023-06-09T10:57:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-mirror.ko 2023-06-09T10:57:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-09T10:57:06.798 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-09T10:57:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-09T10:57:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-region-hash.ko 2023-06-09T10:57:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-09T10:57:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-09T10:57:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-snapshot.ko 2023-06-09T10:57:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-09T10:57:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 182017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-09T10:57:06.800 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-09T10:57:06.800 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-zero.ko 2023-06-09T10:57:06.800 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-09T10:57:06.800 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-09T10:57:06.800 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-09T10:57:06.801 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/ 2023-06-09T10:57:06.801 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 192737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-09T10:57:06.801 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-09T10:57:06.801 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 111361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-09T10:57:06.801 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 157873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-09T10:57:06.801 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 392777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-09T10:57:06.802 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/ 2023-06-09T10:57:06.802 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/ 2023-06-09T10:57:06.802 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 174329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-09T10:57:06.802 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-09T10:57:06.802 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-09T10:57:06.803 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-09T10:57:06.803 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 123185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-09T10:57:06.803 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 76009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-09T10:57:06.803 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-09T10:57:06.804 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ 2023-06-09T10:57:06.804 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm800.ko 2023-06-09T10:57:06.804 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm805.ko 2023-06-09T10:57:06.805 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm80x.ko 2023-06-09T10:57:06.805 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona-i2c.ko 2023-06-09T10:57:06.805 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 121721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona.ko 2023-06-09T10:57:06.806 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/bcm590xx.ko 2023-06-09T10:57:06.806 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/cros_ec_dev.ko 2023-06-09T10:57:06.806 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/dln2.ko 2023-06-09T10:57:06.806 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/janz-cmodio.ko 2023-06-09T10:57:06.806 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/kempld-core.ko 2023-06-09T10:57:06.806 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-core.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lp3943.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/max8907.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-core.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-06-09T10:57:06.807 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/menf21bmc.ko 2023-06-09T10:57:06.808 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-adc.ko 2023-06-09T10:57:06.808 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-gpio.ko 2023-06-09T10:57:06.808 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633.ko 2023-06-09T10:57:06.808 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-06-09T10:57:06.808 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/retu-mfd.ko 2023-06-09T10:57:06.808 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 76433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/si476x-core.ko 2023-06-09T10:57:06.808 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps65010.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps6507x.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wm8994.ko 2023-06-09T10:57:06.809 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot.ko 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/ 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-09T10:57:06.810 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/ 2023-06-09T10:57:06.811 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-06-09T10:57:06.811 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/core.ko 2023-06-09T10:57:06.811 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/ 2023-06-09T10:57:06.811 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-09T10:57:06.811 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ds1682.ko 2023-06-09T10:57:06.811 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/dummy-irq.ko 2023-06-09T10:57:06.811 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/ 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/echo.ko 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/ 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-09T10:57:06.812 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/ 2023-06-09T10:57:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 151953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-06-09T10:57:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hmc6352.ko 2023-06-09T10:57:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-09T10:57:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ 2023-06-09T10:57:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-06-09T10:57:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ics932s401.ko 2023-06-09T10:57:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/ 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/ 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 124401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-09T10:57:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 304353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/phantom.ko 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/ 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/st_drv.ko 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-09T10:57:06.815 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/ 2023-06-09T10:57:06.816 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 180697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-09T10:57:06.816 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ 2023-06-09T10:57:06.816 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/ 2023-06-09T10:57:06.816 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 487817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-09T10:57:06.816 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/ 2023-06-09T10:57:06.816 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/ 2023-06-09T10:57:06.816 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/ 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 447113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ 2023-06-09T10:57:06.817 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/ 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 130385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-09T10:57:06.818 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 98945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/ 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/ 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/ 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-09T10:57:06.819 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/ 2023-06-09T10:57:06.820 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-09T10:57:06.820 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/ 2023-06-09T10:57:06.820 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-09T10:57:06.820 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-09T10:57:06.820 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-09T10:57:06.820 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/ 2023-06-09T10:57:06.820 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/ 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 104473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 90073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/ 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-09T10:57:06.821 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-09T10:57:06.822 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/ 2023-06-09T10:57:06.822 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-09T10:57:06.822 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 176705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-09T10:57:06.822 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-06-09T10:57:06.822 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1422001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-09T10:57:06.822 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 127881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-09T10:57:06.822 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/ 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 130785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 311913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/ 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/ 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 323489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/ 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-06-09T10:57:06.823 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 193321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 345761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1038865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-06-09T10:57:06.824 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-09T10:57:06.825 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/ 2023-06-09T10:57:06.825 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/ 2023-06-09T10:57:06.825 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 203425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-09T10:57:06.825 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/ 2023-06-09T10:57:06.825 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/ 2023-06-09T10:57:06.825 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-09T10:57:06.825 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 141049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/ 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-09T10:57:06.826 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ec_bhf.ko 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/ 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/ 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 280865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/ 2023-06-09T10:57:06.827 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-06-09T10:57:06.828 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ 2023-06-09T10:57:06.828 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 90297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-09T10:57:06.828 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/ 2023-06-09T10:57:06.828 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 295609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-09T10:57:06.828 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/ 2023-06-09T10:57:06.828 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 583881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-09T10:57:06.828 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/ 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 246201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/ 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 922281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/ 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 301665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/ 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 514281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-09T10:57:06.829 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/ 2023-06-09T10:57:06.830 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 93481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-09T10:57:06.830 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-06-09T10:57:06.830 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 733977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-09T10:57:06.830 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-06-09T10:57:06.830 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 151753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-09T10:57:06.830 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 86737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-09T10:57:06.830 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/ 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 102273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/ 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 710297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 280409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-09T10:57:06.831 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1050633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 95497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-09T10:57:06.832 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/ 2023-06-09T10:57:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-06-09T10:57:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-09T10:57:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ 2023-06-09T10:57:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-09T10:57:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-09T10:57:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/ 2023-06-09T10:57:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 150737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/ 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 136609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/ 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/ 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-06-09T10:57:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 226993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 86913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 671281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/ 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/ 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-09T10:57:06.835 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-09T10:57:06.836 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-09T10:57:06.836 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 189649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-09T10:57:06.836 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/ 2023-06-09T10:57:06.836 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-06-09T10:57:06.836 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 104065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-06-09T10:57:06.836 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/ 2023-06-09T10:57:06.836 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 893521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/ 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/ 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/ 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-09T10:57:06.837 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/ 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-06-09T10:57:06.838 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 480697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-09T10:57:06.839 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/ 2023-06-09T10:57:06.839 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 103273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-09T10:57:06.839 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-09T10:57:06.839 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-09T10:57:06.839 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-09T10:57:06.839 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/ 2023-06-09T10:57:06.839 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/ 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 86353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/ 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/ 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-09T10:57:06.840 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/ 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/ 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/defxx.ko 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/ 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 216801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/skfp.ko 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 76993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-09T10:57:06.841 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/ 2023-06-09T10:57:06.842 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 234441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-09T10:57:06.842 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/ 2023-06-09T10:57:06.842 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-09T10:57:06.842 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-09T10:57:06.842 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ 2023-06-09T10:57:06.842 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 82865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-09T10:57:06.842 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/ 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-gpio.ko 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-09T10:57:06.843 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/ 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-09T10:57:06.844 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-09T10:57:06.845 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-09T10:57:06.845 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-09T10:57:06.845 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-09T10:57:06.845 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-09T10:57:06.845 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-09T10:57:06.845 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-09T10:57:06.845 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 92049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-09T10:57:06.846 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/ 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/plip.ko 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-09T10:57:06.847 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-09T10:57:06.848 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-09T10:57:06.848 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-09T10:57:06.848 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-09T10:57:06.848 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-09T10:57:06.848 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sb1000.ko 2023-06-09T10:57:06.848 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/ 2023-06-09T10:57:06.848 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/ 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 104617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-09T10:57:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/ 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 120377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/ 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 290049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/ 2023-06-09T10:57:06.850 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 143697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/ 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/ 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 255881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/ 2023-06-09T10:57:06.851 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 129017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-09T10:57:06.852 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-09T10:57:06.852 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-09T10:57:06.852 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-09T10:57:06.852 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/ 2023-06-09T10:57:06.852 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/ 2023-06-09T10:57:06.852 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-09T10:57:06.852 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pci-stub.ko 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/ 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 143593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia.ko 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_core.ko 2023-06-09T10:57:06.853 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-06-09T10:57:06.854 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-09T10:57:06.854 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 112801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-09T10:57:06.854 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/ 2023-06-09T10:57:06.854 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/ 2023-06-09T10:57:06.854 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-06-09T10:57:06.854 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/ 2023-06-09T10:57:06.854 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/ 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/ 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/ 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/ 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec.ko 2023-06-09T10:57:06.855 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-06-09T10:57:06.856 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-06-09T10:57:06.856 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-06-09T10:57:06.856 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-06-09T10:57:06.856 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-06-09T10:57:06.856 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ 2023-06-09T10:57:06.856 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-09T10:57:06.856 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-09T10:57:06.857 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-09T10:57:06.857 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-09T10:57:06.857 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-09T10:57:06.857 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-09T10:57:06.857 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ibm_rtl.ko 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/ 2023-06-09T10:57:06.858 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-09T10:57:06.859 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-06-09T10:57:06.859 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-09T10:57:06.859 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-09T10:57:06.859 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-09T10:57:06.859 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-09T10:57:06.859 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-09T10:57:06.859 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/ 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ 2023-06-09T10:57:06.860 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_battery.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_charger.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq2415x_charger.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24190_charger.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24735-charger.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9030_battery.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9052-battery.ko 2023-06-09T10:57:06.861 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2760_battery.ko 2023-06-09T10:57:06.862 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2780_battery.ko 2023-06-09T10:57:06.862 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2781_battery.ko 2023-06-09T10:57:06.862 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2782_battery.ko 2023-06-09T10:57:06.862 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/gpio-charger.ko 2023-06-09T10:57:06.862 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/isp1704_charger.ko 2023-06-09T10:57:06.862 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/lp8727_charger.ko 2023-06-09T10:57:06.862 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max14577_charger.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17040_battery.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17042_battery.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8903_charger.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8925_power.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/pcf50633-charger.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/sbs-battery.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/test_power.ko 2023-06-09T10:57:06.863 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/tps65090-charger.ko 2023-06-09T10:57:06.864 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_backup.ko 2023-06-09T10:57:06.864 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_power.ko 2023-06-09T10:57:06.864 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm8350_power.ko 2023-06-09T10:57:06.864 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/ 2023-06-09T10:57:06.864 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-09T10:57:06.864 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-09T10:57:06.864 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/ 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/ 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 64505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-09T10:57:06.865 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/ 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm80x.ko 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm860x.ko 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9052.ko 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9055.ko 2023-06-09T10:57:06.866 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9063.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-09T10:57:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-09T10:57:06.868 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-09T10:57:06.868 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-09T10:57:06.868 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-09T10:57:06.868 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-09T10:57:06.868 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-09T10:57:06.868 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-lp8788.ko 2023-06-09T10:57:06.868 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t86.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8907.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8925.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8997.ko 2023-06-09T10:57:06.869 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8998.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-palmas.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf50633.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-09T10:57:06.870 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-09T10:57:06.871 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-09T10:57:06.871 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rc5t583.ko 2023-06-09T10:57:06.871 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-09T10:57:06.871 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-09T10:57:06.871 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-09T10:57:06.871 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-09T10:57:06.871 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-s35390a.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps6586x.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps65910.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm831x.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm8350.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-09T10:57:06.872 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ 2023-06-09T10:57:06.873 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-09T10:57:06.873 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-09T10:57:06.873 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-09T10:57:06.873 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 134993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-09T10:57:06.873 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-09T10:57:06.873 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/ 2023-06-09T10:57:06.873 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 271033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/ 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 356081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 295697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/ 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 189145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-09T10:57:06.874 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/ 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/ 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 246785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/ 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1172073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/ 2023-06-09T10:57:06.875 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 237057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-09T10:57:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/ 2023-06-09T10:57:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 115289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-09T10:57:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-09T10:57:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/ 2023-06-09T10:57:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 308721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-09T10:57:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/ 2023-06-09T10:57:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 76017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 141697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/ 2023-06-09T10:57:06.877 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 212297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/ 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 154921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fdomain.ko 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/ 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 261961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-09T10:57:06.878 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 201689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/imm.ko 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 266409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/ 2023-06-09T10:57:06.879 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 317137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-09T10:57:06.880 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-09T10:57:06.880 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-09T10:57:06.880 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/ 2023-06-09T10:57:06.880 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 308257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-09T10:57:06.880 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 140057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-09T10:57:06.880 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-09T10:57:06.880 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/ 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 212865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/ 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2193673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/ 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 310561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-09T10:57:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 84585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-09T10:57:06.882 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/ 2023-06-09T10:57:06.882 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 659401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-09T10:57:06.882 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/ 2023-06-09T10:57:06.882 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 119745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-09T10:57:06.882 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-09T10:57:06.882 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/ 2023-06-09T10:57:06.882 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/ 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 361249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 123377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ppa.ko 2023-06-09T10:57:06.883 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/ 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1850585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 85145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/ 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 558681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qlogicfas408.ko 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-09T10:57:06.884 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 238633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 171753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 269985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 94177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 115665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-09T10:57:06.885 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-09T10:57:06.886 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/ 2023-06-09T10:57:06.886 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 161953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-09T10:57:06.886 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-09T10:57:06.886 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-09T10:57:06.886 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-09T10:57:06.886 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/xen-scsifront.ko 2023-06-09T10:57:06.886 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 126913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/ 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/ 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 731481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/ 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-09T10:57:06.887 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 920681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/ 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/ 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/ 2023-06-09T10:57:06.888 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/ 2023-06-09T10:57:06.889 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-09T10:57:06.889 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-09T10:57:06.889 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-09T10:57:06.889 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-09T10:57:06.889 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-09T10:57:06.889 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-09T10:57:06.889 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-09T10:57:06.890 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/moxa.ko 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/mxser.ko 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 107377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-09T10:57:06.891 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-09T10:57:06.892 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-09T10:57:06.892 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/ 2023-06-09T10:57:06.892 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/ 2023-06-09T10:57:06.892 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-06-09T10:57:06.892 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-09T10:57:06.892 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-06-09T10:57:06.892 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_uart.ko 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/ 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 102841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/rp2.ko 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/sc16is7xx.ko 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-09T10:57:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/ 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 519233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/ 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-09T10:57:06.894 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_dmem_genirq.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_mf624.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_netx.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-09T10:57:06.895 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/ 2023-06-09T10:57:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/ 2023-06-09T10:57:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/c67x00.ko 2023-06-09T10:57:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ 2023-06-09T10:57:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 142417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-06-09T10:57:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-06-09T10:57:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-06-09T10:57:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/ 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 85345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ulpi.ko 2023-06-09T10:57:06.897 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/ 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/ 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 438457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3.ko 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/ 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/ 2023-06-09T10:57:06.898 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_ether.ko 2023-06-09T10:57:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_serial.ko 2023-06-09T10:57:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-06-09T10:57:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-06-09T10:57:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-06-09T10:57:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-06-09T10:57:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 91705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-06-09T10:57:06.899 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 117913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 84017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-06-09T10:57:06.900 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/ 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-06-09T10:57:06.901 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-06-09T10:57:06.902 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-06-09T10:57:06.903 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 156905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/libcomposite.ko 2023-06-09T10:57:06.903 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/ 2023-06-09T10:57:06.903 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-06-09T10:57:06.903 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/ 2023-06-09T10:57:06.903 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 157545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-06-09T10:57:06.903 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-06-09T10:57:06.903 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2272.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2280.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 65681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 65969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-06-09T10:57:06.904 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 145081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/bcma-hcd.ko 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 79913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/isp116x-hcd.ko 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-09T10:57:06.905 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811_cs.ko 2023-06-09T10:57:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ssb-hcd.ko 2023-06-09T10:57:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-06-09T10:57:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/ 2023-06-09T10:57:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-09T10:57:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-09T10:57:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ 2023-06-09T10:57:06.906 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cytherm.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ehset.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-09T10:57:06.907 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/lvstest.ko 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/ 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 64665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-09T10:57:06.908 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-09T10:57:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-09T10:57:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-09T10:57:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-09T10:57:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbtest.ko 2023-06-09T10:57:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-09T10:57:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-09T10:57:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/ 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/usbmon.ko 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/ 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 294937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/musb_hdrc.ko 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/ 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-isp1301.ko 2023-06-09T10:57:06.910 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-tahvo.ko 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-09T10:57:06.911 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-09T10:57:06.912 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-09T10:57:06.912 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-09T10:57:06.912 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/f81232.ko 2023-06-09T10:57:06.912 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 174729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-09T10:57:06.912 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-09T10:57:06.912 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 136761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-09T10:57:06.912 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 124345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 107305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-09T10:57:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/metro-usb.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mxuport.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-09T10:57:06.914 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-09T10:57:06.915 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 187713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-09T10:57:06.915 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-09T10:57:06.915 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-09T10:57:06.915 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-09T10:57:06.915 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-09T10:57:06.915 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-09T10:57:06.915 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-09T10:57:06.916 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-09T10:57:06.917 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usbserial.ko 2023-06-09T10:57:06.917 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-09T10:57:06.917 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-09T10:57:06.917 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/wishbone-serial.ko 2023-06-09T10:57:06.917 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-09T10:57:06.917 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ 2023-06-09T10:57:06.917 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-09T10:57:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 176713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/ 2023-06-09T10:57:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 65585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 105225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/ 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/ 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 145697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-09T10:57:06.920 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/ 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 96865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 85697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/ 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/ 2023-06-09T10:57:06.921 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-06-09T10:57:06.922 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/aat2870_bl.ko 2023-06-09T10:57:06.922 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp5520_bl.ko 2023-06-09T10:57:06.922 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8860_bl.ko 2023-06-09T10:57:06.922 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8870_bl.ko 2023-06-09T10:57:06.922 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-09T10:57:06.922 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/as3711_bl.ko 2023-06-09T10:57:06.922 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/bd6107.ko 2023-06-09T10:57:06.923 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da903x_bl.ko 2023-06-09T10:57:06.923 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da9052_bl.ko 2023-06-09T10:57:06.923 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/gpio_backlight.ko 2023-06-09T10:57:06.923 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/kb3886_bl.ko 2023-06-09T10:57:06.923 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-09T10:57:06.923 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3533_bl.ko 2023-06-09T10:57:06.924 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3639_bl.ko 2023-06-09T10:57:06.924 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lv5207lp.ko 2023-06-09T10:57:06.924 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/max8925_bl.ko 2023-06-09T10:57:06.924 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pandora_bl.ko 2023-06-09T10:57:06.924 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-06-09T10:57:06.924 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-09T10:57:06.924 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/wm831x_bl.ko 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/ 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/matrox_w1.ko 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/w1-gpio.ko 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/ 2023-06-09T10:57:06.925 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-09T10:57:06.926 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/acquirewdt.ko 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/advantechwdt.ko 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-09T10:57:06.927 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-09T10:57:06.928 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/cpu5wdt.ko 2023-06-09T10:57:06.928 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9052_wdt.ko 2023-06-09T10:57:06.928 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9055_wdt.ko 2023-06-09T10:57:06.928 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9063_wdt.ko 2023-06-09T10:57:06.928 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/dw_wdt.ko 2023-06-09T10:57:06.928 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/eurotechwdt.ko 2023-06-09T10:57:06.928 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-09T10:57:06.929 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-09T10:57:06.930 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-09T10:57:06.930 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/kempld_wdt.ko 2023-06-09T10:57:06.930 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-09T10:57:06.930 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/mena21_wdt.ko 2023-06-09T10:57:06.930 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-06-09T10:57:06.930 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-09T10:57:06.930 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pc87413_wdt.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/retu_wdt.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-09T10:57:06.931 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sc1200wdt.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/twl4030_wdt.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-09T10:57:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-09T10:57:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-09T10:57:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wafer5823wdt.ko 2023-06-09T10:57:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-09T10:57:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm831x_wdt.ko 2023-06-09T10:57:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm8350_wdt.ko 2023-06-09T10:57:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-09T10:57:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/ 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/ 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 176241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-scsiback.ko 2023-06-09T10:57:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/ 2023-06-09T10:57:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-09T10:57:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ 2023-06-09T10:57:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/ 2023-06-09T10:57:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 165401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-09T10:57:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/ 2023-06-09T10:57:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/adfs.ko 2023-06-09T10:57:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/ 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 162449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/ 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 924617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/kafs.ko 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/ 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/autofs4.ko 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/ 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 64297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-09T10:57:06.936 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/ 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/bfs.ko 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/ 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 3445465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/ 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 299849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ 2023-06-09T10:57:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1230257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/ 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2619753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/ 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 99217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/ 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 105857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/configfs.ko 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/ 2023-06-09T10:57:06.938 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-09T10:57:06.939 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/ 2023-06-09T10:57:06.939 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 631321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-09T10:57:06.939 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/ 2023-06-09T10:57:06.939 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/efs.ko 2023-06-09T10:57:06.939 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/ 2023-06-09T10:57:06.939 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1472873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-09T10:57:06.939 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/ 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/ 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/freevxfs.ko 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/ 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 218609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/ 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-09T10:57:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/ 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1221153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/ 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 141129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/ 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 221441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/ 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 193465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/hpfs.ko 2023-06-09T10:57:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/ 2023-06-09T10:57:06.942 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-09T10:57:06.942 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/ 2023-06-09T10:57:06.942 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 420305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-09T10:57:06.942 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/ 2023-06-09T10:57:06.942 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 276841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-09T10:57:06.942 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/ 2023-06-09T10:57:06.942 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/ 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 128553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/ 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/ 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/ 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-09T10:57:06.943 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/ 2023-06-09T10:57:06.944 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 117529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-09T10:57:06.944 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1002305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-09T10:57:06.944 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 65985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv2.ko 2023-06-09T10:57:06.944 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 119177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-09T10:57:06.944 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2003321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-09T10:57:06.944 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/ 2023-06-09T10:57:06.944 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/ 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1407361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/ 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 587585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/ 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-09T10:57:06.945 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-09T10:57:06.946 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_ascii.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-09T10:57:06.947 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-09T10:57:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-09T10:57:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-09T10:57:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-09T10:57:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-09T10:57:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-09T10:57:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-09T10:57:06.948 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 93969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 142505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-09T10:57:06.949 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 165641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 117945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-09T10:57:06.950 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-09T10:57:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-09T10:57:06.952 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-09T10:57:06.952 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ 2023-06-09T10:57:06.952 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 218905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ntfs.ko 2023-06-09T10:57:06.952 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ 2023-06-09T10:57:06.952 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ 2023-06-09T10:57:06.952 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 241057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-09T10:57:06.952 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 439521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2511193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-09T10:57:06.953 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/ 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/omfs.ko 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/ 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 320569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/ 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/qnx4.ko 2023-06-09T10:57:06.954 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/ 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/qnx6.ko 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/ 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_tree.ko 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v1.ko 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v2.ko 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/ 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 530593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-09T10:57:06.955 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/ 2023-06-09T10:57:06.956 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-09T10:57:06.956 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/ 2023-06-09T10:57:06.956 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-09T10:57:06.956 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-09T10:57:06.956 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/ 2023-06-09T10:57:06.956 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 131513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-09T10:57:06.956 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/ 2023-06-09T10:57:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-09T10:57:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/ 2023-06-09T10:57:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 248145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-09T10:57:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ 2023-06-09T10:57:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 160753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-09T10:57:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/ 2023-06-09T10:57:06.957 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 3854681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-09T10:57:06.979 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/ 2023-06-09T10:57:06.979 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/ 2023-06-09T10:57:06.979 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/locktorture.ko 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/ 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/test_udelay.ko 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc7.ko 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-09T10:57:06.980 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/ 2023-06-09T10:57:06.981 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-09T10:57:06.981 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-09T10:57:06.981 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/interval_tree_test.ko 2023-06-09T10:57:06.981 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-09T10:57:06.981 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-09T10:57:06.981 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/ 2023-06-09T10:57:06.981 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/ 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/memory-notifier-error-inject.ko 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/notifier-error-inject.ko 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/percpu_test.ko 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/pm-notifier-error-inject.ko 2023-06-09T10:57:06.982 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/ 2023-06-09T10:57:06.983 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 142193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-09T10:57:06.983 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/rbtree_test.ko 2023-06-09T10:57:06.983 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/ 2023-06-09T10:57:06.983 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-09T10:57:06.983 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-kstrtox.ko 2023-06-09T10:57:06.983 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-string_helpers.ko 2023-06-09T10:57:06.983 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 4760649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_bpf.ko 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_firmware.ko 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_module.ko 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_user_copy.ko 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/ 2023-06-09T10:57:06.984 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/xz_dec_test.ko 2023-06-09T10:57:06.985 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/ 2023-06-09T10:57:06.985 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-09T10:57:06.985 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ 2023-06-09T10:57:06.985 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/ 2023-06-09T10:57:06.985 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-09T10:57:06.985 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-09T10:57:06.985 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/ 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-09T10:57:06.986 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/ 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/ 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 191689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-09T10:57:06.987 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-09T10:57:06.988 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-09T10:57:06.988 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-09T10:57:06.988 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/ 2023-06-09T10:57:06.988 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 652649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-09T10:57:06.988 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/ 2023-06-09T10:57:06.988 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-09T10:57:06.988 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 769721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-09T10:57:06.989 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-09T10:57:06.990 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-09T10:57:06.990 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-09T10:57:06.990 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-09T10:57:06.990 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-09T10:57:06.990 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-09T10:57:06.990 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-09T10:57:06.990 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-09T10:57:06.991 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-09T10:57:06.992 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-09T10:57:06.992 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/ 2023-06-09T10:57:06.992 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1030089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-09T10:57:06.992 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/ 2023-06-09T10:57:06.992 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 124617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-09T10:57:06.992 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/ 2023-06-09T10:57:06.992 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 189137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/ 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 380185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-09T10:57:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/ 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 99713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/hsr.ko 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 245745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-09T10:57:06.994 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-09T10:57:06.995 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ 2023-06-09T10:57:06.995 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-09T10:57:06.995 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-09T10:57:06.995 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-09T10:57:06.995 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-09T10:57:06.995 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-09T10:57:06.995 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-09T10:57:06.996 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ip_tables.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-06-09T10:57:06.997 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-09T10:57:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-09T10:57:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-09T10:57:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-09T10:57:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-09T10:57:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-09T10:57:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-09T10:57:06.998 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-09T10:57:06.999 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-09T10:57:07.000 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-09T10:57:07.000 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-09T10:57:07.000 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-09T10:57:07.000 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-09T10:57:07.000 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-09T10:57:07.000 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-09T10:57:07.000 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-09T10:57:07.001 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_gre.ko 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 91377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-09T10:57:07.002 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-09T10:57:07.003 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-09T10:57:07.003 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-09T10:57:07.003 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/mip6.ko 2023-06-09T10:57:07.003 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ 2023-06-09T10:57:07.003 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-09T10:57:07.003 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-06-09T10:57:07.003 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-09T10:57:07.004 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-09T10:57:07.005 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-09T10:57:07.005 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-09T10:57:07.005 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-09T10:57:07.005 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-09T10:57:07.005 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-09T10:57:07.005 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-09T10:57:07.005 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-09T10:57:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-09T10:57:07.007 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-09T10:57:07.007 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-09T10:57:07.007 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/ 2023-06-09T10:57:07.007 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 82825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-09T10:57:07.007 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/ 2023-06-09T10:57:07.007 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 120649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-09T10:57:07.007 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/ 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/lapb.ko 2023-06-09T10:57:07.008 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/ 2023-06-09T10:57:07.009 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-09T10:57:07.009 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 267033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc2.ko 2023-06-09T10:57:07.009 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/ 2023-06-09T10:57:07.009 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 280225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-09T10:57:07.009 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/ 2023-06-09T10:57:07.009 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-09T10:57:07.009 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 116897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 103001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-09T10:57:07.010 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 104417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 105017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 114273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 111041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 114561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 114209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 113033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-09T10:57:07.011 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 116097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-09T10:57:07.012 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-09T10:57:07.012 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ 2023-06-09T10:57:07.012 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 410481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-09T10:57:07.012 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-09T10:57:07.012 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-09T10:57:07.012 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-09T10:57:07.012 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-09T10:57:07.013 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 397561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 117633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-09T10:57:07.014 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-09T10:57:07.015 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-09T10:57:07.015 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-09T10:57:07.015 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-09T10:57:07.015 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-09T10:57:07.015 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 65625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-09T10:57:07.015 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-09T10:57:07.015 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 86713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 91657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-09T10:57:07.016 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 579473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-06-09T10:57:07.017 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-09T10:57:07.018 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-09T10:57:07.018 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-09T10:57:07.018 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-09T10:57:07.018 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-09T10:57:07.018 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-09T10:57:07.018 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-09T10:57:07.018 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-09T10:57:07.019 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_osf.ko 2023-06-09T10:57:07.020 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-09T10:57:07.020 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-09T10:57:07.020 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-09T10:57:07.020 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-09T10:57:07.020 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-09T10:57:07.020 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_synproxy.ko 2023-06-09T10:57:07.020 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tproxy.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 84993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/x_tables.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-09T10:57:07.021 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-09T10:57:07.022 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-09T10:57:07.023 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-09T10:57:07.024 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-09T10:57:07.024 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-09T10:57:07.024 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-09T10:57:07.024 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-09T10:57:07.024 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-09T10:57:07.024 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-09T10:57:07.024 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-09T10:57:07.025 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-09T10:57:07.025 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-09T10:57:07.025 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-09T10:57:07.025 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-09T10:57:07.025 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-09T10:57:07.025 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-09T10:57:07.025 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-09T10:57:07.026 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-09T10:57:07.027 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-09T10:57:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-09T10:57:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-09T10:57:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-09T10:57:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-09T10:57:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-09T10:57:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-09T10:57:07.028 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-09T10:57:07.029 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpudp.ko 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/ 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/ 2023-06-09T10:57:07.030 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-09T10:57:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/ 2023-06-09T10:57:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 377897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-09T10:57:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-09T10:57:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-09T10:57:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-09T10:57:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/ 2023-06-09T10:57:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/ 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 109953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/phonet.ko 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/pn_pep.ko 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/ 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 248865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 164961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-09T10:57:07.032 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/ 2023-06-09T10:57:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 806905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/rxrpc.ko 2023-06-09T10:57:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/ 2023-06-09T10:57:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-09T10:57:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-09T10:57:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-09T10:57:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-09T10:57:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-09T10:57:07.034 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_cgroup.ko 2023-06-09T10:57:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-09T10:57:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-09T10:57:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-09T10:57:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-09T10:57:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-09T10:57:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-09T10:57:07.035 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-09T10:57:07.036 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq_codel.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-09T10:57:07.037 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-09T10:57:07.038 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-09T10:57:07.038 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-09T10:57:07.038 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-09T10:57:07.038 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-09T10:57:07.038 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-09T10:57:07.038 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-09T10:57:07.038 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/ 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 929065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/ 2023-06-09T10:57:07.039 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/ 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 327953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1427857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/ 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 681617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/ 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-09T10:57:07.040 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 853649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-09T10:57:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/ 2023-06-09T10:57:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-09T10:57:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/ 2023-06-09T10:57:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-09T10:57:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-09T10:57:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 92577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-09T10:57:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/ 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/x25.ko 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/ 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_algo.ko 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_user.ko 2023-06-09T10:57:07.042 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/ 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/ 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 636518 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 622189 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7605 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.alias.bin 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9788 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-09T10:57:07.043 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68530 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-09T10:57:07.044 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 146382 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-09T10:57:07.044 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 232620 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-09T10:57:07.044 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 210 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-09T10:57:07.044 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72719 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-09T10:57:07.044 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 879 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-09T10:57:07.044 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 251838 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-09T10:57:07.044 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 306636 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-09T10:57:07.045 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/ 2023-06-09T10:57:07.045 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/ 2023-06-09T10:57:07.045 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/ 2023-06-09T10:57:07.045 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T10:57:07.045 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 173 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/changelog.Debian.gz 2023-06-09T10:57:07.045 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 691 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/copyright 2023-06-09T10:57:07.046 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:07.046 INFO:teuthology.task.kernel:searching for kernel 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:07.047 DEBUG:teuthology.orchestra.run.smithi187:> egrep '(submenu|menuentry.*6.4.0-rc2-g10b2f20a4f46).*{' /boot/grub/grub.cfg 2023-06-09T10:57:07.055 INFO:teuthology.orchestra.run.smithi187.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T10:57:07.055 INFO:teuthology.orchestra.run.smithi187.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T10:57:07.056 INFO:teuthology.orchestra.run.smithi187.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T10:57:07.056 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-06-09T10:57:07.056 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:07.057 DEBUG:teuthology.orchestra.run.smithi187:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-06-09T10:57:07.098 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi187.front.sepia.ceph.com to complete... 2023-06-09T10:57:07.832 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2023-06-09T10:57:07.837 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T10:57:07.856 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-06-09T10:57:08.157 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:08.169 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:57:08.597 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T10:57:08.608 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T10:57:10.082 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-06-09T10:57:25.011 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-09T10:57:25.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-09T10:57:25.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:57:41.220 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-09T10:57:41.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-06-09T10:57:41.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:57:43.540 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-09T10:57:59.668 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-09T10:58:13.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-09T10:58:13.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:58:29.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-06-09T10:58:29.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:58:31.920 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-09T10:58:47.025 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-09T10:59:01.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-09T10:59:01.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:59:02.193 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-06-09T10:59:02.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-09T10:59:02.859 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-09T10:59:02.859 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-06-09T10:59:02.923 INFO:teuthology.orchestra.run.smithi078.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:59:02.923 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:59:02.924 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T10:59:02.924 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T10:59:03.925 DEBUG:teuthology.parallel:result is None 2023-06-09T10:59:17.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-06-09T10:59:17.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T10:59:17.266 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-06-09T10:59:18.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-06-09T10:59:18.029 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-09T10:59:18.030 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-06-09T10:59:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:59:18.089 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-09T10:59:18.090 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T10:59:18.090 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T10:59:19.091 DEBUG:teuthology.parallel:result is None 2023-06-09T10:59:19.092 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-09T10:59:19.099 INFO:teuthology.task.internal:Creating test directory... 2023-06-09T10:59:19.100 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T10:59:19.107 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T10:59:19.125 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-09T10:59:19.203 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-09T10:59:19.212 INFO:teuthology.task.internal:Creating archive directory... 2023-06-09T10:59:19.213 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T10:59:19.220 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T10:59:19.332 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-09T10:59:19.339 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-09T10:59:19.340 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T10:59:19.347 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T10:59:19.450 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T10:59:19.454 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T10:59:19.473 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T10:59:19.479 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T10:59:19.482 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-09T10:59:19.491 INFO:teuthology.task.internal:Configuring sudo... 2023-06-09T10:59:19.491 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T10:59:19.498 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T10:59:19.534 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-09T10:59:19.544 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-09T10:59:19.545 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T10:59:19.580 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T10:59:19.600 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T10:59:19.656 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T10:59:19.716 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T10:59:19.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T10:59:19.800 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T10:59:19.821 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T10:59:19.882 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T10:59:19.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T10:59:19.966 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-06-09T10:59:19.974 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-06-09T10:59:20.117 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-09T10:59:20.125 INFO:teuthology.task.internal:Starting timer... 2023-06-09T10:59:20.126 INFO:teuthology.run_tasks:Running task pcp... 2023-06-09T10:59:20.165 INFO:teuthology.run_tasks:Running task selinux... 2023-06-09T10:59:20.173 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2023-06-09T10:59:20.174 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux 2023-06-09T10:59:20.174 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-09T10:59:20.175 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-09T10:59:20.175 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-09T10:59:20.175 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-09T10:59:20.186 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-09T10:59:20.192 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-09T10:59:20.351 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-09T10:59:20.374 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-09T10:59:20.376 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-09T11:07:03.945 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2023-06-09T11:07:03.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-09T11:07:03.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T11:07:04.052 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-06-09T11:07:04.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-06-09T11:07:04.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T11:07:04.386 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-06-09T11:07:04.608 INFO:teuthology.run_tasks:Running task clock... 2023-06-09T11:07:04.634 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-09T11:07:04.635 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T11:07:04.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T11:07:04.643 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T11:07:04.643 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T11:07:04.710 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-09T11:07:04.710 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Command line: ntpd -gq 2023-06-09T11:07:04.711 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: proto: precision = 0.054 usec (-24) 2023-06-09T11:07:04.711 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T11:07:04.712 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T11:07:04.712 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T11:07:04.713 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T11:07:04.713 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T11:07:04.713 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T11:07:04.713 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T11:07:04.713 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2023-06-09T11:07:04.714 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Listen normally on 4 lo [::1]:123 2023-06-09T11:07:04.714 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2023-06-09T11:07:04.714 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:04 ntpd[22075]: Listening on routing socket on fd #22 for interface updates 2023-06-09T11:07:04.728 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-09T11:07:04.728 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Command line: ntpd -gq 2023-06-09T11:07:04.730 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: proto: precision = 0.065 usec (-24) 2023-06-09T11:07:04.730 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T11:07:04.730 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T11:07:04.731 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T11:07:04.731 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T11:07:04.732 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T11:07:04.732 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T11:07:04.732 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T11:07:04.732 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Listen normally on 3 enp3s0f1 172.21.15.187:123 2023-06-09T11:07:04.732 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Listen normally on 4 lo [::1]:123 2023-06-09T11:07:04.733 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123 2023-06-09T11:07:04.733 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:04 ntpd[22055]: Listening on routing socket on fd #22 for interface updates 2023-06-09T11:07:05.710 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:05.711 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:05.711 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:05.711 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:05.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:05.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:05.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:05.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:05 ntpd[22075]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:05.729 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:05.729 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:05.729 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:05.729 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:05.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:05.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:05.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:05.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:05 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:07.710 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:07 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:07.710 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:07 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:07.711 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:07 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:07.711 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:07 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:07.711 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:07 ntpd[22075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:07.711 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:07 ntpd[22075]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:07.729 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:07.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:07.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:07.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:07.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:07 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:09.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:09.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:09.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:09.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:09.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:09.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:09 ntpd[22075]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:09.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.732 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.732 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.732 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.733 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.733 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.733 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.734 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:09.735 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:09.736 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.736 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.736 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:09.737 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:09.737 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:09.737 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:09.737 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:09.738 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:09 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:11.712 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.713 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.714 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:11.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:11.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.715 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.716 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:11.716 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:11.716 INFO:teuthology.orchestra.run.smithi078.stdout: 9 Jun 11:07:11 ntpd[22075]: ntpd: time slew +0.003159 s 2023-06-09T11:07:11.717 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew +0.003159s 2023-06-09T11:07:11.718 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T11:07:11.718 INFO:teuthology.orchestra.run.smithi078.stderr: 9 Jun 11:07:11 ntpd[22075]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T11:07:11.730 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.731 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.732 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.732 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.732 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.732 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.733 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:11.733 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:11.733 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T11:07:11.733 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T11:07:11.734 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T11:07:11.734 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T11:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout: 9 Jun 11:07:11 ntpd[22055]: ntpd: time slew +0.002696 s 2023-06-09T11:07:11.735 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew +0.002696s 2023-06-09T11:07:11.736 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T11:07:11.736 INFO:teuthology.orchestra.run.smithi187.stderr: 9 Jun 11:07:11 ntpd[22055]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T11:07:11.848 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T11:07:11.849 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-06-09T11:07:11.849 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.849 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.849 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.849 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.858 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T11:07:11.859 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2023-06-09T11:07:11.859 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.859 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.859 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.859 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T11:07:11.860 INFO:teuthology.run_tasks:Running task install... 2023-06-09T11:07:11.871 DEBUG:teuthology.task.install:project ceph 2023-06-09T11:07:11.871 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d'}} 2023-06-09T11:07:11.871 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d'} 2023-06-09T11:07:11.872 INFO:teuthology.task.install:Using flavor: default 2023-06-09T11:07:11.882 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-09T11:07:11.882 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-09T11:07:11.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2023-06-09T11:07:11.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-key list | grep Ceph 2023-06-09T11:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-09T11:07:12.107 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-09T11:07:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T11:07:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T11:07:12.245 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T11:07:12.246 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T11:07:12.246 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T11:07:12.247 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T11:07:12.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=034108821cde95ca1c56d458dfccc7ef9e0d964d 2023-06-09T11:07:12.251 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T11:07:12.251 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T11:07:12.251 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=034108821cde95ca1c56d458dfccc7ef9e0d964d 2023-06-09T11:07:12.388 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default/ 2023-06-09T11:07:12.388 INFO:teuthology.task.install.deb:Package version is 18.0.0-3924-g03410882-1focal 2023-06-09T11:07:12.498 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:07:12.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T11:07:12.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2023-06-09T11:07:12.533 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default/ 2023-06-09T11:07:12.533 INFO:teuthology.task.install.deb:Package version is 18.0.0-3924-g03410882-1focal 2023-06-09T11:07:12.639 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:07:12.640 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T11:07:12.673 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2023-06-09T11:07:12.807 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-09T11:07:12.807 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-09T11:07:12.819 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-09T11:07:12.854 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal InRelease 2023-06-09T11:07:12.875 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-09T11:07:12.899 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal Release.gpg 2023-06-09T11:07:12.920 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-06-09T11:07:12.943 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:8 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-09T11:07:12.965 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main i386 Packages [3,431 B] 2023-06-09T11:07:13.072 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-09T11:07:13.073 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-09T11:07:13.102 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal InRelease 2023-06-09T11:07:13.131 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-09T11:07:13.152 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-09T11:07:13.204 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal Release.gpg 2023-06-09T11:07:13.213 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-09T11:07:13.254 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main i386 Packages [3,431 B] 2023-06-09T11:07:13.324 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-06-09T11:07:14.267 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 28.4 kB in 1s (20.4 kB/s) 2023-06-09T11:07:14.508 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 28.4 kB in 2s (18.9 kB/s) 2023-06-09T11:07:15.449 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-09T11:07:15.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3924-g03410882-1focal cephadm=18.0.0-3924-g03410882-1focal ceph-mds=18.0.0-3924-g03410882-1focal ceph-mgr=18.0.0-3924-g03410882-1focal ceph-common=18.0.0-3924-g03410882-1focal ceph-fuse=18.0.0-3924-g03410882-1focal ceph-test=18.0.0-3924-g03410882-1focal ceph-volume=18.0.0-3924-g03410882-1focal radosgw=18.0.0-3924-g03410882-1focal python3-rados=18.0.0-3924-g03410882-1focal python3-rgw=18.0.0-3924-g03410882-1focal python3-cephfs=18.0.0-3924-g03410882-1focal python3-rbd=18.0.0-3924-g03410882-1focal libcephfs2=18.0.0-3924-g03410882-1focal libcephfs-dev=18.0.0-3924-g03410882-1focal librados2=18.0.0-3924-g03410882-1focal librbd1=18.0.0-3924-g03410882-1focal rbd-fuse=18.0.0-3924-g03410882-1focal python3-cephfs=18.0.0-3924-g03410882-1focal cephfs-shell=18.0.0-3924-g03410882-1focal cephfs-top=18.0.0-3924-g03410882-1focal cephfs-mirror=18.0.0-3924-g03410882-1focal 2023-06-09T11:07:15.611 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-09T11:07:15.685 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2023-06-09T11:07:15.722 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3924-g03410882-1focal cephadm=18.0.0-3924-g03410882-1focal ceph-mds=18.0.0-3924-g03410882-1focal ceph-mgr=18.0.0-3924-g03410882-1focal ceph-common=18.0.0-3924-g03410882-1focal ceph-fuse=18.0.0-3924-g03410882-1focal ceph-test=18.0.0-3924-g03410882-1focal ceph-volume=18.0.0-3924-g03410882-1focal radosgw=18.0.0-3924-g03410882-1focal python3-rados=18.0.0-3924-g03410882-1focal python3-rgw=18.0.0-3924-g03410882-1focal python3-cephfs=18.0.0-3924-g03410882-1focal python3-rbd=18.0.0-3924-g03410882-1focal libcephfs2=18.0.0-3924-g03410882-1focal libcephfs-dev=18.0.0-3924-g03410882-1focal librados2=18.0.0-3924-g03410882-1focal librbd1=18.0.0-3924-g03410882-1focal rbd-fuse=18.0.0-3924-g03410882-1focal python3-cephfs=18.0.0-3924-g03410882-1focal cephfs-shell=18.0.0-3924-g03410882-1focal cephfs-top=18.0.0-3924-g03410882-1focal cephfs-mirror=18.0.0-3924-g03410882-1focal 2023-06-09T11:07:15.804 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-06-09T11:07:15.805 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-06-09T11:07:15.839 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2023-06-09T11:07:15.976 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T11:07:15.977 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T11:07:15.977 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T11:07:15.977 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-06-09T11:07:15.977 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T11:07:15.978 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-09T11:07:15.978 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-09T11:07:15.978 INFO:teuthology.orchestra.run.smithi078.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-09T11:07:15.978 INFO:teuthology.orchestra.run.smithi078.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-09T11:07:15.979 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-09T11:07:15.979 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T11:07:15.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T11:07:15.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T11:07:15.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-06-09T11:07:15.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-06-09T11:07:15.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-06-09T11:07:15.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-06-09T11:07:15.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-06-09T11:07:15.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T11:07:15.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-06-09T11:07:15.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T11:07:15.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-06-09T11:07:15.981 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T11:07:15.981 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T11:07:15.981 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T11:07:15.981 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T11:07:15.981 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T11:07:15.982 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-06-09T11:07:15.982 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-09T11:07:15.982 INFO:teuthology.orchestra.run.smithi078.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-09T11:07:15.982 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-09T11:07:15.982 INFO:teuthology.orchestra.run.smithi078.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-09T11:07:15.982 INFO:teuthology.orchestra.run.smithi078.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-09T11:07:15.983 INFO:teuthology.orchestra.run.smithi078.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-09T11:07:15.983 INFO:teuthology.orchestra.run.smithi078.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-09T11:07:15.983 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-09T11:07:15.983 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-09T11:07:15.983 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2023-06-09T11:07:15.983 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2023-06-09T11:07:16.012 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2023-06-09T11:07:16.013 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2023-06-09T11:07:16.174 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T11:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T11:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T11:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2023-06-09T11:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T11:07:16.176 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-09T11:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-09T11:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-09T11:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-09T11:07:16.177 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-09T11:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T11:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T11:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T11:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-06-09T11:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-06-09T11:07:16.178 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T11:07:16.179 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T11:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T11:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T11:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T11:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2023-06-09T11:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-09T11:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-09T11:07:16.180 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2023-06-09T11:07:16.181 INFO:teuthology.orchestra.run.smithi187.stdout: btrfs-tools 2023-06-09T11:07:16.182 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-06-09T11:07:16.182 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T11:07:16.182 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T11:07:16.183 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T11:07:16.183 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-09T11:07:16.183 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-09T11:07:16.184 INFO:teuthology.orchestra.run.smithi078.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-09T11:07:16.184 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-09T11:07:16.184 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-09T11:07:16.184 INFO:teuthology.orchestra.run.smithi078.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T11:07:16.184 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T11:07:16.184 INFO:teuthology.orchestra.run.smithi078.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T11:07:16.185 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-06-09T11:07:16.185 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-09T11:07:16.185 INFO:teuthology.orchestra.run.smithi078.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-09T11:07:16.185 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-09T11:07:16.185 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-09T11:07:16.185 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-09T11:07:16.185 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T11:07:16.186 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-09T11:07:16.187 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-06-09T11:07:16.187 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 librbd1 2023-06-09T11:07:16.276 INFO:teuthology.orchestra.run.smithi078.stdout:2 upgraded, 116 newly installed, 0 to remove and 186 not upgraded. 2023-06-09T11:07:16.276 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 201 MB of archives. 2023-06-09T11:07:16.277 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 1,003 MB of additional disk space will be used. 2023-06-09T11:07:16.277 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-09T11:07:16.296 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-09T11:07:16.303 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-09T11:07:16.329 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-09T11:07:16.358 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-09T11:07:16.362 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-09T11:07:16.375 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-09T11:07:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2023-06-09T11:07:16.379 INFO:teuthology.orchestra.run.smithi187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T11:07:16.379 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T11:07:16.379 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T11:07:16.379 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-09T11:07:16.380 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-09T11:07:16.380 INFO:teuthology.orchestra.run.smithi187.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-09T11:07:16.381 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-09T11:07:16.381 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-09T11:07:16.381 INFO:teuthology.orchestra.run.smithi187.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T11:07:16.381 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T11:07:16.381 INFO:teuthology.orchestra.run.smithi187.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T11:07:16.381 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-06-09T11:07:16.382 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-09T11:07:16.382 INFO:teuthology.orchestra.run.smithi187.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-09T11:07:16.382 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-09T11:07:16.382 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-09T11:07:16.382 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-09T11:07:16.382 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-09T11:07:16.382 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-09T11:07:16.383 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-09T11:07:16.383 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T11:07:16.383 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T11:07:16.383 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T11:07:16.383 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T11:07:16.383 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T11:07:16.384 INFO:teuthology.orchestra.run.smithi187.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-09T11:07:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2023-06-09T11:07:16.385 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 librbd1 2023-06-09T11:07:16.421 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-09T11:07:16.424 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-09T11:07:16.433 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-09T11:07:16.435 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-09T11:07:16.470 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-09T11:07:16.545 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-09T11:07:16.549 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-09T11:07:16.585 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-09T11:07:16.586 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-09T11:07:16.594 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-09T11:07:16.595 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-09T11:07:16.596 INFO:teuthology.orchestra.run.smithi187.stdout:2 upgraded, 116 newly installed, 0 to remove and 186 not upgraded. 2023-06-09T11:07:16.596 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 201 MB of archives. 2023-06-09T11:07:16.596 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 1,003 MB of additional disk space will be used. 2023-06-09T11:07:16.597 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-09T11:07:16.597 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-09T11:07:16.597 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-09T11:07:16.598 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T11:07:16.599 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-09T11:07:16.634 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-09T11:07:16.680 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-09T11:07:16.690 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-3924-g03410882-1focal [3,429 kB] 2023-06-09T11:07:16.702 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-09T11:07:16.706 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-09T11:07:16.715 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-09T11:07:16.721 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-09T11:07:16.734 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-09T11:07:16.735 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-09T11:07:16.761 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-09T11:07:16.761 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-09T11:07:16.762 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-09T11:07:16.763 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-09T11:07:16.765 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-09T11:07:16.805 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-09T11:07:16.822 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-3924-g03410882-1focal [3,429 kB] 2023-06-09T11:07:16.839 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-09T11:07:16.896 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-09T11:07:16.899 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-06-09T11:07:16.908 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-09T11:07:16.917 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-09T11:07:16.919 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-09T11:07:16.920 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T11:07:16.920 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-09T11:07:16.926 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-09T11:07:16.931 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-09T11:07:16.933 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-09T11:07:16.969 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-09T11:07:16.979 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-09T11:07:16.996 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-09T11:07:17.010 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-09T11:07:17.059 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-09T11:07:17.197 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-09T11:07:17.218 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-09T11:07:17.219 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-09T11:07:17.234 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-09T11:07:17.235 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-09T11:07:17.235 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-09T11:07:17.235 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-09T11:07:17.236 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-09T11:07:17.237 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-09T11:07:17.257 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-09T11:07:17.266 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-09T11:07:17.272 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-09T11:07:17.293 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-09T11:07:17.301 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-09T11:07:17.340 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-09T11:07:17.343 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-09T11:07:17.348 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-09T11:07:17.381 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-09T11:07:17.390 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-09T11:07:17.395 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-09T11:07:17.398 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-09T11:07:17.408 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-09T11:07:17.416 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-09T11:07:17.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-09T11:07:17.466 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-09T11:07:17.480 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-09T11:07:17.560 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-3924-g03410882-1focal [3,987 kB] 2023-06-09T11:07:17.578 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-06-09T11:07:17.590 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-09T11:07:17.671 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-09T11:07:17.672 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-09T11:07:17.672 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-09T11:07:17.673 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-09T11:07:17.674 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-09T11:07:17.675 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-09T11:07:17.689 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-09T11:07:17.690 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T11:07:17.725 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-09T11:07:17.761 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-09T11:07:17.805 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-09T11:07:17.816 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-09T11:07:17.818 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-09T11:07:17.824 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-09T11:07:17.831 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-09T11:07:17.834 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-09T11:07:17.843 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-09T11:07:17.895 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-3924-g03410882-1focal [725 kB] 2023-06-09T11:07:17.997 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-3924-g03410882-1focal [377 kB] 2023-06-09T11:07:18.021 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-09T11:07:18.030 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-09T11:07:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-3924-g03410882-1focal [22.5 kB] 2023-06-09T11:07:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-3924-g03410882-1focal [191 kB] 2023-06-09T11:07:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-09T11:07:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-09T11:07:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-09T11:07:18.074 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-09T11:07:18.084 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T11:07:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-09T11:07:18.092 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-3924-g03410882-1focal [48.4 kB] 2023-06-09T11:07:18.094 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-3924-g03410882-1focal [354 kB] 2023-06-09T11:07:18.135 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-3924-g03410882-1focal [6,549 kB] 2023-06-09T11:07:18.151 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-3924-g03410882-1focal [3,987 kB] 2023-06-09T11:07:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-09T11:07:18.567 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-09T11:07:18.590 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-09T11:07:18.661 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-09T11:07:18.723 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-09T11:07:18.732 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-09T11:07:18.852 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-09T11:07:18.853 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-09T11:07:18.857 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-09T11:07:18.861 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-09T11:07:18.872 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-09T11:07:18.888 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-3924-g03410882-1focal [725 kB] 2023-06-09T11:07:19.004 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-3924-g03410882-1focal [377 kB] 2023-06-09T11:07:19.042 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-3924-g03410882-1focal [104 kB] 2023-06-09T11:07:19.044 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-3924-g03410882-1focal [467 kB] 2023-06-09T11:07:19.058 INFO:teuthology.orchestra.run.smithi187.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-09T11:07:19.062 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-3924-g03410882-1focal [22.5 kB] 2023-06-09T11:07:19.063 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-3924-g03410882-1focal [191 kB] 2023-06-09T11:07:19.081 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-3924-g03410882-1focal [48.4 kB] 2023-06-09T11:07:19.085 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-3924-g03410882-1focal [354 kB] 2023-06-09T11:07:19.130 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-3924-g03410882-1focal [6,549 kB] 2023-06-09T11:07:19.147 INFO:teuthology.orchestra.run.smithi187.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-3924-g03410882-1focal [25.0 MB] 2023-06-09T11:07:19.496 INFO:teuthology.orchestra.run.smithi187.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-09T11:07:19.508 INFO:teuthology.orchestra.run.smithi187.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-06-09T11:07:19.552 INFO:teuthology.orchestra.run.smithi187.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-09T11:07:19.596 INFO:teuthology.orchestra.run.smithi187.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-09T11:07:19.605 INFO:teuthology.orchestra.run.smithi187.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-09T11:07:19.610 INFO:teuthology.orchestra.run.smithi187.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T11:07:19.613 INFO:teuthology.orchestra.run.smithi187.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-09T11:07:19.640 INFO:teuthology.orchestra.run.smithi187.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-09T11:07:19.661 INFO:teuthology.orchestra.run.smithi187.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-09T11:07:19.672 INFO:teuthology.orchestra.run.smithi187.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-09T11:07:19.780 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-3924-g03410882-1focal [104 kB] 2023-06-09T11:07:19.783 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-3924-g03410882-1focal [467 kB] 2023-06-09T11:07:19.816 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-3924-g03410882-1focal [25.0 MB] 2023-06-09T11:07:19.837 INFO:teuthology.orchestra.run.smithi187.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-09T11:07:20.027 INFO:teuthology.orchestra.run.smithi187.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-09T11:07:20.816 INFO:teuthology.orchestra.run.smithi187.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-09T11:07:20.867 INFO:teuthology.orchestra.run.smithi187.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-09T11:07:20.869 INFO:teuthology.orchestra.run.smithi187.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-09T11:07:20.941 INFO:teuthology.orchestra.run.smithi187.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-09T11:07:20.941 INFO:teuthology.orchestra.run.smithi187.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-09T11:07:20.942 INFO:teuthology.orchestra.run.smithi187.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-09T11:07:20.943 INFO:teuthology.orchestra.run.smithi187.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-09T11:07:20.943 INFO:teuthology.orchestra.run.smithi187.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-09T11:07:20.944 INFO:teuthology.orchestra.run.smithi187.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-09T11:07:21.095 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-3924-g03410882-1focal [10.9 MB] 2023-06-09T11:07:21.109 INFO:teuthology.orchestra.run.smithi187.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-09T11:07:21.428 INFO:teuthology.orchestra.run.smithi187.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-09T11:07:21.441 INFO:teuthology.orchestra.run.smithi187.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-09T11:07:21.468 INFO:teuthology.orchestra.run.smithi187.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-09T11:07:21.591 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-3924-g03410882-1focal [223 kB] 2023-06-09T11:07:21.599 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3924-g03410882-1focal [133 kB] 2023-06-09T11:07:21.605 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-3924-g03410882-1focal [1,551 kB] 2023-06-09T11:07:21.624 INFO:teuthology.orchestra.run.smithi187.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-09T11:07:21.669 INFO:teuthology.orchestra.run.smithi187.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-09T11:07:21.676 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-3924-g03410882-1focal [9,388 kB] 2023-06-09T11:07:21.697 INFO:teuthology.orchestra.run.smithi187.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-09T11:07:21.706 INFO:teuthology.orchestra.run.smithi187.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-09T11:07:21.748 INFO:teuthology.orchestra.run.smithi187.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-09T11:07:21.779 INFO:teuthology.orchestra.run.smithi187.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-09T11:07:21.781 INFO:teuthology.orchestra.run.smithi187.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-09T11:07:22.065 INFO:teuthology.orchestra.run.smithi187.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-09T11:07:22.124 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-3924-g03410882-1focal [31.3 MB] 2023-06-09T11:07:22.535 INFO:teuthology.orchestra.run.smithi187.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-06-09T11:07:22.591 INFO:teuthology.orchestra.run.smithi187.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-09T11:07:22.940 INFO:teuthology.orchestra.run.smithi187.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-09T11:07:22.942 INFO:teuthology.orchestra.run.smithi187.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-09T11:07:22.942 INFO:teuthology.orchestra.run.smithi187.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-09T11:07:22.943 INFO:teuthology.orchestra.run.smithi187.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-09T11:07:22.944 INFO:teuthology.orchestra.run.smithi187.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-09T11:07:22.946 INFO:teuthology.orchestra.run.smithi187.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-09T11:07:22.987 INFO:teuthology.orchestra.run.smithi187.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-09T11:07:22.988 INFO:teuthology.orchestra.run.smithi187.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T11:07:23.152 INFO:teuthology.orchestra.run.smithi187.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-09T11:07:23.319 INFO:teuthology.orchestra.run.smithi187.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-09T11:07:23.532 INFO:teuthology.orchestra.run.smithi187.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-09T11:07:23.577 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-3924-g03410882-1focal [3,812 B] 2023-06-09T11:07:23.578 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-3924-g03410882-1focal [833 kB] 2023-06-09T11:07:23.579 INFO:teuthology.orchestra.run.smithi187.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-09T11:07:23.593 INFO:teuthology.orchestra.run.smithi187.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-09T11:07:23.612 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-3924-g03410882-1focal [2,292 kB] 2023-06-09T11:07:23.620 INFO:teuthology.orchestra.run.smithi187.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-3924-g03410882-1focal [10.9 MB] 2023-06-09T11:07:23.656 INFO:teuthology.orchestra.run.smithi187.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-09T11:07:23.669 INFO:teuthology.orchestra.run.smithi187.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-09T11:07:23.719 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-3924-g03410882-1focal [97.8 kB] 2023-06-09T11:07:23.726 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-3924-g03410882-1focal [122 kB] 2023-06-09T11:07:23.731 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-3924-g03410882-1focal [1,775 kB] 2023-06-09T11:07:23.816 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3924-g03410882-1focal [7,867 kB] 2023-06-09T11:07:24.173 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-3924-g03410882-1focal [3,932 B] 2023-06-09T11:07:24.173 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-3924-g03410882-1focal [43.8 MB] 2023-06-09T11:07:26.457 INFO:teuthology.orchestra.run.smithi187.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-3924-g03410882-1focal [223 kB] 2023-06-09T11:07:26.504 INFO:teuthology.orchestra.run.smithi187.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3924-g03410882-1focal [133 kB] 2023-06-09T11:07:26.529 INFO:teuthology.orchestra.run.smithi187.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-3924-g03410882-1focal [1,551 kB] 2023-06-09T11:07:26.872 INFO:teuthology.orchestra.run.smithi187.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-3924-g03410882-1focal [9,388 kB] 2023-06-09T11:07:27.996 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-3924-g03410882-1focal [227 kB] 2023-06-09T11:07:28.033 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-3924-g03410882-1focal [253 kB] 2023-06-09T11:07:28.088 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-3924-g03410882-1focal [23.3 kB] 2023-06-09T11:07:28.090 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-3924-g03410882-1focal [12.9 kB] 2023-06-09T11:07:28.090 INFO:teuthology.orchestra.run.smithi078.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-3924-g03410882-1focal [28.0 kB] 2023-06-09T11:07:28.110 INFO:teuthology.orchestra.run.smithi078.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-3924-g03410882-1focal [13.3 MB] 2023-06-09T11:07:29.819 INFO:teuthology.orchestra.run.smithi187.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-3924-g03410882-1focal [31.3 MB] 2023-06-09T11:07:32.996 INFO:teuthology.orchestra.run.smithi078.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-3924-g03410882-1focal [97.2 kB] 2023-06-09T11:07:34.486 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 201 MB in 17s (11.6 MB/s) 2023-06-09T11:07:34.643 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T11:07:34.713 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-06-09T11:07:34.716 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-09T11:07:34.756 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-09T11:07:35.077 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T11:07:35.095 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-09T11:07:35.136 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T11:07:35.454 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T11:07:35.473 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-09T11:07:35.512 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-09T11:07:35.867 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-09T11:07:35.884 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-09T11:07:35.966 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T11:07:36.371 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T11:07:36.389 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-09T11:07:36.429 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T11:07:36.799 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T11:07:36.818 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-09T11:07:36.858 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T11:07:37.303 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T11:07:37.323 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T11:07:37.373 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:07:37.897 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T11:07:37.915 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T11:07:37.955 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:07:38.359 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T11:07:38.378 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T11:07:38.417 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:07:38.836 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-09T11:07:38.856 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-09T11:07:38.894 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T11:07:39.284 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-librbd1_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:39.415 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (18.0.0-3924-g03410882-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T11:07:40.146 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-librados2_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:40.260 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (18.0.0-3924-g03410882-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T11:07:41.006 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T11:07:41.024 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:41.072 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:41.425 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2023-06-09T11:07:41.444 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-rados_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:41.483 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:41.861 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T11:07:41.879 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:07:41.919 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:42.205 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T11:07:42.218 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:42.263 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:42.621 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T11:07:42.640 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:07:42.680 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:43.045 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T11:07:43.064 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-06-09T11:07:43.103 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-09T11:07:43.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T11:07:43.427 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:43.469 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:43.839 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-09T11:07:43.857 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-09T11:07:43.897 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T11:07:44.258 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-09T11:07:44.276 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-09T11:07:44.316 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T11:07:44.678 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T11:07:44.697 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-09T11:07:44.736 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T11:07:45.122 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2023-06-09T11:07:45.141 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-librgw2_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:45.180 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:46.108 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T11:07:46.127 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:46.166 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:46.381 INFO:teuthology.orchestra.run.smithi187.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-3924-g03410882-1focal [3,812 B] 2023-06-09T11:07:46.382 INFO:teuthology.orchestra.run.smithi187.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-3924-g03410882-1focal [833 kB] 2023-06-09T11:07:46.552 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0. 2023-06-09T11:07:46.571 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-09T11:07:46.610 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-09T11:07:46.737 INFO:teuthology.orchestra.run.smithi187.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-3924-g03410882-1focal [2,292 kB] 2023-06-09T11:07:47.630 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T11:07:47.649 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:47.688 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:47.708 INFO:teuthology.orchestra.run.smithi187.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-3924-g03410882-1focal [97.8 kB] 2023-06-09T11:07:47.760 INFO:teuthology.orchestra.run.smithi187.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-3924-g03410882-1focal [122 kB] 2023-06-09T11:07:47.821 INFO:teuthology.orchestra.run.smithi187.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-3924-g03410882-1focal [1,775 kB] 2023-06-09T11:07:48.184 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2023-06-09T11:07:48.203 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-ceph-common_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:48.242 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:48.452 INFO:teuthology.orchestra.run.smithi187.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3924-g03410882-1focal [7,867 kB] 2023-06-09T11:07:50.160 INFO:teuthology.orchestra.run.smithi187.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-3924-g03410882-1focal [3,932 B] 2023-06-09T11:07:50.174 INFO:teuthology.orchestra.run.smithi187.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-3924-g03410882-1focal [43.8 MB] 2023-06-09T11:07:50.789 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2023-06-09T11:07:50.807 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-ceph-base_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:07:50.868 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:52.252 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T11:07:52.270 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-09T11:07:52.309 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-09T11:07:52.680 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T11:07:52.698 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-06-09T11:07:52.738 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-09T11:07:53.100 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T11:07:53.119 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-06-09T11:07:53.158 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-09T11:07:53.478 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T11:07:53.496 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-09T11:07:53.535 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-09T11:07:53.864 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2023-06-09T11:07:53.881 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-09T11:07:53.921 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T11:07:54.275 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T11:07:54.293 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T11:07:54.333 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T11:07:54.491 INFO:teuthology.orchestra.run.smithi187.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-3924-g03410882-1focal [227 kB] 2023-06-09T11:07:54.494 INFO:teuthology.orchestra.run.smithi187.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-3924-g03410882-1focal [253 kB] 2023-06-09T11:07:54.496 INFO:teuthology.orchestra.run.smithi187.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-3924-g03410882-1focal [23.3 kB] 2023-06-09T11:07:54.497 INFO:teuthology.orchestra.run.smithi187.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-3924-g03410882-1focal [12.9 kB] 2023-06-09T11:07:54.497 INFO:teuthology.orchestra.run.smithi187.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-3924-g03410882-1focal [28.0 kB] 2023-06-09T11:07:54.498 INFO:teuthology.orchestra.run.smithi187.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-3924-g03410882-1focal [13.3 MB] 2023-06-09T11:07:54.644 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T11:07:54.663 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-09T11:07:54.693 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T11:07:55.005 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2023-06-09T11:07:55.024 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-09T11:07:55.063 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-09T11:07:55.424 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-09T11:07:55.444 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-09T11:07:55.482 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T11:07:55.544 INFO:teuthology.orchestra.run.smithi187.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jun9-1308/034108821cde95ca1c56d458dfccc7ef9e0d964d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-3924-g03410882-1focal [97.2 kB] 2023-06-09T11:07:55.827 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bs4. 2023-06-09T11:07:55.845 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-06-09T11:07:55.884 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-09T11:07:56.280 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T11:07:56.299 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-09T11:07:56.345 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T11:07:56.460 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 201 MB in 39s (5,136 kB/s) 2023-06-09T11:07:56.626 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T11:07:56.699 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-06-09T11:07:56.702 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-09T11:07:56.708 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T11:07:56.728 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-06-09T11:07:56.748 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-09T11:07:56.766 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-09T11:07:57.084 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T11:07:57.094 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2023-06-09T11:07:57.103 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-09T11:07:57.112 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-09T11:07:57.142 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T11:07:57.152 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T11:07:57.514 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T11:07:57.532 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-09T11:07:57.572 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T11:07:57.645 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T11:07:57.663 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-09T11:07:57.703 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-09T11:07:57.894 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T11:07:57.913 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-09T11:07:57.951 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-09T11:07:58.083 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-09T11:07:58.101 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-09T11:07:58.183 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T11:07:58.296 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T11:07:58.315 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-06-09T11:07:58.354 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-09T11:07:58.563 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T11:07:58.582 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-09T11:07:58.621 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T11:07:58.699 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T11:07:58.717 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-09T11:07:58.757 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T11:07:58.992 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T11:07:59.011 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-09T11:07:59.050 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T11:07:59.162 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T11:07:59.180 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-09T11:07:59.220 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T11:07:59.538 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T11:07:59.540 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T11:07:59.557 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T11:07:59.557 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:07:59.597 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:07:59.618 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:08:00.028 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T11:08:00.046 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:00.086 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:00.141 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T11:08:00.160 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T11:08:00.199 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:08:00.439 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cryptography. 2023-06-09T11:08:00.458 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-09T11:08:00.496 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T11:08:00.586 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T11:08:00.605 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T11:08:00.644 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:08:00.893 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T11:08:00.912 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-09T11:08:00.950 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-09T11:08:01.039 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-09T11:08:01.057 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-09T11:08:01.097 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T11:08:01.345 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T11:08:01.364 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:01.403 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:01.494 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../010-librbd1_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:01.626 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librbd1 (18.0.0-3924-g03410882-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T11:08:01.890 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T11:08:01.908 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:01.939 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:02.349 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../011-librados2_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:02.489 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librados2 (18.0.0-3924-g03410882-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T11:08:03.243 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T11:08:03.262 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:03.301 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:03.360 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T11:08:03.377 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:03.418 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:03.671 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rados. 2023-06-09T11:08:03.690 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../013-python3-rados_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:03.729 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rados (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:04.083 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T11:08:04.100 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:04.140 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-argparse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:04.426 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T11:08:04.444 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:04.484 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cephfs (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:04.845 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T11:08:04.863 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:04.904 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:05.257 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T11:08:05.276 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-06-09T11:08:05.315 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-09T11:08:05.608 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T11:08:05.627 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:05.669 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rbd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:06.048 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-09T11:08:06.067 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-09T11:08:06.106 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T11:08:06.188 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2023-06-09T11:08:06.206 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-ceph_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:06.246 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:06.490 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-09T11:08:06.509 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-09T11:08:06.548 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T11:08:06.598 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T11:08:06.617 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:06.656 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:06.893 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T11:08:06.913 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-09T11:08:06.951 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T11:08:07.093 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T11:08:07.112 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:07.151 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:07.330 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librgw2. 2023-06-09T11:08:07.348 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../022-librgw2_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:07.388 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librgw2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:07.746 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2023-06-09T11:08:07.765 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-cephadm_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:07.804 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:08.165 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T11:08:08.184 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-06-09T11:08:08.223 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-06-09T11:08:08.274 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T11:08:08.293 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:08.324 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:08.635 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T11:08:08.653 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-06-09T11:08:08.686 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liboath0. 2023-06-09T11:08:08.693 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-09T11:08:08.704 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-09T11:08:08.743 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-09T11:08:09.079 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T11:08:09.088 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T11:08:09.098 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:09.107 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:09.137 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:09.146 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libradosstriper1 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:09.516 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T11:08:09.534 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-09T11:08:09.573 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T11:08:09.650 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-common. 2023-06-09T11:08:09.669 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../026-ceph-common_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:09.716 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:09.935 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jwt. 2023-06-09T11:08:09.954 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-09T11:08:09.993 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T11:08:10.321 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T11:08:10.340 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T11:08:10.379 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T11:08:10.665 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjs-underscore. 2023-06-09T11:08:10.684 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-09T11:08:10.723 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T11:08:11.034 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-09T11:08:11.052 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-09T11:08:11.092 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T11:08:11.453 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2023-06-09T11:08:11.473 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-06-09T11:08:11.519 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-09T11:08:11.881 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T11:08:11.899 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:11.939 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:12.305 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-base. 2023-06-09T11:08:12.317 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../027-ceph-base_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:12.378 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-base (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-decorator. 2023-06-09T11:08:12.469 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-09T11:08:12.508 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T11:08:12.854 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-09T11:08:12.872 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-09T11:08:12.911 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T11:08:13.256 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-scipy. 2023-06-09T11:08:13.274 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-09T11:08:13.314 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-09T11:08:13.769 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T11:08:13.781 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-09T11:08:13.818 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-09T11:08:14.222 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T11:08:14.236 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-06-09T11:08:14.280 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-09T11:08:14.617 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T11:08:14.636 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-06-09T11:08:14.675 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-09T11:08:14.690 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-09T11:08:14.712 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-09T11:08:14.747 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T11:08:15.013 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T11:08:15.032 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-09T11:08:15.071 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-09T11:08:15.301 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T11:08:15.320 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-06-09T11:08:15.359 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-09T11:08:15.407 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-mako. 2023-06-09T11:08:15.426 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-09T11:08:15.465 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T11:08:15.771 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T11:08:15.790 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-09T11:08:15.829 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T11:08:15.844 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T11:08:15.863 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T11:08:15.902 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T11:08:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T11:08:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-09T11:08:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T11:08:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T11:08:16.541 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:16.578 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:16.583 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webob. 2023-06-09T11:08:16.601 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-09T11:08:16.641 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-09T11:08:17.011 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-09T11:08:17.029 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-09T11:08:17.069 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T11:08:17.397 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bs4. 2023-06-09T11:08:17.415 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-06-09T11:08:17.455 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-09T11:08:17.781 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T11:08:17.794 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-06-09T11:08:17.831 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-09T11:08:17.850 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T11:08:17.869 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-09T11:08:17.914 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T11:08:18.167 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T11:08:18.180 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-09T11:08:18.216 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T11:08:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T11:08:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-06-09T11:08:18.329 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-09T11:08:18.553 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T11:08:18.566 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-09T11:08:18.611 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T11:08:18.665 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-paste. 2023-06-09T11:08:18.683 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-09T11:08:18.723 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T11:08:18.981 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T11:08:18.994 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-06-09T11:08:19.030 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-09T11:08:19.085 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T11:08:19.104 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-09T11:08:19.143 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T11:08:19.376 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T11:08:19.395 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-06-09T11:08:19.433 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-09T11:08:19.463 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T11:08:19.481 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-09T11:08:19.521 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-09T11:08:19.787 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-blinker. 2023-06-09T11:08:19.800 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-09T11:08:19.845 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T11:08:19.849 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T11:08:19.868 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-06-09T11:08:19.907 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-09T11:08:20.181 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-09T11:08:20.200 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-09T11:08:20.239 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T11:08:20.252 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T11:08:20.270 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-09T11:08:20.318 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T11:08:20.721 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T11:08:20.732 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T11:08:20.738 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-09T11:08:20.750 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-09T11:08:20.778 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T11:08:20.790 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T11:08:21.102 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T11:08:21.121 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:21.140 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T11:08:21.158 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-09T11:08:21.159 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:21.198 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T11:08:21.552 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T11:08:21.571 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-09T11:08:21.573 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T11:08:21.593 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:21.618 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T11:08:21.631 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:21.967 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cryptography. 2023-06-09T11:08:21.980 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-09T11:08:22.017 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T11:08:22.249 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T11:08:22.268 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:22.306 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:22.438 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T11:08:22.457 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-09T11:08:22.496 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-09T11:08:22.659 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T11:08:22.678 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-06-09T11:08:22.717 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-09T11:08:22.849 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T11:08:22.868 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:22.907 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:23.104 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T11:08:23.123 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:08:23.162 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:08:23.436 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T11:08:23.455 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:23.465 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2023-06-09T11:08:23.485 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:08:23.502 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mon (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:23.523 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:08:23.818 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2023-06-09T11:08:23.837 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-06-09T11:08:23.875 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-09T11:08:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T11:08:24.231 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-09T11:08:24.270 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-09T11:08:24.751 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2023-06-09T11:08:24.764 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T11:08:24.769 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-ceph-test_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:24.783 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:24.808 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:24.822 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-osd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:27.592 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph. 2023-06-09T11:08:27.611 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../053-ceph_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:27.650 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:27.995 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T11:08:28.013 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:28.052 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:28.656 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T11:08:28.671 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T11:08:28.673 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:28.689 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:28.714 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mds (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:28.728 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:29.067 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T11:08:29.086 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:29.124 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:29.259 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephadm. 2023-06-09T11:08:29.277 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../056-cephadm_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:29.316 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:29.486 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T11:08:29.505 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-09T11:08:29.544 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-09T11:08:29.662 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T11:08:29.680 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-06-09T11:08:29.719 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-06-09T11:08:29.861 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T11:08:29.881 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:29.927 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:30.089 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T11:08:30.102 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-06-09T11:08:30.139 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-09T11:08:30.205 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T11:08:30.218 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:30.263 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:30.517 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T11:08:30.535 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:30.549 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-09T11:08:30.570 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T11:08:30.575 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:30.607 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:08:30.946 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T11:08:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-09T11:08:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T11:08:31.111 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T11:08:31.130 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:31.168 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:31.340 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jwt. 2023-06-09T11:08:31.358 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-09T11:08:31.398 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T11:08:31.614 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T11:08:31.633 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-09T11:08:31.710 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T11:08:31.735 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T11:08:31.753 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T11:08:31.792 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T11:08:32.060 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T11:08:32.062 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjs-underscore. 2023-06-09T11:08:32.080 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-06-09T11:08:32.081 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-09T11:08:32.118 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-06-09T11:08:32.120 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T11:08:32.431 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-09T11:08:32.450 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-09T11:08:32.489 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T11:08:32.530 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-09T11:08:32.549 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T11:08:32.587 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:08:32.826 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-routes. 2023-06-09T11:08:32.844 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-06-09T11:08:32.883 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-09T11:08:33.270 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T11:08:33.289 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:33.328 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:33.832 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-decorator. 2023-06-09T11:08:33.850 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-09T11:08:33.890 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T11:08:34.226 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-09T11:08:34.245 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-09T11:08:34.284 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T11:08:34.638 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-scipy. 2023-06-09T11:08:34.657 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-09T11:08:34.700 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-09T11:08:34.701 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-09T11:08:34.709 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-09T11:08:34.754 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-09T11:08:35.107 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-09T11:08:35.122 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-09T11:08:35.174 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T11:08:35.485 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-attr. 2023-06-09T11:08:35.499 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-06-09T11:08:35.543 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-09T11:08:35.913 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webencodings. 2023-06-09T11:08:35.933 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-09T11:08:35.979 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T11:08:36.040 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-09T11:08:36.059 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-09T11:08:36.097 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T11:08:36.324 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-html5lib. 2023-06-09T11:08:36.344 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-06-09T11:08:36.381 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-09T11:08:36.651 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T11:08:36.670 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-06-09T11:08:36.709 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-09T11:08:36.760 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-09T11:08:36.779 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-09T11:08:36.818 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T11:08:37.105 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T11:08:37.121 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-09T11:08:37.162 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T11:08:37.313 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-packaging. 2023-06-09T11:08:37.333 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-06-09T11:08:37.370 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-09T11:08:37.707 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T11:08:37.727 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T11:08:37.764 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T11:08:37.879 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T11:08:37.897 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:37.936 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:38.127 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T11:08:38.147 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-06-09T11:08:38.185 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-09T11:08:38.555 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T11:08:38.575 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-09T11:08:38.612 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T11:08:38.999 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2023-06-09T11:08:39.018 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-09T11:08:39.056 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T11:08:39.156 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T11:08:39.175 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-06-09T11:08:39.214 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-09T11:08:39.436 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T11:08:39.451 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-09T11:08:39.494 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T11:08:39.534 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T11:08:39.553 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-09T11:08:39.591 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T11:08:39.830 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T11:08:39.843 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-06-09T11:08:39.888 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-09T11:08:39.961 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T11:08:39.981 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-09T11:08:40.019 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T11:08:40.275 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T11:08:40.295 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-09T11:08:40.341 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T11:08:40.372 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T11:08:40.392 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-06-09T11:08:40.430 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-09T11:08:40.670 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T11:08:40.690 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-09T11:08:40.728 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T11:08:40.784 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T11:08:40.802 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-06-09T11:08:40.841 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-09T11:08:41.220 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-blinker. 2023-06-09T11:08:41.239 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-09T11:08:41.277 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T11:08:41.440 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2023-06-09T11:08:41.460 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../116-radosgw_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:41.498 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:41.622 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-09T11:08:41.641 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-09T11:08:41.680 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T11:08:42.127 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T11:08:42.147 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-09T11:08:42.185 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T11:08:42.531 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T11:08:42.550 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-09T11:08:42.588 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T11:08:42.877 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T11:08:42.895 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:42.934 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:42.943 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T11:08:42.961 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-09T11:08:43.000 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T11:08:43.294 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-09T11:08:43.622 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T11:08:43.641 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:43.668 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T11:08:43.680 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:43.794 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T11:08:43.920 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T11:08:44.050 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T11:08:44.070 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-06-09T11:08:44.107 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-09T11:08:44.138 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:44.470 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T11:08:44.490 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:08:44.527 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:08:44.837 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2023-06-09T11:08:44.838 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package jq. 2023-06-09T11:08:44.857 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:08:44.896 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:08:45.019 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:08:45.146 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T11:08:45.183 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package socat. 2023-06-09T11:08:45.201 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-06-09T11:08:45.232 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-09T11:08:45.572 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T11:08:45.586 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T11:08:45.605 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-09T11:08:45.643 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-09T11:08:45.915 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:08:46.015 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-test. 2023-06-09T11:08:46.033 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../090-ceph-test_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:46.049 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-09T11:08:46.072 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-test (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:46.175 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T11:08:46.581 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-09T11:08:47.058 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T11:08:47.410 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-09T11:08:47.761 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-09T11:08:48.104 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T11:08:48.448 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T11:08:48.789 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:49.159 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T11:08:49.285 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-09T11:08:49.628 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-09T11:08:49.768 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T11:08:49.781 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:49.826 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-volume (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:49.971 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T11:08:50.198 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T11:08:50.214 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:50.255 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephfs-mirror (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:50.313 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T11:08:50.439 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T11:08:50.608 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T11:08:50.622 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-09T11:08:50.666 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-09T11:08:50.890 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-09T11:08:50.952 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T11:08:50.964 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:51.010 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephfs-shell (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:51.250 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T11:08:51.313 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T11:08:51.326 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-3924-g03410882-1focal_all.deb ... 2023-06-09T11:08:51.370 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephfs-top (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:51.601 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T11:08:51.653 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-09T11:08:51.671 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T11:08:51.712 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:08:52.002 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T11:08:52.216 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T11:08:52.231 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:08:52.273 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs-dev (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:52.336 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-09T11:08:52.685 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T11:08:52.698 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-09T11:08:52.737 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-09T11:08:52.772 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T11:08:53.088 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-09T11:08:53.123 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T11:08:53.138 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-06-09T11:08:53.180 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-06-09T11:08:53.447 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T11:08:53.590 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T11:08:53.609 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-09T11:08:53.624 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T11:08:53.666 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:08:53.716 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T11:08:54.051 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T11:08:54.536 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-09T11:08:54.895 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T11:08:55.329 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T11:08:55.606 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-09T11:08:55.622 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-09T11:08:55.664 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-09T11:08:55.764 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-09T11:08:55.899 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:08:56.042 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-09T11:08:56.057 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-09T11:08:56.100 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T11:08:56.301 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:08:56.420 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-attr. 2023-06-09T11:08:56.435 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-06-09T11:08:56.443 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-09T11:08:56.477 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-09T11:08:56.822 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webencodings. 2023-06-09T11:08:56.838 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-09T11:08:56.861 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T11:08:56.879 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T11:08:56.989 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-09T11:08:57.116 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-09T11:08:57.217 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-html5lib. 2023-06-09T11:08:57.232 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-06-09T11:08:57.274 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-09T11:08:57.451 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T11:08:57.628 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-09T11:08:57.643 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-09T11:08:57.685 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T11:08:57.827 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:08:57.953 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T11:08:58.079 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T11:08:58.164 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-packaging. 2023-06-09T11:08:58.179 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-06-09T11:08:58.221 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-09T11:08:58.472 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T11:08:58.566 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T11:08:58.576 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T11:08:58.615 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T11:08:58.826 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-09T11:08:59.186 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T11:08:59.219 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T11:08:59.224 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-06-09T11:08:59.268 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-09T11:08:59.312 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T11:08:59.605 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T11:08:59.616 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-09T11:08:59.654 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T11:08:59.655 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-09T11:09:00.014 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T11:09:00.024 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-py. 2023-06-09T11:09:00.035 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-09T11:09:00.073 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T11:09:00.399 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T11:09:00.435 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T11:09:00.447 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-09T11:09:00.485 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T11:09:00.777 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-09T11:09:00.821 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T11:09:00.828 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-06-09T11:09:00.870 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-09T11:09:01.086 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-09T11:09:01.212 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T11:09:01.242 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T11:09:01.256 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-09T11:09:01.300 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T11:09:01.594 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T11:09:01.597 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-09T11:09:01.607 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-09T11:09:01.652 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T11:09:02.023 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T11:09:02.149 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T11:09:02.275 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-09T11:09:02.306 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package radosgw. 2023-06-09T11:09:02.319 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../116-radosgw_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:09:02.363 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking radosgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:02.668 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T11:09:03.011 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-09T11:09:03.736 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T11:09:03.746 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-3924-g03410882-1focal_amd64.deb ... 2023-06-09T11:09:03.786 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking rbd-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:04.121 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-09T11:09:04.482 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T11:09:04.617 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T11:09:04.743 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T11:09:04.766 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:09:04.892 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-09T11:09:04.964 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:05.352 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-09T11:09:05.671 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user cephadm....done 2023-06-09T11:09:05.711 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-09T11:09:05.845 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:09:05.971 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T11:09:06.062 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:09:06.189 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-09T11:09:06.389 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T11:09:06.598 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T11:09:06.732 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T11:09:06.867 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-09T11:09:06.992 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-06-09T11:09:06.993 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T11:09:07.395 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-09T11:09:07.443 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T11:09:07.836 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T11:09:07.855 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T11:09:08.198 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-09T11:09:08.541 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-09T11:09:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T11:09:09.058 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T11:09:09.238 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T11:09:09.501 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-09T11:09:09.589 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-argparse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:09.626 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:09:09.752 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-09T11:09:09.940 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T11:09:10.067 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-09T11:09:10.104 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T11:09:10.229 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-09T11:09:10.410 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-09T11:09:10.580 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T11:09:10.746 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T11:09:10.932 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T11:09:11.095 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T11:09:11.220 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T11:09:11.316 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T11:09:11.682 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-09T11:09:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:11.972 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-06-09T11:09:12.041 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T11:09:12.106 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:12.257 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:12.376 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T11:09:12.391 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:12.517 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-09T11:09:12.777 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T11:09:12.869 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:12.995 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-09T11:09:13.121 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-09T11:09:13.363 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:13.489 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:13.529 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-09T11:09:13.615 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:13.879 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T11:09:13.880 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T11:09:13.888 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-09T11:09:14.423 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T11:09:14.548 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T11:09:14.674 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T11:09:14.684 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:14.809 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:14.935 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:15.026 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T11:09:15.061 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T11:09:15.502 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-09T11:09:15.870 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T11:09:16.181 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T11:09:16.310 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:16.436 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:16.561 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:16.687 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:16.748 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-09T11:09:16.813 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:16.874 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:17.267 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:09:17.393 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2023-06-09T11:09:17.418 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-09T11:09:17.836 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T11:09:17.842 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2023-06-09T11:09:17.962 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-09T11:09:18.065 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2023-06-09T11:09:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-09T11:09:18.097 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T11:09:18.285 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T11:09:18.439 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T11:09:18.803 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T11:09:18.824 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:09:18.950 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T11:09:19.077 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T11:09:19.472 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T11:09:19.718 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:19.814 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-09T11:09:19.852 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:19.978 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:20.173 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T11:09:20.298 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T11:09:20.298 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T11:09:20.299 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T11:09:20.643 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-09T11:09:21.002 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T11:09:21.396 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T11:09:21.546 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:21.825 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-09T11:09:22.037 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T11:09:22.125 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-09T11:09:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T11:09:22.627 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-09T11:09:22.898 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:23.053 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T11:09:23.179 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T11:09:23.184 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T11:09:23.184 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T11:09:23.297 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-09T11:09:23.700 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T11:09:24.008 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:24.051 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-09T11:09:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T11:09:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T11:09:25.160 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:25.832 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:09:25.931 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T11:09:25.931 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T11:09:25.966 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-09T11:09:26.418 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-09T11:09:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:26.785 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-09T11:09:26.889 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:27.040 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:27.136 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T11:09:27.262 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-09T11:09:27.306 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T11:09:27.306 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T11:09:27.680 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T11:09:28.073 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-06-09T11:09:28.141 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:28.292 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:28.427 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:28.541 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T11:09:28.578 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:28.704 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T11:09:28.864 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T11:09:28.934 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T11:09:29.365 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T11:09:30.156 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T11:09:30.282 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-09T11:09:30.416 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T11:09:30.542 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-09T11:09:30.893 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T11:09:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-09T11:09:31.379 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T11:09:31.721 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T11:09:32.099 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T11:09:32.542 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librados2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:32.770 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-06-09T11:09:32.896 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librgw2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:33.022 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:33.148 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs2 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:33.274 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-09T11:09:33.633 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libradosstriper1 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:33.759 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-09T11:09:34.111 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librbd1 (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:34.237 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-modules-core (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:34.363 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:34.378 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-09T11:09:34.627 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T11:09:34.627 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T11:09:35.254 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T11:09:35.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T11:09:35.381 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-09T11:09:35.456 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs-dev (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:35.582 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rados (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:35.583 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-06-09T11:09:35.584 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-06-09T11:09:35.716 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephfs-top (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:35.766 INFO:teuthology.orchestra.run.smithi078.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-09T11:09:35.766 INFO:teuthology.orchestra.run.smithi078.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-09T11:09:35.766 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-09T11:09:35.766 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T11:09:35.767 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T11:09:35.767 INFO:teuthology.orchestra.run.smithi078.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T11:09:35.767 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T11:09:35.767 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T11:09:35.768 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T11:09:35.768 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T11:09:35.768 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-06-09T11:09:35.768 INFO:teuthology.orchestra.run.smithi078.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-09T11:09:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-06-09T11:09:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-06-09T11:09:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-06-09T11:09:35.769 INFO:teuthology.orchestra.run.smithi078.stdout: wpasupplicant 2023-06-09T11:09:35.769 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-06-09T11:09:35.770 INFO:teuthology.orchestra.run.smithi078.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-06-09T11:09:35.770 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-06-09T11:09:35.842 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T11:09:35.863 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-06-09T11:09:35.864 INFO:teuthology.orchestra.run.smithi078.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-09T11:09:35.864 INFO:teuthology.orchestra.run.smithi078.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-06-09T11:09:35.865 INFO:teuthology.orchestra.run.smithi078.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-09T11:09:35.865 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-06-09T11:09:35.865 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-06-09T11:09:35.865 INFO:teuthology.orchestra.run.smithi078.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T11:09:35.866 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-06-09T11:09:35.866 INFO:teuthology.orchestra.run.smithi078.stdout: libssl1.1 2023-06-09T11:09:36.062 INFO:teuthology.orchestra.run.smithi078.stdout:1 upgraded, 31 newly installed, 0 to remove and 185 not upgraded. 2023-06-09T11:09:36.062 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 24.0 MB of archives. 2023-06-09T11:09:36.062 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-06-09T11:09:36.062 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-09T11:09:36.714 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-09T11:09:36.716 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-09T11:09:36.722 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-09T11:09:36.726 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-09T11:09:36.727 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-09T11:09:36.728 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-09T11:09:36.730 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-09T11:09:36.736 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-09T11:09:36.737 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-09T11:09:36.795 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-09T11:09:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-09T11:09:36.963 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rbd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:37.088 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up rbd-fuse (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:37.214 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:37.349 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cephfs (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:37.461 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-06-09T11:09:37.475 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephfs-shell (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:37.479 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-09T11:09:37.601 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-common (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:37.602 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-09T11:09:37.603 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-09T11:09:37.722 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-09T11:09:37.723 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-09T11:09:37.756 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-09T11:09:37.791 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-09T11:09:37.841 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-09T11:09:37.845 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-09T11:09:38.009 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-09T11:09:38.171 INFO:teuthology.orchestra.run.smithi187.stdout:Adding group ceph....done 2023-06-09T11:09:38.201 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-06-09T11:09:38.250 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-06-09T11:09:38.630 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-06-09T11:09:38.631 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user ceph....done 2023-06-09T11:09:38.644 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-06-09T11:09:38.851 INFO:teuthology.orchestra.run.smithi187.stdout:Setting system user ceph properties....done 2023-06-09T11:09:38.889 INFO:teuthology.orchestra.run.smithi187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T11:09:39.083 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-06-09T11:09:39.083 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-06-09T11:09:39.084 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-06-09T11:09:39.084 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-09T11:09:39.085 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-09T11:09:39.098 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T11:09:39.636 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2023-06-09T11:09:39.637 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T11:09:39.977 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 24.0 MB in 3s (7,470 kB/s) 2023-06-09T11:09:40.476 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118859 files and directories currently installed.) 2023-06-09T11:09:40.480 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T11:09:40.561 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephfs-mirror (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:40.669 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-09T11:09:40.687 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-test (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:40.813 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up radosgw (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:41.132 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T11:09:41.133 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T11:09:41.190 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T11:09:41.204 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-09T11:09:41.248 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-09T11:09:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2023-06-09T11:09:41.639 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-09T11:09:41.676 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b46-6) ... 2023-06-09T11:09:42.030 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2023-06-09T11:09:42.050 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-09T11:09:42.088 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1) ... 2023-06-09T11:09:42.351 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-base (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:42.432 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T11:09:42.452 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-09T11:09:42.490 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T11:09:42.836 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T11:09:42.860 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T11:09:42.882 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-09T11:09:42.918 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T11:09:43.209 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T11:09:43.224 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-09T11:09:43.262 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T11:09:43.657 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T11:09:43.678 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:09:43.767 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mds (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:43.767 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:09:43.975 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T11:09:43.975 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T11:09:44.026 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T11:09:44.046 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:09:44.084 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:09:44.445 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T11:09:44.467 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:09:44.511 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:09:44.795 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:44.914 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T11:09:44.935 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-09T11:09:44.972 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T11:09:45.063 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T11:09:45.063 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T11:09:45.393 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T11:09:45.413 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T11:09:45.451 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T11:09:45.845 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T11:09:45.865 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:09:45.905 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-osd (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:45.911 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:09:46.281 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T11:09:46.303 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:09:46.339 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:09:46.716 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T11:09:46.736 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:09:46.774 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T11:09:46.774 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T11:09:46.775 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:09:47.060 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T11:09:47.081 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T11:09:47.118 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T11:09:47.623 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:47.638 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T11:09:47.658 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-06-09T11:09:47.696 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-09T11:09:47.749 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:47.901 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mon (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:48.099 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package modemmanager. 2023-06-09T11:09:48.119 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:09:48.155 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T11:09:48.155 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T11:09:48.177 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:09:48.838 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T11:09:48.858 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-09T11:09:48.896 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T11:09:49.085 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-cephadm (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:49.227 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:49.354 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-dashboard (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:49.476 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager. 2023-06-09T11:09:49.495 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T11:09:49.506 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-volume (18.0.0-3924-g03410882-1focal) ... 2023-06-09T11:09:49.588 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T11:09:49.634 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T11:09:49.793 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T11:09:50.279 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T11:09:50.568 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ppp. 2023-06-09T11:09:50.587 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-09T11:09:51.060 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T11:09:51.447 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T11:09:51.467 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-09T11:09:51.505 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-09T11:09:51.917 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T11:09:51.937 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-09T11:09:52.006 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-09T11:09:52.345 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T11:09:52.365 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-06-09T11:09:52.403 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-06-09T11:09:52.748 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-12. 2023-06-09T11:09:52.769 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:09:52.806 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:09:53.419 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T11:09:53.438 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-06-09T11:09:53.507 INFO:teuthology.orchestra.run.smithi078.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T11:09:53.546 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-06-09T11:09:54.017 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-12. 2023-06-09T11:09:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:09:54.081 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:09:55.365 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-09T11:09:55.561 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql. 2023-06-09T11:09:55.581 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-06-09T11:09:55.619 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-06-09T11:09:55.914 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T11:09:55.935 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-06-09T11:09:55.980 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-06-09T11:09:56.138 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T11:09:56.143 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T11:09:56.265 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T11:09:56.267 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2023-06-09T11:09:56.287 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-06-09T11:09:56.332 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T11:09:56.465 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2023-06-09T11:09:56.465 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2023-06-09T11:09:56.601 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T11:09:56.621 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-09T11:09:56.649 INFO:teuthology.orchestra.run.smithi187.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-09T11:09:56.649 INFO:teuthology.orchestra.run.smithi187.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-09T11:09:56.649 INFO:teuthology.orchestra.run.smithi187.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-09T11:09:56.649 INFO:teuthology.orchestra.run.smithi187.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T11:09:56.650 INFO:teuthology.orchestra.run.smithi187.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T11:09:56.650 INFO:teuthology.orchestra.run.smithi187.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T11:09:56.650 INFO:teuthology.orchestra.run.smithi187.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T11:09:56.650 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T11:09:56.651 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T11:09:56.651 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T11:09:56.651 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2023-06-09T11:09:56.651 INFO:teuthology.orchestra.run.smithi187.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-09T11:09:56.651 INFO:teuthology.orchestra.run.smithi187.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-06-09T11:09:56.652 INFO:teuthology.orchestra.run.smithi187.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-06-09T11:09:56.652 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-06-09T11:09:56.652 INFO:teuthology.orchestra.run.smithi187.stdout: wpasupplicant 2023-06-09T11:09:56.652 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2023-06-09T11:09:56.653 INFO:teuthology.orchestra.run.smithi187.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-06-09T11:09:56.653 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-06-09T11:09:56.658 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-09T11:09:56.744 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2023-06-09T11:09:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-09T11:09:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-06-09T11:09:56.746 INFO:teuthology.orchestra.run.smithi187.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-09T11:09:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-06-09T11:09:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-06-09T11:09:56.747 INFO:teuthology.orchestra.run.smithi187.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T11:09:56.748 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2023-06-09T11:09:56.748 INFO:teuthology.orchestra.run.smithi187.stdout: libssl1.1 2023-06-09T11:09:56.833 INFO:teuthology.orchestra.run.smithi187.stdout:1 upgraded, 31 newly installed, 0 to remove and 185 not upgraded. 2023-06-09T11:09:56.833 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 24.0 MB of archives. 2023-06-09T11:09:56.833 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-06-09T11:09:56.833 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-09T11:09:56.970 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-09T11:09:56.972 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-09T11:09:56.975 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-09T11:09:56.978 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-09T11:09:56.979 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-09T11:09:56.981 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-09T11:09:56.982 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-09T11:09:56.983 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-09T11:09:56.984 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-09T11:09:56.987 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-09T11:09:57.022 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-09T11:09:57.070 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T11:09:57.084 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-09T11:09:57.127 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-06-09T11:09:57.132 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-09T11:09:57.149 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T11:09:57.157 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-09T11:09:57.157 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-09T11:09:57.183 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-09T11:09:57.184 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-09T11:09:57.195 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-09T11:09:57.210 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-09T11:09:57.229 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-09T11:09:57.233 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-09T11:09:57.268 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-09T11:09:57.310 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-06-09T11:09:57.320 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-06-09T11:09:57.401 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-06-09T11:09:57.404 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-06-09T11:09:57.467 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-06-09T11:09:57.548 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-06-09T11:09:57.549 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-06-09T11:09:57.549 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-06-09T11:09:57.549 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-09T11:09:57.550 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-09T11:09:57.676 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T11:09:58.077 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:09:58.105 INFO:teuthology.orchestra.run.smithi187.stdout:Preconfiguring packages ... 2023-06-09T11:09:58.203 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-09T11:09:58.329 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T11:09:58.336 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 24.0 MB in 1s (30.2 MB/s) 2023-06-09T11:09:58.455 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T11:09:58.697 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118859 files and directories currently installed.) 2023-06-09T11:09:58.701 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T11:09:58.881 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-09T11:09:58.892 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T11:09:58.892 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T11:09:59.394 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T11:09:59.414 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-09T11:09:59.459 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-09T11:09:59.816 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:09:59.846 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package dump. 2023-06-09T11:09:59.865 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-09T11:09:59.904 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking dump (0.4b46-6) ... 2023-06-09T11:10:00.296 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package indent. 2023-06-09T11:10:00.319 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-09T11:10:00.768 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking indent (2.2.12-1) ... 2023-06-09T11:10:01.121 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T11:10:01.145 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-09T11:10:01.179 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T11:10:01.532 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T11:10:01.556 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-09T11:10:01.590 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T11:10:01.885 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T11:10:01.903 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-09T11:10:01.925 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T11:10:01.942 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T11:10:02.029 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-09T11:10:02.155 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-06-09T11:10:02.329 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T11:10:02.348 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:10:02.387 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:10:02.675 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T11:10:02.695 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:10:02.733 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:10:03.094 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T11:10:03.114 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:10:03.152 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:10:03.400 INFO:teuthology.orchestra.run.smithi078.stdout:Adding user postgres to group ssl-cert 2023-06-09T11:10:03.530 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T11:10:03.550 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-09T11:10:03.588 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T11:10:03.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:03.775 INFO:teuthology.orchestra.run.smithi078.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T11:10:03.950 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T11:10:03.970 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T11:10:04.008 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T11:10:04.259 INFO:teuthology.orchestra.run.smithi078.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T11:10:04.260 INFO:teuthology.orchestra.run.smithi078.stdout:Removing obsolete dictionary files: 2023-06-09T11:10:04.403 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T11:10:04.422 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:10:04.460 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:10:04.817 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T11:10:04.840 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T11:10:04.858 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:10:04.896 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:10:05.291 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T11:10:05.311 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:10:05.349 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:10:05.619 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T11:10:05.638 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T11:10:05.860 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T11:10:06.365 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T11:10:06.406 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T11:10:06.427 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-06-09T11:10:06.464 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-09T11:10:06.491 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-09T11:10:06.616 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T11:10:06.743 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T11:10:06.869 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T11:10:06.876 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package modemmanager. 2023-06-09T11:10:06.896 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T11:10:06.958 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:10:07.598 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T11:10:07.618 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-09T11:10:07.656 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T11:10:08.038 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-09T11:10:08.220 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package network-manager. 2023-06-09T11:10:08.239 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T11:10:08.318 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T11:10:08.482 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b46-6) ... 2023-06-09T11:10:08.591 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T11:10:08.658 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:10:08.793 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T11:10:08.919 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1) ... 2023-06-09T11:10:09.045 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T11:10:09.127 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ppp. 2023-06-09T11:10:09.147 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-09T11:10:09.230 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T11:10:09.356 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:10:09.628 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T11:10:09.849 INFO:teuthology.orchestra.run.smithi078.stdout:Creating new PostgreSQL cluster 12/main ... 2023-06-09T11:10:09.885 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-06-09T11:10:09.954 INFO:teuthology.orchestra.run.smithi078.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T11:10:09.955 INFO:teuthology.orchestra.run.smithi078.stdout:This user must also own the server process. 2023-06-09T11:10:09.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:09.955 INFO:teuthology.orchestra.run.smithi078.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T11:10:09.955 INFO:teuthology.orchestra.run.smithi078.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T11:10:09.955 INFO:teuthology.orchestra.run.smithi078.stdout:The default text search configuration will be set to "english". 2023-06-09T11:10:09.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:09.955 INFO:teuthology.orchestra.run.smithi078.stdout:Data page checksums are disabled. 2023-06-09T11:10:09.956 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:09.956 INFO:teuthology.orchestra.run.smithi078.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-06-09T11:10:09.958 INFO:teuthology.orchestra.run.smithi078.stdout:creating subdirectories ... ok 2023-06-09T11:10:09.959 INFO:teuthology.orchestra.run.smithi078.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T11:10:09.996 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default max_connections ... 100 2023-06-09T11:10:09.999 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T11:10:10.018 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-09T11:10:10.040 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default shared_buffers ... 128MB 2023-06-09T11:10:10.057 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-09T11:10:10.063 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default time zone ... Etc/UTC 2023-06-09T11:10:10.065 INFO:teuthology.orchestra.run.smithi078.stdout:creating configuration files ... ok 2023-06-09T11:10:10.255 INFO:teuthology.orchestra.run.smithi078.stdout:running bootstrap script ... ok 2023-06-09T11:10:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T11:10:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-09T11:10:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-09T11:10:10.890 INFO:teuthology.orchestra.run.smithi078.stdout:performing post-bootstrap initialization ... ok 2023-06-09T11:10:11.015 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T11:10:11.035 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-06-09T11:10:11.073 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-06-09T11:10:11.419 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-client-12. 2023-06-09T11:10:11.439 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:10:11.477 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:10:11.770 INFO:teuthology.orchestra.run.smithi078.stdout:syncing data to disk ... ok 2023-06-09T11:10:11.770 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:11.770 INFO:teuthology.orchestra.run.smithi078.stdout:Success. You can now start the database server using: 2023-06-09T11:10:11.770 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:11.770 INFO:teuthology.orchestra.run.smithi078.stdout: pg_ctlcluster 12 main start 2023-06-09T11:10:11.771 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:12.116 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T11:10:12.136 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-06-09T11:10:12.206 INFO:teuthology.orchestra.run.smithi187.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T11:10:12.235 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-06-09T11:10:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-06-09T11:10:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-06-09T11:10:12.527 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T11:10:12.756 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-12. 2023-06-09T11:10:12.776 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T11:10:12.821 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:10:14.302 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql. 2023-06-09T11:10:14.323 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-06-09T11:10:14.368 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-06-09T11:10:14.645 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T11:10:14.666 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-06-09T11:10:14.712 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-06-09T11:10:14.989 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T11:10:15.010 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-06-09T11:10:15.047 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T11:10:15.342 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T11:10:15.363 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-09T11:10:15.408 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-09T11:10:15.803 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T11:10:15.823 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-09T11:10:15.873 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T11:10:16.130 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:10:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-06-09T11:10:16.256 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-09T11:10:16.432 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-06-09T11:10:16.484 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T11:10:16.558 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T11:10:16.844 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:10:16.970 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-09T11:10:17.096 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T11:10:17.222 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T11:10:17.664 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T11:10:17.665 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T11:10:17.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:17.718 INFO:teuthology.orchestra.run.smithi078.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T11:10:17.718 INFO:teuthology.orchestra.run.smithi078.stdout:which means they are currently configured by ifupdown: 2023-06-09T11:10:17.719 INFO:teuthology.orchestra.run.smithi078.stdout:- enp3s0f1 2023-06-09T11:10:17.719 INFO:teuthology.orchestra.run.smithi078.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T11:10:17.719 INFO:teuthology.orchestra.run.smithi078.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T11:10:17.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:17.945 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T11:10:18.480 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T11:10:18.550 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:10:19.392 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T11:10:20.327 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:10:20.462 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-09T11:10:20.621 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T11:10:20.676 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T11:10:20.747 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-06-09T11:10:20.789 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-09T11:10:20.873 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:10:20.915 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-06-09T11:10:20.999 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:10:21.133 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:10:21.457 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T11:10:21.458 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T11:10:22.152 INFO:teuthology.orchestra.run.smithi187.stdout:Adding user postgres to group ssl-cert 2023-06-09T11:10:22.452 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T11:10:22.531 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:22.531 INFO:teuthology.orchestra.run.smithi187.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T11:10:22.587 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T11:10:22.747 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T11:10:23.011 INFO:teuthology.orchestra.run.smithi187.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T11:10:23.012 INFO:teuthology.orchestra.run.smithi187.stdout:Removing obsolete dictionary files: 2023-06-09T11:10:23.231 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T11:10:23.557 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T11:10:24.909 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T11:10:25.035 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-09T11:10:25.160 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T11:10:25.287 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T11:10:25.417 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T11:10:26.626 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-09T11:10:27.043 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up dump (0.4b46-6) ... 2023-06-09T11:10:27.154 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T11:10:27.220 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:10:27.346 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T11:10:27.472 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up indent (2.2.12-1) ... 2023-06-09T11:10:27.590 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T11:10:27.792 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T11:10:27.918 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T11:10:28.384 INFO:teuthology.orchestra.run.smithi187.stdout:Creating new PostgreSQL cluster 12/main ... 2023-06-09T11:10:28.419 INFO:teuthology.orchestra.run.smithi187.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-06-09T11:10:28.495 INFO:teuthology.orchestra.run.smithi187.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T11:10:28.495 INFO:teuthology.orchestra.run.smithi187.stdout:This user must also own the server process. 2023-06-09T11:10:28.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:28.495 INFO:teuthology.orchestra.run.smithi187.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T11:10:28.496 INFO:teuthology.orchestra.run.smithi187.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T11:10:28.496 INFO:teuthology.orchestra.run.smithi187.stdout:The default text search configuration will be set to "english". 2023-06-09T11:10:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:28.496 INFO:teuthology.orchestra.run.smithi187.stdout:Data page checksums are disabled. 2023-06-09T11:10:28.496 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:28.496 INFO:teuthology.orchestra.run.smithi187.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-06-09T11:10:28.497 INFO:teuthology.orchestra.run.smithi187.stdout:creating subdirectories ... ok 2023-06-09T11:10:28.497 INFO:teuthology.orchestra.run.smithi187.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T11:10:28.533 INFO:teuthology.orchestra.run.smithi187.stdout:selecting default max_connections ... 100 2023-06-09T11:10:28.580 INFO:teuthology.orchestra.run.smithi187.stdout:selecting default shared_buffers ... 128MB 2023-06-09T11:10:28.602 INFO:teuthology.orchestra.run.smithi187.stdout:selecting default time zone ... Etc/UTC 2023-06-09T11:10:28.603 INFO:teuthology.orchestra.run.smithi187.stdout:creating configuration files ... ok 2023-06-09T11:10:28.792 INFO:teuthology.orchestra.run.smithi187.stdout:running bootstrap script ... ok 2023-06-09T11:10:29.441 INFO:teuthology.orchestra.run.smithi187.stdout:performing post-bootstrap initialization ... ok 2023-06-09T11:10:29.957 INFO:teuthology.orchestra.run.smithi187.stdout:syncing data to disk ... ok 2023-06-09T11:10:29.957 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:29.957 INFO:teuthology.orchestra.run.smithi187.stdout:Success. You can now start the database server using: 2023-06-09T11:10:29.957 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:29.957 INFO:teuthology.orchestra.run.smithi187.stdout: pg_ctlcluster 12 main start 2023-06-09T11:10:29.958 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:30.541 INFO:teuthology.orchestra.run.smithi187.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-06-09T11:10:30.541 INFO:teuthology.orchestra.run.smithi187.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-06-09T11:10:30.748 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T11:10:33.794 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-09T11:10:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T11:10:34.409 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:10:34.535 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-09T11:10:34.703 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-06-09T11:10:34.829 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T11:10:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T11:10:35.054 DEBUG:teuthology.parallel:result is None 2023-06-09T11:10:35.982 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:35.983 INFO:teuthology.orchestra.run.smithi187.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T11:10:35.983 INFO:teuthology.orchestra.run.smithi187.stdout:which means they are currently configured by ifupdown: 2023-06-09T11:10:35.983 INFO:teuthology.orchestra.run.smithi187.stdout:- enp3s0f1 2023-06-09T11:10:35.983 INFO:teuthology.orchestra.run.smithi187.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T11:10:35.983 INFO:teuthology.orchestra.run.smithi187.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T11:10:35.983 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:36.214 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T11:10:36.769 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T11:10:37.706 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T11:10:38.649 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T11:10:38.783 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-09T11:10:38.951 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T11:10:39.086 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-06-09T11:10:39.212 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:10:39.338 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T11:10:39.473 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T11:10:39.792 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T11:10:39.793 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T11:10:40.750 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T11:10:40.885 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T11:10:41.044 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T11:10:41.546 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T11:10:52.258 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-09T11:10:52.366 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T11:10:53.577 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T11:10:53.581 DEBUG:teuthology.parallel:result is None 2023-06-09T11:10:53.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=034108821cde95ca1c56d458dfccc7ef9e0d964d 2023-06-09T11:10:53.870 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2023-06-09T11:10:53.913 INFO:teuthology.orchestra.run.smithi078.stdout:18.0.0-3924-g03410882-1focal 2023-06-09T11:10:53.914 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3924-g03410882-1focal 2023-06-09T11:10:53.914 INFO:teuthology.task.install:The correct ceph version 18.0.0-3924-g03410882-1focal is installed. 2023-06-09T11:10:53.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=034108821cde95ca1c56d458dfccc7ef9e0d964d 2023-06-09T11:10:54.054 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-query -W -f '${Version}' ceph 2023-06-09T11:10:54.090 INFO:teuthology.orchestra.run.smithi187.stdout:18.0.0-3924-g03410882-1focal 2023-06-09T11:10:54.091 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3924-g03410882-1focal 2023-06-09T11:10:54.091 INFO:teuthology.task.install:The correct ceph version 18.0.0-3924-g03410882-1focal is installed. 2023-06-09T11:10:54.092 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-09T11:10:54.093 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:54.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T11:10:54.132 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:54.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T11:10:54.174 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-09T11:10:54.175 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:54.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T11:10:54.213 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T11:10:54.288 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:54.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T11:10:54.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T11:10:54.402 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-09T11:10:54.403 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:54.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T11:10:54.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T11:10:54.508 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:54.509 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T11:10:54.542 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T11:10:54.621 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-09T11:10:54.622 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:54.622 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T11:10:54.658 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T11:10:54.733 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:54.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T11:10:54.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T11:10:54.845 INFO:teuthology.run_tasks:Running task ceph... 2023-06-09T11:10:54.941 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-09T11:10:54.942 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-06-09T11:10:54.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2023-06-09T11:10:54.982 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-09T11:10:54.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T11:10:55.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T11:10:55.058 INFO:tasks.ceph:Creating extra log directories... 2023-06-09T11:10:55.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T11:10:55.099 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T11:10:55.146 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-09T11:10:55.147 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-09T11:10:55.147 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-09T11:10:55.147 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:55.148 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T11:10:55.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:55.321 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:55.322 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T11:10:55.343 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:55.479 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-09T11:10:55.479 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-09T11:10:55.480 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879', 'branch': 'wip-rishabh-2023Jun9-1308', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7299879', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '10b2f20a4f46c803bb730efc73498f97d45082e7'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jun9-1308'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jun9-1308', 'sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jun9-1308', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', 'smithi187.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '10b2f20a4f46c803bb730efc73498f97d45082e7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '034108821cde95ca1c56d458dfccc7ef9e0d964d'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-09_10:19:22', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-09T11:10:55.482 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T11:10:55.489 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T11:10:55.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T11:10:55.551 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T11:10:55.588 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:55.588 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T11:10:55.638 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T11:10:55.639 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-06-09T11:10:55.699 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T11:10:55.699 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:55.700 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-06-09T11:10:55.700 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:55.700 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-09 11:05:10.924926288 +0000 2023-06-09T11:10:55.700 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-09 11:05:10.920926380 +0000 2023-06-09T11:10:55.700 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-09 11:05:10.920926380 +0000 2023-06-09T11:10:55.700 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-09T11:10:55.701 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T11:10:55.780 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-09T11:10:55.781 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-09T11:10:55.781 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000647876 s, 790 kB/s 2023-06-09T11:10:55.781 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T11:10:55.851 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-06-09T11:10:55.911 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T11:10:55.911 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:55.911 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-06-09T11:10:55.911 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:55.912 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-09 11:05:12.276895140 +0000 2023-06-09T11:10:55.912 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-09 11:05:11.740907488 +0000 2023-06-09T11:10:55.912 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-09 11:05:11.740907488 +0000 2023-06-09T11:10:55.912 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-09T11:10:55.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T11:10:55.984 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-09T11:10:55.984 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-09T11:10:55.984 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000682227 s, 750 kB/s 2023-06-09T11:10:55.991 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T11:10:56.056 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-06-09T11:10:56.114 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T11:10:56.114 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:56.114 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-06-09T11:10:56.115 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:56.115 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-09 11:05:12.556888688 +0000 2023-06-09T11:10:56.115 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-09 11:05:12.552888781 +0000 2023-06-09T11:10:56.115 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-09 11:05:12.552888781 +0000 2023-06-09T11:10:56.115 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-09T11:10:56.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T11:10:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-09T11:10:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-09T11:10:56.188 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000673709 s, 760 kB/s 2023-06-09T11:10:56.189 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T11:10:56.256 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-06-09T11:10:56.318 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T11:10:56.318 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:56.319 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 518 Links: 1 2023-06-09T11:10:56.319 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:56.319 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-09 11:05:13.804775542 +0000 2023-06-09T11:10:56.319 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-09 11:05:13.320837513 +0000 2023-06-09T11:10:56.319 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-09 11:05:13.320837513 +0000 2023-06-09T11:10:56.319 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-09T11:10:56.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T11:10:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-09T11:10:56.397 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-09T11:10:56.398 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000532682 s, 961 kB/s 2023-06-09T11:10:56.398 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T11:10:56.470 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T11:10:56.471 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:56.473 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T11:10:56.492 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T11:10:56.492 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-06-09T11:10:56.552 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T11:10:56.553 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:56.553 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 499 Links: 1 2023-06-09T11:10:56.553 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:56.553 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-06-09 11:05:10.789478051 +0000 2023-06-09T11:10:56.553 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-06-09 11:05:10.297489395 +0000 2023-06-09T11:10:56.553 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-06-09 11:05:10.297489395 +0000 2023-06-09T11:10:56.554 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-06-09T11:10:56.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T11:10:56.624 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-06-09T11:10:56.625 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-06-09T11:10:56.625 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000691885 s, 740 kB/s 2023-06-09T11:10:56.627 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T11:10:56.694 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-06-09T11:10:56.756 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T11:10:56.757 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:56.757 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-06-09T11:10:56.757 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:56.757 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-06-09 11:05:11.581459785 +0000 2023-06-09T11:10:56.757 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-06-09 11:05:11.073471501 +0000 2023-06-09T11:10:56.757 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-06-09 11:05:11.073471501 +0000 2023-06-09T11:10:56.758 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-06-09T11:10:56.758 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T11:10:56.832 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-06-09T11:10:56.833 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-06-09T11:10:56.833 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000598383 s, 856 kB/s 2023-06-09T11:10:56.834 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T11:10:56.905 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-06-09T11:10:56.964 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T11:10:56.964 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:56.965 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-06-09T11:10:56.965 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:56.965 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-06-09 11:05:12.341442259 +0000 2023-06-09T11:10:56.965 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-06-09 11:05:11.849453606 +0000 2023-06-09T11:10:56.965 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-06-09 11:05:11.849453606 +0000 2023-06-09T11:10:56.965 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-06-09T11:10:56.966 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T11:10:57.036 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-06-09T11:10:57.036 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-06-09T11:10:57.037 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000712217 s, 719 kB/s 2023-06-09T11:10:57.038 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T11:10:57.110 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-06-09T11:10:57.171 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T11:10:57.171 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T11:10:57.172 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-06-09T11:10:57.172 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T11:10:57.172 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-06-09 11:05:13.121424272 +0000 2023-06-09T11:10:57.172 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-06-09 11:05:12.645435249 +0000 2023-06-09T11:10:57.172 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-06-09 11:05:12.645435249 +0000 2023-06-09T11:10:57.172 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-06-09T11:10:57.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T11:10:57.244 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-06-09T11:10:57.244 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-06-09T11:10:57.245 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000678627 s, 754 kB/s 2023-06-09T11:10:57.246 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T11:10:57.315 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T11:10:57.315 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T11:10:57.315 INFO:tasks.ceph:Generating config... 2023-06-09T11:10:57.316 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-09T11:10:57.317 INFO:tasks.ceph:[client] debug client = 20 2023-06-09T11:10:57.317 INFO:tasks.ceph:[client] debug ms = 1 2023-06-09T11:10:57.317 INFO:tasks.ceph:[client] pid file = 2023-06-09T11:10:57.317 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-09T11:10:57.318 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-09T11:10:57.318 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-09T11:10:57.318 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-09T11:10:57.318 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-09T11:10:57.318 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-09T11:10:57.319 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-09T11:10:57.319 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-09T11:10:57.319 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-09T11:10:57.319 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-09T11:10:57.319 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-09T11:10:57.320 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-09T11:10:57.320 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-09T11:10:57.320 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-09T11:10:57.320 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-09T11:10:57.320 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-09T11:10:57.321 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-09T11:10:57.321 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-09T11:10:57.322 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-09T11:10:57.322 INFO:tasks.ceph:[osd] bdev async discard = True 2023-06-09T11:10:57.323 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-06-09T11:10:57.323 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-06-09T11:10:57.323 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-09T11:10:57.323 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-09T11:10:57.323 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-06-09T11:10:57.324 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-06-09T11:10:57.324 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-09T11:10:57.324 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-09T11:10:57.324 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-06-09T11:10:57.325 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-09T11:10:57.325 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-09T11:10:57.325 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-09T11:10:57.325 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-09T11:10:57.326 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-09T11:10:57.326 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-09T11:10:57.326 INFO:tasks.ceph:Setting up mon.a... 2023-06-09T11:10:57.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-09T11:10:57.401 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2023-06-09T11:10:57.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-09T11:10:57.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T11:10:57.535 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2023-06-09T11:10:57.535 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-09T11:10:57.536 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:57.537 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T11:10:57.595 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:10:57.707 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:10:57.708 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid a733ef11-cd5d-4be5-8773-23eabcf05e48 2023-06-09T11:10:57.708 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = pacific 2023-06-09T11:10:57.708 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2023-06-09T11:10:57.708 INFO:teuthology.orchestra.run.smithi078.stdout:fsid a733ef11-cd5d-4be5-8773-23eabcf05e48 2023-06-09T11:10:57.708 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2023-06-09T11:10:57.703672+0000 2023-06-09T11:10:57.709 INFO:teuthology.orchestra.run.smithi078.stdout:created 2023-06-09T11:10:57.703672+0000 2023-06-09T11:10:57.709 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 16 (pacific) 2023-06-09T11:10:57.709 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2023-06-09T11:10:57.709 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2023-06-09T11:10:57.709 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2023-06-09T11:10:57.709 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2023-06-09T11:10:57.709 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-09T11:10:57.711 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T11:10:57.729 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a733ef11-cd5d-4be5-8773-23eabcf05e48... 2023-06-09T11:10:57.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T11:10:57.783 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T11:10:57.851 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-06-09T11:10:57.852 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-06-09T11:10:57.852 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T11:10:57.852 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-06-09T11:10:57.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.853 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-06-09T11:10:57.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.853 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-06-09T11:10:57.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.853 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-06-09T11:10:57.853 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-06-09T11:10:57.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.854 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-06-09T11:10:57.854 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-06-09T11:10:57.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.854 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T11:10:57.854 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-06-09T11:10:57.855 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-06-09T11:10:57.856 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-06-09T11:10:57.856 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-06-09T11:10:57.856 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-06-09T11:10:57.856 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-06-09T11:10:57.856 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-06-09T11:10:57.856 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.857 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-06-09T11:10:57.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.858 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-06-09T11:10:57.858 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-06-09T11:10:57.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-06-09T11:10:57.859 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-06-09T11:10:57.859 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2023-06-09T11:10:57.859 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = a733ef11-cd5d-4be5-8773-23eabcf05e48 2023-06-09T11:10:57.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.859 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-06-09T11:10:57.860 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-06-09T11:10:57.860 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.860 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-06-09T11:10:57.860 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-06-09T11:10:57.860 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.860 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-06-09T11:10:57.860 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-06-09T11:10:57.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.861 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-06-09T11:10:57.861 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-06-09T11:10:57.861 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-06-09T11:10:57.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.861 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-06-09T11:10:57.861 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-06-09T11:10:57.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.862 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-06-09T11:10:57.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.862 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-06-09T11:10:57.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.862 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-06-09T11:10:57.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2023-06-09T11:10:57.863 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2023-06-09T11:10:57.864 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-06-09T11:10:57.864 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-06-09T11:10:57.864 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2023-06-09T11:10:57.864 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2023-06-09T11:10:57.864 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-09T11:10:57.864 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-06-09T11:10:57.864 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2023-06-09T11:10:57.865 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T11:10:57.865 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-06-09T11:10:57.865 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-06-09T11:10:57.865 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-06-09T11:10:57.865 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-06-09T11:10:57.865 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-06-09T11:10:57.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.866 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-06-09T11:10:57.866 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-09T11:10:57.866 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-06-09T11:10:57.866 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-06-09T11:10:57.866 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-06-09T11:10:57.866 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-06-09T11:10:57.866 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-06-09T11:10:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-06-09T11:10:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.867 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-06-09T11:10:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-09T11:10:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-06-09T11:10:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-06-09T11:10:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.868 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T11:10:57.869 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T11:10:57.869 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T11:10:57.869 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.870 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T11:10:57.870 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T11:10:57.870 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T11:10:57.870 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.870 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-06-09T11:10:57.871 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-06-09T11:10:57.872 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-06-09T11:10:57.872 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T11:10:57.872 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T11:10:57.872 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2023-06-09T11:10:57.872 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-06-09T11:10:57.872 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-09T11:10:57.872 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = "" 2023-06-09T11:10:57.873 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-06-09T11:10:57.873 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-06-09T11:10:57.873 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-06-09T11:10:57.873 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-06-09T11:10:57.873 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-06-09T11:10:57.873 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-06-09T11:10:57.873 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-06-09T11:10:57.874 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-06-09T11:10:57.874 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-06-09T11:10:57.874 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2023-06-09T11:10:57.874 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2023-06-09T11:10:57.874 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2023-06-09T11:10:57.874 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-09T11:10:57.874 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2023-06-09T11:10:57.875 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2023-06-09T11:10:57.875 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2023-06-09T11:10:57.875 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2023-06-09T11:10:57.875 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-06-09T11:10:57.876 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-06-09T11:10:57.876 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-06-09T11:10:57.877 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2023-06-09T11:10:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2023-06-09T11:10:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T11:10:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2023-06-09T11:10:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.878 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2023-06-09T11:10:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.879 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2023-06-09T11:10:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2023-06-09T11:10:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2023-06-09T11:10:57.880 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2023-06-09T11:10:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2023-06-09T11:10:57.881 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T11:10:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2023-06-09T11:10:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.882 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T11:10:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T11:10:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.883 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2023-06-09T11:10:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2023-06-09T11:10:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2023-06-09T11:10:57.884 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2023-06-09T11:10:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2023-06-09T11:10:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2023-06-09T11:10:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2023-06-09T11:10:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2023-06-09T11:10:57.885 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T11:10:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T11:10:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2023-06-09T11:10:57.886 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T11:10:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.887 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2023-06-09T11:10:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2023-06-09T11:10:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.888 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2023-06-09T11:10:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2023-06-09T11:10:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2023-06-09T11:10:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.78,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-06-09T11:10:57.889 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on skipped message = False 2023-06-09T11:10:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = a733ef11-cd5d-4be5-8773-23eabcf05e48 2023-06-09T11:10:57.890 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.890 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2023-06-09T11:10:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2023-06-09T11:10:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2023-06-09T11:10:57.891 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2023-06-09T11:10:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2023-06-09T11:10:57.892 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2023-06-09T11:10:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2023-06-09T11:10:57.893 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2023-06-09T11:10:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2023-06-09T11:10:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2023-06-09T11:10:57.894 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2023-06-09T11:10:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2023-06-09T11:10:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.895 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2023-06-09T11:10:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2023-06-09T11:10:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2023-06-09T11:10:57.896 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2023-06-09T11:10:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2023-06-09T11:10:57.897 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2023-06-09T11:10:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: bdev async discard = True 2023-06-09T11:10:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: bdev enable discard = True 2023-06-09T11:10:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore allocator = bitmap 2023-06-09T11:10:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2023-06-09T11:10:57.898 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2023-06-09T11:10:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 1/20 2023-06-09T11:10:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 1/20 2023-06-09T11:10:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-06-09T11:10:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2023-06-09T11:10:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 4/10 2023-06-09T11:10:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T11:10:57.899 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2023-06-09T11:10:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2023-06-09T11:10:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2023-06-09T11:10:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2023-06-09T11:10:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-06-09T11:10:57.900 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.900 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2023-06-09T11:10:57.901 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.902 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2023-06-09T11:10:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-06-09T11:10:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-06-09T11:10:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2023-06-09T11:10:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-06-09T11:10:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2023-06-09T11:10:57.902 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2023-06-09T11:10:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-06-09T11:10:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2023-06-09T11:10:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2023-06-09T11:10:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-06-09T11:10:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.903 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T11:10:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T11:10:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T11:10:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T11:10:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T11:10:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T11:10:57.904 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2023-06-09T11:10:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2023-06-09T11:10:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2023-06-09T11:10:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2023-06-09T11:10:57.905 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-09T11:10:57.905 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-06-09T11:10:57.906 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-06-09T11:10:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = "" 2023-06-09T11:10:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-06-09T11:10:57.907 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-06-09T11:10:57.907 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2023-06-09T11:10:57.907 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2023-06-09T11:10:57.908 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2023-06-09T11:10:57.908 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-06-09T11:10:57.908 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-06-09T11:10:57.908 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-06-09T11:10:57.908 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-06-09T11:10:57.909 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2023-06-09T11:10:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2023-06-09T11:10:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2023-06-09T11:10:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-06-09T11:10:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2023-06-09T11:10:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2023-06-09T11:10:57.909 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2023-06-09T11:10:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2023-06-09T11:10:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-06-09T11:10:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-06-09T11:10:57.910 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-06-09T11:10:57.912 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-09T11:10:57.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-09T11:10:58.001 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-09T11:10:58.001 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:58.002 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-09T11:10:58.017 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:58.018 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-09T11:10:58.077 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T11:10:58.077 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:58.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T11:10:58.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T11:10:58.180 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:10:58.181 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:10:58.246 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T11:10:58.247 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:58.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T11:10:58.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T11:10:58.310 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:10:58.311 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:10:58.370 INFO:tasks.ceph:Setting up mon nodes... 2023-06-09T11:10:58.370 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-09T11:10:58.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T11:10:58.474 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T11:10:58.486 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T11:10:58.583 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T11:10:58.597 INFO:tasks.ceph:Setting up mds nodes... 2023-06-09T11:10:58.597 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T11:10:58.697 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T11:10:58.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-09T11:10:58.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T11:10:58.881 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T11:10:58.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-09T11:10:58.919 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T11:10:59.020 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T11:10:59.027 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-09T11:10:59.061 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T11:10:59.200 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T11:10:59.208 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-09T11:10:59.241 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-09T11:10:59.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-09T11:10:59.322 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-09T11:10:59.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-09T11:10:59.424 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-09T11:10:59.452 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-09T11:10:59.526 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-09T11:10:59.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-09T11:10:59.628 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-09T11:10:59.654 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-09T11:10:59.655 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T11:10:59.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-09T11:10:59.692 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T11:10:59.693 INFO:tasks.ceph:role: osd.0 2023-06-09T11:10:59.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T11:10:59.693 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T11:11:00.290 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:00.290 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:00.290 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:00.291 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-06-09T11:11:00.291 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:00.291 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:00.291 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:00.291 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:00.291 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:00.291 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:00.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-09T11:11:00.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-09T11:11:00.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-09T11:11:00.468 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:00.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:00.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-09T11:11:00.549 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T11:11:00.550 INFO:tasks.ceph:role: osd.1 2023-06-09T11:11:00.550 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T11:11:00.550 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T11:11:01.066 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:01.067 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:01.067 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:01.067 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-06-09T11:11:01.067 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:01.067 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:01.067 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:01.067 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:01.068 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:01.068 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:01.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-09T11:11:01.071 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-09T11:11:01.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-09T11:11:01.155 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:01.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:01.157 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-09T11:11:01.233 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T11:11:01.234 INFO:tasks.ceph:role: osd.2 2023-06-09T11:11:01.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T11:11:01.235 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T11:11:01.790 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:01.791 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:01.791 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:01.791 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-06-09T11:11:01.792 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:01.792 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:01.792 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:01.792 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:01.792 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:01.793 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:01.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-09T11:11:01.798 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-09T11:11:01.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-09T11:11:01.926 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:01.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:01.928 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-09T11:11:02.004 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T11:11:02.004 INFO:tasks.ceph:role: osd.3 2023-06-09T11:11:02.004 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T11:11:02.005 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T11:11:02.607 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:02.608 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:02.608 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:02.608 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2023-06-09T11:11:02.608 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:02.608 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:02.608 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:02.609 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:02.609 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:02.609 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:02.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-09T11:11:02.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-09T11:11:02.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-09T11:11:02.747 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:02.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:02.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:02.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:02.910+0000 7f61bc8d1700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-09T11:11:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:02.910+0000 7f61bc8d1700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-09T11:11:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:02.910+0000 7f61bc8d1700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T11:11:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:02.910+0000 7f61bc8d1700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T11:11:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:02.910+0000 7f61bc8d1700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T11:11:02.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:02.914+0000 7f61bc8d1700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-09T11:11:06.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-09T11:11:06.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:06.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:06.382+0000 7f1aea641700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-09T11:11:06.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:06.386+0000 7f1aea641700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-09T11:11:06.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:06.386+0000 7f1aea641700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T11:11:06.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:06.386+0000 7f1aea641700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T11:11:06.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:06.386+0000 7f1aea641700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T11:11:06.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:06.390+0000 7f1aea641700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-09T11:11:09.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-09T11:11:09.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:09.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:09.610+0000 7f305addf700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-09T11:11:09.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:09.610+0000 7f305addf700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-09T11:11:09.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:09.610+0000 7f305addf700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T11:11:09.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:09.610+0000 7f305addf700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T11:11:09.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:09.610+0000 7f305addf700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T11:11:09.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:09.614+0000 7f305addf700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-09T11:11:12.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-09T11:11:12.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:12.850+0000 7fe3f4942700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-09T11:11:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:12.850+0000 7fe3f4942700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-09T11:11:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:12.850+0000 7fe3f4942700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T11:11:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:12.850+0000 7fe3f4942700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T11:11:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:12.850+0000 7fe3f4942700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T11:11:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:12.854+0000 7fe3f4942700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-09T11:11:15.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-09T11:11:15.949 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-09T11:11:15.985 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T11:11:15.986 INFO:tasks.ceph:role: osd.4 2023-06-09T11:11:15.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T11:11:15.986 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T11:11:16.557 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:16.557 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:16.557 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 2023-06-09T11:11:16.558 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:16.558 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:16.558 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:16.558 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:16.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-06-09T11:11:16.562 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-09T11:11:16.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-09T11:11:16.704 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:16.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:16.705 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-09T11:11:16.782 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T11:11:16.783 INFO:tasks.ceph:role: osd.5 2023-06-09T11:11:16.783 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T11:11:16.783 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T11:11:17.335 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:17.336 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:17.336 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:17.336 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 2023-06-09T11:11:17.336 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:17.336 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:17.336 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:17.337 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:17.337 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:17.337 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:17.341 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-06-09T11:11:17.341 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-09T11:11:17.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-09T11:11:17.433 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:17.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:17.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-09T11:11:17.512 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T11:11:17.512 INFO:tasks.ceph:role: osd.6 2023-06-09T11:11:17.513 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T11:11:17.513 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T11:11:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:18.081 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:18.081 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:18.081 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 2023-06-09T11:11:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:18.081 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:18.082 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:18.086 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-06-09T11:11:18.086 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-09T11:11:18.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-09T11:11:18.227 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:18.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:18.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-09T11:11:18.310 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T11:11:18.310 INFO:tasks.ceph:role: osd.7 2023-06-09T11:11:18.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T11:11:18.310 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T11:11:18.915 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T11:11:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T11:11:18.916 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T11:11:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 2023-06-09T11:11:18.917 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T11:11:18.917 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-06-09T11:11:18.917 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T11:11:18.918 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T11:11:18.918 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T11:11:18.918 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T11:11:18.920 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-06-09T11:11:18.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-09T11:11:19.411 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-09T11:11:19.433 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T11:11:19.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:11:19.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:19.588 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:19.579+0000 7f6a048a1700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-09T11:11:19.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:19.579+0000 7f6a048a1700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-09T11:11:19.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:19.579+0000 7f6a048a1700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T11:11:19.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:19.579+0000 7f6a048a1700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T11:11:19.589 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:19.579+0000 7f6a048a1700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T11:11:19.591 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:19.583+0000 7f6a048a1700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-09T11:11:22.666 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-09T11:11:22.700 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:22.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:22.815+0000 7f36b87e0700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-09T11:11:22.826 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:22.815+0000 7f36b87e0700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-09T11:11:22.826 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:22.815+0000 7f36b87e0700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T11:11:22.827 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:22.815+0000 7f36b87e0700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T11:11:22.827 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:22.815+0000 7f36b87e0700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T11:11:22.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:22.819+0000 7f36b87e0700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-09T11:11:25.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:25.494 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:25.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-09T11:11:25.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:26.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:26.043+0000 7f1926cec700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-09T11:11:26.054 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:26.043+0000 7f1926cec700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-09T11:11:26.054 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:26.043+0000 7f1926cec700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T11:11:26.054 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:26.043+0000 7f1926cec700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T11:11:26.054 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:26.043+0000 7f1926cec700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T11:11:26.055 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:26.047+0000 7f1926cec700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-09T11:11:29.116 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-09T11:11:29.150 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:29.279 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:29.270+0000 7f0588f9e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-09T11:11:29.280 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:29.270+0000 7f0588f9e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-09T11:11:29.280 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:29.270+0000 7f0588f9e700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T11:11:29.280 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:29.270+0000 7f0588f9e700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T11:11:29.280 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:29.270+0000 7f0588f9e700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T11:11:29.282 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:29.274+0000 7f0588f9e700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-09T11:11:32.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-09T11:11:32.387 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-09T11:11:32.387 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:32.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-09T11:11:32.421 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:32.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-09T11:11:32.497 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:32.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-09T11:11:32.577 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:32.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-09T11:11:32.650 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:32.650 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-09T11:11:32.730 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:32.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-09T11:11:32.808 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:32.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-09T11:11:32.881 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:32.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-09T11:11:32.915 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:32.916 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-09T11:11:32.990 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:32.991 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-09T11:11:33.063 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:33.063 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-09T11:11:33.139 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:33.139 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-09T11:11:33.216 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:33.216 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-09T11:11:33.291 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:33.292 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-09T11:11:33.367 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:33.367 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-09T11:11:33.386 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:33.387 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-09T11:11:33.446 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:33.446 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-09T11:11:33.465 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:33.465 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-09T11:11:33.523 INFO:tasks.ceph:Adding keys to all mons... 2023-06-09T11:11:33.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T11:11:33.531 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T11:11:33.574 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-06-09T11:11:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDCCINk8mUPHBAAdXrI2h9wptCvEzNFlePjPg== 2023-06-09T11:11:33.574 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-06-09T11:11:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDCCINkzS9VKRAAt4Bku4DtHWThoDQIHCViag== 2023-06-09T11:11:33.574 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-06-09T11:11:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDCCINkJOBNNBAAg+ZsKgRe+KNSoCtJJ7atsQ== 2023-06-09T11:11:33.575 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-06-09T11:11:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDGCINkoAd0NhAAZK3AQPRgux4V3wXwtw4mLw== 2023-06-09T11:11:33.575 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-06-09T11:11:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDKCINkLfYuFxAA1RiDeA2lJbaLgC6ujPOhYw== 2023-06-09T11:11:33.575 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-06-09T11:11:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDNCINkX4m1JBAANqOrYRikkt/g1dvgbK1zew== 2023-06-09T11:11:33.576 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-06-09T11:11:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDQCINkqMHmMhAADiVj1QQiexIlG/oI0lv4OA== 2023-06-09T11:11:33.576 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-06-09T11:11:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDCCINkaH16IhAAi5jlGqA1ZWGycmkDceB0yQ== 2023-06-09T11:11:33.576 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-06-09T11:11:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDDCINkNNnuABAAQgx5xb5v4s1u+ESTEAYvNA== 2023-06-09T11:11:33.576 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-06-09T11:11:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDDCINktpKtCxAA6yEGMsTCCpG6PDBODhGDog== 2023-06-09T11:11:33.577 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-06-09T11:11:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDXCINkIHW8IhAA4I1xPwaBL0+ycD6+ZFf+uQ== 2023-06-09T11:11:33.577 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-06-09T11:11:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDaCINkI8/gMBAAWv8ahOFYW2ii8++mNlTJkw== 2023-06-09T11:11:33.578 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-06-09T11:11:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDeCINk1TzRAhAA5HJEj3YkZ8NSnW1Oz9E6ug== 2023-06-09T11:11:33.578 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-06-09T11:11:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDhCINkohpOEBAAKwyp7oYRSVSu/YOb60KG8Q== 2023-06-09T11:11:33.579 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-06-09T11:11:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDDCINkLbj/EhAAlbgZ9OqO1RLR8Gbm9TvHDw== 2023-06-09T11:11:33.579 INFO:teuthology.orchestra.run.smithi078.stdout:[client.2] 2023-06-09T11:11:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDDCINkotUUGRAA5/JE0VY5wxUaIvZ0/ohqDg== 2023-06-09T11:11:33.579 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-06-09T11:11:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDDCINkSOwVHxAAsI+GS1SmhUCYwyTfDNSiqA== 2023-06-09T11:11:33.580 INFO:teuthology.orchestra.run.smithi078.stdout:[client.3] 2023-06-09T11:11:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDDCINkuJMeJRAA42MZyFPQo096ITv2Gn2hYQ== 2023-06-09T11:11:33.597 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2023-06-09T11:11:33.598 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDCCINk8mUPHBAAdXrI2h9wptCvEzNFlePjPg== 2023-06-09T11:11:33.598 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-06-09T11:11:33.598 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDCCINkzS9VKRAAt4Bku4DtHWThoDQIHCViag== 2023-06-09T11:11:33.599 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-06-09T11:11:33.599 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDCCINkJOBNNBAAg+ZsKgRe+KNSoCtJJ7atsQ== 2023-06-09T11:11:33.599 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2023-06-09T11:11:33.599 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDGCINkoAd0NhAAZK3AQPRgux4V3wXwtw4mLw== 2023-06-09T11:11:33.599 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2023-06-09T11:11:33.599 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDKCINkLfYuFxAA1RiDeA2lJbaLgC6ujPOhYw== 2023-06-09T11:11:33.599 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2023-06-09T11:11:33.600 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDNCINkX4m1JBAANqOrYRikkt/g1dvgbK1zew== 2023-06-09T11:11:33.600 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2023-06-09T11:11:33.600 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDQCINkqMHmMhAADiVj1QQiexIlG/oI0lv4OA== 2023-06-09T11:11:33.600 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2023-06-09T11:11:33.600 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDCCINkaH16IhAAi5jlGqA1ZWGycmkDceB0yQ== 2023-06-09T11:11:33.600 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-06-09T11:11:33.601 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDDCINkNNnuABAAQgx5xb5v4s1u+ESTEAYvNA== 2023-06-09T11:11:33.601 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-06-09T11:11:33.601 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDDCINktpKtCxAA6yEGMsTCCpG6PDBODhGDog== 2023-06-09T11:11:33.601 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2023-06-09T11:11:33.601 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDXCINkIHW8IhAA4I1xPwaBL0+ycD6+ZFf+uQ== 2023-06-09T11:11:33.601 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2023-06-09T11:11:33.601 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDaCINkI8/gMBAAWv8ahOFYW2ii8++mNlTJkw== 2023-06-09T11:11:33.602 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2023-06-09T11:11:33.603 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDeCINk1TzRAhAA5HJEj3YkZ8NSnW1Oz9E6ug== 2023-06-09T11:11:33.603 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2023-06-09T11:11:33.603 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDhCINkohpOEBAAKwyp7oYRSVSu/YOb60KG8Q== 2023-06-09T11:11:33.603 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-06-09T11:11:33.603 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDDCINkLbj/EhAAlbgZ9OqO1RLR8Gbm9TvHDw== 2023-06-09T11:11:33.603 INFO:teuthology.orchestra.run.smithi187.stdout:[client.2] 2023-06-09T11:11:33.603 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDDCINkotUUGRAA5/JE0VY5wxUaIvZ0/ohqDg== 2023-06-09T11:11:33.604 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-06-09T11:11:33.604 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDDCINkSOwVHxAAsI+GS1SmhUCYwyTfDNSiqA== 2023-06-09T11:11:33.604 INFO:teuthology.orchestra.run.smithi187.stdout:[client.3] 2023-06-09T11:11:33.604 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDDCINkuJMeJRAA42MZyFPQo096ITv2Gn2hYQ== 2023-06-09T11:11:33.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T11:11:33.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T11:11:33.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:33.737 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:33.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:33.830 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:33.914 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:33.921 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.001 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.006 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.096 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T11:11:34.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T11:11:34.346 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:34.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:34.435 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:34.442 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T11:11:34.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.533 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.621 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.798 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.805 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T11:11:34.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:34.896 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:34.982 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:34.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:35.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:35.082 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:35.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:35.174 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T11:11:35.259 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-09T11:11:35.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-09T11:11:35.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T11:11:35.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-09T11:11:35.472 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-09T11:11:35.506 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T11:11:35.653 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-09T11:11:35.687 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-09T11:11:35.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T11:11:35.911 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-09T11:11:35.944 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:35.952 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T11:11:36.003 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-09T11:11:36.004 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-09T11:11:36.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-09T11:11:36.016 INFO:tasks.ceph.mon.a:Started 2023-06-09T11:11:36.017 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-09T11:11:36.018 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-09T11:11:36.053 INFO:tasks.ceph.mon.b:Started 2023-06-09T11:11:36.053 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-09T11:11:36.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-09T11:11:36.058 INFO:tasks.ceph.mon.c:Started 2023-06-09T11:11:36.058 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-09T11:11:36.059 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-09T11:11:36.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-09T11:11:36.066 INFO:tasks.ceph.mgr.y:Started 2023-06-09T11:11:36.066 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-09T11:11:36.066 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-09T11:11:36.072 INFO:tasks.ceph.mgr.x:Started 2023-06-09T11:11:36.072 INFO:tasks.ceph:Setting crush tunables to default 2023-06-09T11:11:36.072 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2023-06-09T11:11:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.233+0000 7fd8d49ef700 1 Processor -- start 2023-06-09T11:11:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.233+0000 7fd8d49ef700 1 -- start start 2023-06-09T11:11:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.233+0000 7fd8d49ef700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:36.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.233+0000 7fd8d49ef700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d015d290 con 0x7fd8d00b2da0 2023-06-09T11:11:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.233+0000 7fd8d49ef700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d00ce820 con 0x7fd8d0156d50 2023-06-09T11:11:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.233+0000 7fd8d49ef700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0159760 con 0x7fd8d00ce3d0 2023-06-09T11:11:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.233+0000 7fd8ceffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.237+0000 7fd8ceffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:59004/0 (socket says 172.21.15.78:59004) 2023-06-09T11:11:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 learned_addr learned my addr 172.21.15.78:0/2136922794 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:11:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T11:11:36.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.441+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:36.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.441+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:36.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.441+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:36.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.441+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:36.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.441+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-09T11:11:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.845+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.845+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.845+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.845+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:36.845+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-09T11:11:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:37.649+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:37.649+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:37.649+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:37.649+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:37.649+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-09T11:11:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 msgr2=0x7fd8d015cd50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T11:11:39.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8d00ce3d0 0x7fd8d015cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 >> v1:172.21.15.187:6789/0 conn(0x7fd8d0156d50 legacy=0x7fd8d0159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 >> v1:172.21.15.78:6789/0 conn(0x7fd8d00b2da0 legacy=0x7fd8d00cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:39.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc00af70 con 0x7fd8bc005980 2023-06-09T11:11:39.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc00b0e0 con 0x7fd8bc008440 2023-06-09T11:11:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:39.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:39.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:39.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:39.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:39.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T11:11:39.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:39.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:39.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T11:11:39.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T11:11:39.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:39.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:39.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T11:11:39.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-09T11:11:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:39.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.441+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-09T11:11:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:39.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T11:11:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-09T11:11:39.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:39.845+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-09T11:11:40.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T11:11:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-09T11:11:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T11:11:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T11:11:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T11:11:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:40.649+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-09T11:11:41.675 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:41.666+0000 7fb4693c22c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T11:11:42.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.233+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 msgr2=0x7fd8bc00a8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T11:11:42.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.233+0000 7fd8cd7fa700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008440 0x7fd8bc00a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 msgr2=0x7fd8bc007df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T11:11:42.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cd7fa700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005980 0x7fd8bc007df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cffff700 1 -- 172.21.15.78:0/2136922794 reap_dead start 2023-06-09T11:11:42.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cd7fa700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005de0 0x7fd8bc0088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:42.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cd7fa700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008e20 0x7fd8bc0092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:42.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d015d4c0 con 0x7fd8d00b2da0 2023-06-09T11:11:42.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc00af70 con 0x7fd8bc005de0 2023-06-09T11:11:42.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cd7fa700 1 -- 172.21.15.78:0/2136922794 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc00b0e0 con 0x7fd8bc008e20 2023-06-09T11:11:42.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.78:3300/0 conn(0x7fd8bc005de0 0x7fd8bc0088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8cffff700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008e20 0x7fd8bc0092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008e20 msgr2=0x7fd8bc0092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008e20 0x7fd8bc0092a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 >> v1:172.21.15.78:6789/0 conn(0x7fd8d00b2da0 legacy=0x7fd8bc00d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ceffd700 1 -- 172.21.15.78:0/2136922794 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc00a920 con 0x7fd8bc005de0 2023-06-09T11:11:42.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8bc005de0 0x7fd8bc0088e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc008260 tx=0x7fd8c4016d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a43b4563cdac119 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ce7fc700 1 -- 172.21.15.78:0/2136922794 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c401e070 con 0x7fd8bc005de0 2023-06-09T11:11:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ce7fc700 1 -- 172.21.15.78:0/2136922794 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c400c040 con 0x7fd8bc005de0 2023-06-09T11:11:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.237+0000 7fd8ce7fc700 1 -- 172.21.15.78:0/2136922794 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4019ae0 con 0x7fd8bc005de0 2023-06-09T11:11:42.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 -- 172.21.15.78:0/2136922794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8bc005de0 msgr2=0x7fd8bc0088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8bc005de0 0x7fd8bc0088e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc008260 tx=0x7fd8c4016d50 comp rx=0 tx=0).stop 2023-06-09T11:11:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 -- 172.21.15.78:0/2136922794 shutdown_connections 2023-06-09T11:11:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 --2- 172.21.15.78:0/2136922794 >> v2:172.21.15.187:3300/0 conn(0x7fd8bc008e20 0x7fd8bc0092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 --2- 172.21.15.78:0/2136922794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8bc005de0 0x7fd8bc0088e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 -- 172.21.15.78:0/2136922794 >> 172.21.15.78:0/2136922794 conn(0x7fd8d00b0780 msgr2=0x7fd8d00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 -- 172.21.15.78:0/2136922794 shutdown_connections 2023-06-09T11:11:42.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.241+0000 7fd8d49ef700 1 -- 172.21.15.78:0/2136922794 wait complete. 2023-06-09T11:11:42.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 Processor -- start 2023-06-09T11:11:42.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 -- start start 2023-06-09T11:11:42.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8bc005de0 0x7fd8d0149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:42.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8bc008e20 0x7fd8d014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:42.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d00b2da0 0x7fd8d015b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:42.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d014a080 con 0x7fd8d00b2da0 2023-06-09T11:11:42.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d014cfd0 con 0x7fd8bc008e20 2023-06-09T11:11:42.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.245+0000 7fd8d49ef700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d014b9f0 con 0x7fd8bc005de0 2023-06-09T11:11:42.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8bc005de0 0x7fd8d0149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:42.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8bc005de0 0x7fd8d0149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:59096/0 (socket says 172.21.15.78:59096) 2023-06-09T11:11:42.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/4293817647 learned_addr learned my addr 172.21.15.78:0/4293817647 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:11:42.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8ceffd700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8bc008e20 0x7fd8d014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:42.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cffff700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d00b2da0 0x7fd8d015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:42.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8bc008e20 msgr2=0x7fd8d014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:42.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8bc008e20 0x7fd8d014ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/4293817647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d00b2da0 msgr2=0x7fd8d015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:42.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d00b2da0 0x7fd8d015b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 -- 172.21.15.78:0/4293817647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c400e040 con 0x7fd8bc005de0 2023-06-09T11:11:42.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8cf7fe700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8bc005de0 0x7fd8d0149b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00056d0 tx=0x7fd8c00059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:42.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8b7fff700 1 -- 172.21.15.78:0/4293817647 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00139a0 con 0x7fd8bc005de0 2023-06-09T11:11:42.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8b7fff700 1 -- 172.21.15.78:0/4293817647 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c0013b00 con 0x7fd8bc005de0 2023-06-09T11:11:42.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d015da80 con 0x7fd8bc005de0 2023-06-09T11:11:42.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d015d7a0 con 0x7fd8bc005de0 2023-06-09T11:11:42.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8b7fff700 1 -- 172.21.15.78:0/4293817647 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0013e70 con 0x7fd8bc005de0 2023-06-09T11:11:42.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8b7fff700 1 -- 172.21.15.78:0/4293817647 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd8c0016450 con 0x7fd8bc005de0 2023-06-09T11:11:42.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8b7fff700 1 -- 172.21.15.78:0/4293817647 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd8c001f720 con 0x7fd8bc005de0 2023-06-09T11:11:42.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.249+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d0159950 con 0x7fd8bc005de0 2023-06-09T11:11:42.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.257+0000 7fd8b7fff700 1 -- 172.21.15.78:0/4293817647 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd8c003db10 con 0x7fd8bc005de0 2023-06-09T11:11:42.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.325+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd8d0067610 con 0x7fd8bc005de0 2023-06-09T11:11:42.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8b7fff700 1 -- 172.21.15.78:0/4293817647 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd8c002c070 con 0x7fd8bc005de0 2023-06-09T11:11:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8bc005de0 msgr2=0x7fd8d0149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8bc005de0 0x7fd8d0149b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00056d0 tx=0x7fd8c00059e0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 shutdown_connections 2023-06-09T11:11:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d00b2da0 0x7fd8d015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8bc008e20 0x7fd8d014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 --2- 172.21.15.78:0/4293817647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8bc005de0 0x7fd8d0149b40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:42.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 >> 172.21.15.78:0/4293817647 conn(0x7fd8d00b0780 msgr2=0x7fd8d00b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 shutdown_connections 2023-06-09T11:11:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:42.337+0000 7fd8d49ef700 1 -- 172.21.15.78:0/4293817647 wait complete. 2023-06-09T11:11:42.349 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2023-06-09T11:11:42.362 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:42.350+0000 7fb4693c22c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T11:11:42.366 INFO:tasks.ceph:check_enable_crimson: False 2023-06-09T11:11:42.366 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-09T11:11:42.367 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:42.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-09T11:11:42.394 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:42.394 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-09T11:11:42.441 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:42.430+0000 7fb4693c22c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T11:11:42.467 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:42.468 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-09T11:11:42.540 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:11:42.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-09T11:11:42.588 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:42.573+0000 7f89c57022c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T11:11:42.612 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:42.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-09T11:11:42.621 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:42.610+0000 7fb4693c22c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T11:11:42.642 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:42.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-09T11:11:42.712 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:42.713 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-09T11:11:42.786 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:11:42.786 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-09T11:11:42.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 49233b9f-5c75-4539-964b-c60157693d28 0 2023-06-09T11:11:42.880 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:42.870+0000 7fb4693c22c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T11:11:42.955 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:42.946+0000 7fb4693c22c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T11:11:43.040 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.030+0000 7f28b0c4f700 1 Processor -- start 2023-06-09T11:11:43.041 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.030+0000 7f28b0c4f700 1 -- start start 2023-06-09T11:11:43.043 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.030+0000 7f28b0c4f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28ac0ce770 0x7f28ac0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.043 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac06fc60 con 0x7f28ac15c8a0 2023-06-09T11:11:43.043 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac06ff40 con 0x7f28ac06ed40 2023-06-09T11:11:43.043 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac06e1d0 con 0x7f28ac0ce770 2023-06-09T11:11:43.045 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28abfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28ac0ce770 0x7f28ac0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.045 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28ab7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f28ac15c8a0 0x7f28ac070d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.187:33150/0 (socket says 172.21.15.187:33150) 2023-06-09T11:11:43.045 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28ab7fe700 1 -- 172.21.15.187:0/1677722834 learned_addr learned my addr 172.21.15.187:0/1677722834 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-06-09T11:11:43.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28aaffd700 1 --1- 172.21.15.187:0/1677722834 >> v1:172.21.15.187:6789/0 conn(0x7f28ac06ed40 0x7f28ac0ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45904/0 (socket says 172.21.15.187:45904) 2023-06-09T11:11:43.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28abfff700 1 -- 172.21.15.187:0/1677722834 >> v1:172.21.15.187:6789/0 conn(0x7f28ac06ed40 legacy=0x7f28ac0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28aa7fc700 1 -- 172.21.15.187:0/1677722834 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436776207 0 0) 0x7f28ac06fc60 con 0x7f28ac15c8a0 2023-06-09T11:11:43.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28abfff700 1 -- 172.21.15.187:0/1677722834 >> v1:172.21.15.78:6789/0 conn(0x7f28ac15c8a0 legacy=0x7f28ac070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.047 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28abfff700 1 -- 172.21.15.187:0/1677722834 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac070220 con 0x7f28ac0ce770 2023-06-09T11:11:43.047 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28abfff700 1 --2- 172.21.15.187:0/1677722834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b3290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009d90 tx=0x7f28a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c5ebe5b4ef4495 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.049 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28aa7fc700 1 -- 172.21.15.187:0/1677722834 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400e070 con 0x7f28ac0ce770 2023-06-09T11:11:43.049 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28aa7fc700 1 -- 172.21.15.187:0/1677722834 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400bad0 con 0x7f28ac0ce770 2023-06-09T11:11:43.049 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28aa7fc700 1 -- 172.21.15.187:0/1677722834 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400be80 con 0x7f28ac0ce770 2023-06-09T11:11:43.049 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- 172.21.15.187:0/1677722834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac0ce770 msgr2=0x7f28ac0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.050 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 --2- 172.21.15.187:0/1677722834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b3290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009d90 tx=0x7f28a400b330 comp rx=0 tx=0).stop 2023-06-09T11:11:43.050 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- 172.21.15.187:0/1677722834 shutdown_connections 2023-06-09T11:11:43.050 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 --2- 172.21.15.187:0/1677722834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b3290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.050 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- 172.21.15.187:0/1677722834 >> 172.21.15.187:0/1677722834 conn(0x7f28ac0cf810 msgr2=0x7f28ac0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:43.050 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- 172.21.15.187:0/1677722834 shutdown_connections 2023-06-09T11:11:43.050 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.034+0000 7f28b0c4f700 1 -- 172.21.15.187:0/1677722834 wait complete. 2023-06-09T11:11:43.051 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.038+0000 7f28b0c4f700 1 Processor -- start 2023-06-09T11:11:43.052 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.038+0000 7f28b0c4f700 1 -- start start 2023-06-09T11:11:43.052 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ac06ed40 0x7f28ac14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.052 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac15c8a0 0x7f28ac0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0b7460 con 0x7f28ac0ce770 2023-06-09T11:11:43.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0b7740 con 0x7f28ac15c8a0 2023-06-09T11:11:43.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0b7a20 con 0x7f28ac06ed40 2023-06-09T11:11:43.056 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac15c8a0 0x7f28ac0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.057 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac15c8a0 0x7f28ac0b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53518/0 (socket says 172.21.15.187:53518) 2023-06-09T11:11:43.057 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 -- 172.21.15.187:0/3780661365 learned_addr learned my addr 172.21.15.187:0/3780661365 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:43.057 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28ab7fe700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ac06ed40 0x7f28ac14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.057 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28aaffd700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.058 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 -- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ac06ed40 msgr2=0x7f28ac14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.058 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ac06ed40 0x7f28ac14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.058 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 -- 172.21.15.187:0/3780661365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ac0ce770 msgr2=0x7f28ac0b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.058 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.058 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 -- 172.21.15.187:0/3780661365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4009a70 con 0x7f28ac15c8a0 2023-06-09T11:11:43.059 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28ab7fe700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ac06ed40 0x7f28ac14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:11:43.059 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28aaffd700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:11:43.059 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28abfff700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac15c8a0 0x7f28ac0b42a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28a4004000 tx=0x7f28a4004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.060 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f2893fff700 1 -- 172.21.15.187:0/3780661365 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4012630 con 0x7f28ac15c8a0 2023-06-09T11:11:43.060 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f2893fff700 1 -- 172.21.15.187:0/3780661365 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4012790 con 0x7f28ac15c8a0 2023-06-09T11:11:43.060 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f2893fff700 1 -- 172.21.15.187:0/3780661365 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4012b40 con 0x7f28ac15c8a0 2023-06-09T11:11:43.060 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac0707e0 con 0x7f28ac15c8a0 2023-06-09T11:11:43.061 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.042+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac070500 con 0x7f28ac15c8a0 2023-06-09T11:11:43.061 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.046+0000 7f2893fff700 1 -- 172.21.15.187:0/3780661365 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28a401c410 con 0x7f28ac15c8a0 2023-06-09T11:11:43.061 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.046+0000 7f2893fff700 1 -- 172.21.15.187:0/3780661365 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f28a4024850 con 0x7f28ac15c8a0 2023-06-09T11:11:43.061 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.046+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac06f880 con 0x7f28ac15c8a0 2023-06-09T11:11:43.062 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.050+0000 7f2893fff700 1 -- 172.21.15.187:0/3780661365 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f28a4029060 con 0x7f28ac15c8a0 2023-06-09T11:11:43.139 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.130+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49233b9f-5c75-4539-964b-c60157693d28", "id": 0} v 0) v1 -- 0x7f28ac067610 con 0x7f28ac15c8a0 2023-06-09T11:11:43.149 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.138+0000 7f2893fff700 1 -- 172.21.15.187:0/3780661365 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49233b9f-5c75-4539-964b-c60157693d28", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28a4024a10 con 0x7f28ac15c8a0 2023-06-09T11:11:43.149 INFO:teuthology.orchestra.run.smithi187.stdout:0 2023-06-09T11:11:43.151 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.138+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac15c8a0 msgr2=0x7f28ac0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.151 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.138+0000 7f28b0c4f700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac15c8a0 0x7f28ac0b42a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28a4004000 tx=0x7f28a4004af0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.151 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.142+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 shutdown_connections 2023-06-09T11:11:43.151 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.142+0000 7f28b0c4f700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ac15c8a0 0x7f28ac0b42a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.151 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.142+0000 7f28b0c4f700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28ac0ce770 0x7f28ac0b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.151 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.142+0000 7f28b0c4f700 1 --2- 172.21.15.187:0/3780661365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ac06ed40 0x7f28ac14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.151 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.142+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 >> 172.21.15.187:0/3780661365 conn(0x7f28ac0cf810 msgr2=0x7f28ac0cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:43.152 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.142+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 shutdown_connections 2023-06-09T11:11:43.152 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.142+0000 7f28b0c4f700 1 -- 172.21.15.187:0/3780661365 wait complete. 2023-06-09T11:11:43.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 6a598b89-7602-426f-b6b1-605d49b36c2a 1 2023-06-09T11:11:43.193 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:43.182+0000 7fb4693c22c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T11:11:43.282 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:43.270+0000 7fb4693c22c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T11:11:43.284 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:43.273+0000 7f89c57022c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T11:11:43.327 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f18929bf700 1 Processor -- start 2023-06-09T11:11:43.327 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f18929bf700 1 -- start start 2023-06-09T11:11:43.330 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f18929bf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0b2860 0x7f188c15d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.330 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f18929bf700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f188c0ce9b0 0x7f188c160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.331 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f18929bf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c15cef0 con 0x7f188c0b2c30 2023-06-09T11:11:43.331 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f18929bf700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c161320 con 0x7f188c0ce9b0 2023-06-09T11:11:43.331 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f18929bf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c15cc30 con 0x7f188c0b2860 2023-06-09T11:11:43.331 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f188bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0b2860 0x7f188c15d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.331 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f188b7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f188c0ce9b0 0x7f188c160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.331 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f1890f5c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f188c0b2c30 0x7f188c15e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45920/0 (socket says 172.21.15.187:45920) 2023-06-09T11:11:43.331 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.318+0000 7f1890f5c700 1 -- 172.21.15.187:0/1040715502 learned_addr learned my addr 172.21.15.187:0/1040715502 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-06-09T11:11:43.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188bfff700 1 -- 172.21.15.187:0/1040715502 >> v2:172.21.15.187:3300/0 conn(0x7f188c0ce9b0 msgr2=0x7f188c160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:43.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188bfff700 1 --2- 172.21.15.187:0/1040715502 >> v2:172.21.15.187:3300/0 conn(0x7f188c0ce9b0 0x7f188c160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188affd700 1 -- 172.21.15.187:0/1040715502 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583995112 0 0) 0x7f188c15cef0 con 0x7f188c0b2c30 2023-06-09T11:11:43.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188bfff700 1 -- 172.21.15.187:0/1040715502 >> v1:172.21.15.187:6789/0 conn(0x7f188c0b2c30 legacy=0x7f188c15e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188bfff700 1 -- 172.21.15.187:0/1040715502 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c0cef30 con 0x7f188c0b2860 2023-06-09T11:11:43.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188bfff700 1 --2- 172.21.15.187:0/1040715502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0b2860 0x7f188c15d990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f187c009840 tx=0x7f187c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d293f502952882b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188affd700 1 -- 172.21.15.187:0/1040715502 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c011830 con 0x7f188c0b2860 2023-06-09T11:11:43.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188affd700 1 -- 172.21.15.187:0/1040715502 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c011990 con 0x7f188c0b2860 2023-06-09T11:11:43.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f188affd700 1 -- 172.21.15.187:0/1040715502 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c011d20 con 0x7f188c0b2860 2023-06-09T11:11:43.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 -- 172.21.15.187:0/1040715502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0b2860 msgr2=0x7f188c15d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 --2- 172.21.15.187:0/1040715502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0b2860 0x7f188c15d990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f187c009840 tx=0x7f187c009b50 comp rx=0 tx=0).stop 2023-06-09T11:11:43.334 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 -- 172.21.15.187:0/1040715502 shutdown_connections 2023-06-09T11:11:43.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 --2- 172.21.15.187:0/1040715502 >> v2:172.21.15.187:3300/0 conn(0x7f188c0ce9b0 0x7f188c160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 --2- 172.21.15.187:0/1040715502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0b2860 0x7f188c15d990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 -- 172.21.15.187:0/1040715502 >> 172.21.15.187:0/1040715502 conn(0x7f188c0cd860 msgr2=0x7f188c0cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:43.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 -- 172.21.15.187:0/1040715502 shutdown_connections 2023-06-09T11:11:43.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.322+0000 7f18929bf700 1 -- 172.21.15.187:0/1040715502 wait complete. 2023-06-09T11:11:43.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 Processor -- start 2023-06-09T11:11:43.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 -- start start 2023-06-09T11:11:43.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f188c0b2860 0x7f188c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f188c0b2c30 0x7f188c1f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0ce9b0 0x7f188c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1f64e0 con 0x7f188c0b2860 2023-06-09T11:11:43.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c0b55c0 con 0x7f188c0b2c30 2023-06-09T11:11:43.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.326+0000 7f18929bf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c0b58a0 con 0x7f188c0ce9b0 2023-06-09T11:11:43.341 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f188c0b2c30 0x7f188c1f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.341 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f1890f5c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0ce9b0 0x7f188c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.341 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f188c0b2c30 0x7f188c1f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53534/0 (socket says 172.21.15.187:53534) 2023-06-09T11:11:43.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 -- 172.21.15.187:0/4155938746 learned_addr learned my addr 172.21.15.187:0/4155938746 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:43.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188bfff700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f188c0b2860 0x7f188c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 -- 172.21.15.187:0/4155938746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0ce9b0 msgr2=0x7f188c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0ce9b0 0x7f188c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 -- 172.21.15.187:0/4155938746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f188c0b2860 msgr2=0x7f188c0b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f188c0b2860 0x7f188c0b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 -- 172.21.15.187:0/4155938746 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c009450 con 0x7f188c0b2c30 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f188b7fe700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f188c0b2c30 0x7f188c1f5fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f188000e840 tx=0x7f188000eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f1888ff9700 1 -- 172.21.15.187:0/4155938746 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800095a0 con 0x7f188c0b2c30 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f1888ff9700 1 -- 172.21.15.187:0/4155938746 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880013680 con 0x7f188c0b2c30 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f1888ff9700 1 -- 172.21.15.187:0/4155938746 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800139f0 con 0x7f188c0b2c30 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c15d470 con 0x7f188c0b2c30 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c15d190 con 0x7f188c0b2c30 2023-06-09T11:11:43.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f1888ff9700 1 -- 172.21.15.187:0/4155938746 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f188001c450 con 0x7f188c0b2c30 2023-06-09T11:11:43.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f1888ff9700 1 -- 172.21.15.187:0/4155938746 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1880005df0 con 0x7f188c0b2c30 2023-06-09T11:11:43.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.330+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c0b30b0 con 0x7f188c0b2c30 2023-06-09T11:11:43.345 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.334+0000 7f1888ff9700 1 -- 172.21.15.187:0/4155938746 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f188003bb10 con 0x7f188c0b2c30 2023-06-09T11:11:43.365 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:43.353+0000 7f89c57022c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T11:11:43.374 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:43.362+0000 7fb4693c22c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T11:11:43.420 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.410+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6a598b89-7602-426f-b6b1-605d49b36c2a", "id": 1} v 0) v1 -- 0x7f188c0741c0 con 0x7f188c0b2c30 2023-06-09T11:11:43.428 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f1888ff9700 1 -- 172.21.15.187:0/4155938746 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a598b89-7602-426f-b6b1-605d49b36c2a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f188002a070 con 0x7f188c0b2c30 2023-06-09T11:11:43.429 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-06-09T11:11:43.430 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f188c0b2c30 msgr2=0x7f188c1f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.431 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f18929bf700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f188c0b2c30 0x7f188c1f5fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f188000e840 tx=0x7f188000eb50 comp rx=0 tx=0).stop 2023-06-09T11:11:43.431 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 shutdown_connections 2023-06-09T11:11:43.431 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f18929bf700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f188c0ce9b0 0x7f188c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.431 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f18929bf700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f188c0b2c30 0x7f188c1f5fa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.431 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f18929bf700 1 --2- 172.21.15.187:0/4155938746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f188c0b2860 0x7f188c0b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.431 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.418+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 >> 172.21.15.187:0/4155938746 conn(0x7f188c0cd860 msgr2=0x7f188c157370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:43.432 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.422+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 shutdown_connections 2023-06-09T11:11:43.432 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.422+0000 7f18929bf700 1 -- 172.21.15.187:0/4155938746 wait complete. 2023-06-09T11:11:43.450 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new fe20b37f-0996-498b-a1cd-e9b1ccb6c218 2 2023-06-09T11:11:43.551 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:43.541+0000 7f89c57022c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T11:11:43.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.642+0000 7fb03e2d8700 1 Processor -- start 2023-06-09T11:11:43.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.642+0000 7fb03e2d8700 1 -- start start 2023-06-09T11:11:43.658 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03e2d8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb0380cfa40 0x7fb0380d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.659 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03e2d8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0380cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.659 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03e2d8700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb038160d70 0x7fb0380cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.659 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03e2d8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0381608e0 con 0x7fb0380cfa40 2023-06-09T11:11:43.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03e2d8700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03806e680 con 0x7fb038160d70 2023-06-09T11:11:43.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03e2d8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03815cc40 con 0x7fb03806e230 2023-06-09T11:11:43.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb038160d70 0x7fb0380cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb02ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0380cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb038160d70 0x7fb0380cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53550/0 (socket says 172.21.15.187:53550) 2023-06-09T11:11:43.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 -- 172.21.15.187:0/2642868691 learned_addr learned my addr 172.21.15.187:0/2642868691 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb037fff700 1 --2- 172.21.15.187:0/2642868691 >> v2:172.21.15.78:3300/0 conn(0x7fb0380cfa40 0x7fb0380d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 -- 172.21.15.187:0/2642868691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 msgr2=0x7fb0380cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 --2- 172.21.15.187:0/2642868691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0380cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 -- 172.21.15.187:0/2642868691 >> v2:172.21.15.78:3300/0 conn(0x7fb0380cfa40 msgr2=0x7fb0380d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 --2- 172.21.15.187:0/2642868691 >> v2:172.21.15.78:3300/0 conn(0x7fb0380cfa40 0x7fb0380d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 -- 172.21.15.187:0/2642868691 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380d0350 con 0x7fb038160d70 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb03c875700 1 --2- 172.21.15.187:0/2642868691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb038160d70 0x7fb0380cd680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb0380d40a0 tx=0x7fb03000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff4909a3ab0f8d67 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb0377fe700 1 -- 172.21.15.187:0/2642868691 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000e070 con 0x7fb038160d70 2023-06-09T11:11:43.662 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb0377fe700 1 -- 172.21.15.187:0/2642868691 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000b910 con 0x7fb038160d70 2023-06-09T11:11:43.662 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.646+0000 7fb0377fe700 1 -- 172.21.15.187:0/2642868691 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000bcc0 con 0x7fb038160d70 2023-06-09T11:11:43.663 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 -- 172.21.15.187:0/2642868691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb038160d70 msgr2=0x7fb0380cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.663 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/2642868691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb038160d70 0x7fb0380cd680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb0380d40a0 tx=0x7fb03000b330 comp rx=0 tx=0).stop 2023-06-09T11:11:43.663 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 -- 172.21.15.187:0/2642868691 shutdown_connections 2023-06-09T11:11:43.664 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/2642868691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb038160d70 0x7fb0380cd680 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.664 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/2642868691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0380cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.664 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/2642868691 >> v2:172.21.15.78:3300/0 conn(0x7fb0380cfa40 0x7fb0380d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.664 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 -- 172.21.15.187:0/2642868691 >> 172.21.15.187:0/2642868691 conn(0x7fb0380b4c00 msgr2=0x7fb0380b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:43.664 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 -- 172.21.15.187:0/2642868691 shutdown_connections 2023-06-09T11:11:43.664 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 -- 172.21.15.187:0/2642868691 wait complete. 2023-06-09T11:11:43.664 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 Processor -- start 2023-06-09T11:11:43.665 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.650+0000 7fb03e2d8700 1 -- start start 2023-06-09T11:11:43.665 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0381e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.665 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0380cfa40 0x7fb0381f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.665 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb038160d70 0x7fb03815f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.665 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380c8220 con 0x7fb038160d70 2023-06-09T11:11:43.665 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380c8500 con 0x7fb0380cfa40 2023-06-09T11:11:43.665 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0380c87e0 con 0x7fb03806e230 2023-06-09T11:11:43.666 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0381e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.666 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb02ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0380cfa40 0x7fb0381f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.666 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0381e84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:40242/0 (socket says 172.21.15.187:40242) 2023-06-09T11:11:43.666 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 -- 172.21.15.187:0/604841831 learned_addr learned my addr 172.21.15.187:0/604841831 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:43.668 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03c875700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb038160d70 0x7fb03815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.668 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 -- 172.21.15.187:0/604841831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0380cfa40 msgr2=0x7fb0381f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0380cfa40 0x7fb0381f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 -- 172.21.15.187:0/604841831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb038160d70 msgr2=0x7fb03815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.670 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb038160d70 0x7fb03815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.670 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 -- 172.21.15.187:0/604841831 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030009b30 con 0x7fb03806e230 2023-06-09T11:11:43.670 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb037fff700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0381e84d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb02800e760 tx=0x7fb02800ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.670 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb0357fa700 1 -- 172.21.15.187:0/604841831 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800c070 con 0x7fb03806e230 2023-06-09T11:11:43.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb0357fa700 1 -- 172.21.15.187:0/604841831 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028013610 con 0x7fb03806e230 2023-06-09T11:11:43.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0380d11e0 con 0x7fb03806e230 2023-06-09T11:11:43.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb0357fa700 1 -- 172.21.15.187:0/604841831 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028013980 con 0x7fb03806e230 2023-06-09T11:11:43.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0380c9ea0 con 0x7fb03806e230 2023-06-09T11:11:43.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb0357fa700 1 -- 172.21.15.187:0/604841831 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb02801c400 con 0x7fb03806e230 2023-06-09T11:11:43.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb0357fa700 1 -- 172.21.15.187:0/604841831 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fb02801cad0 con 0x7fb03806e230 2023-06-09T11:11:43.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.654+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0380d14c0 con 0x7fb03806e230 2023-06-09T11:11:43.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.658+0000 7fb0357fa700 1 -- 172.21.15.187:0/604841831 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb02803bb10 con 0x7fb03806e230 2023-06-09T11:11:43.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.738+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fe20b37f-0996-498b-a1cd-e9b1ccb6c218", "id": 2} v 0) v1 -- 0x7fb0380741c0 con 0x7fb03806e230 2023-06-09T11:11:43.760 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb0357fa700 1 -- 172.21.15.187:0/604841831 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe20b37f-0996-498b-a1cd-e9b1ccb6c218", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb02802a070 con 0x7fb03806e230 2023-06-09T11:11:43.760 INFO:teuthology.orchestra.run.smithi187.stdout:2 2023-06-09T11:11:43.761 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 msgr2=0x7fb0381e84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.761 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0381e84d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb02800e760 tx=0x7fb02800ea70 comp rx=0 tx=0).stop 2023-06-09T11:11:43.762 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 shutdown_connections 2023-06-09T11:11:43.762 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb038160d70 0x7fb03815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.762 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0380cfa40 0x7fb0381f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.762 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 --2- 172.21.15.187:0/604841831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03806e230 0x7fb0381e84d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.762 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 >> 172.21.15.187:0/604841831 conn(0x7fb0380b4c00 msgr2=0x7fb0380b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:43.763 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 shutdown_connections 2023-06-09T11:11:43.763 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.750+0000 7fb03e2d8700 1 -- 172.21.15.187:0/604841831 wait complete. 2023-06-09T11:11:43.781 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new c29c757a-5e70-44c0-b09d-0d47603e9b33 3 2023-06-09T11:11:43.825 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:43.813+0000 7f89c57022c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T11:11:43.862 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:43.850+0000 7fb4693c22c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T11:11:43.901 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:43.889+0000 7f89c57022c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T11:11:43.938 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.926+0000 7fca2b39a700 1 Processor -- start 2023-06-09T11:11:43.939 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.926+0000 7fca2b39a700 1 -- start start 2023-06-09T11:11:43.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2b39a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca24142a50 0x7fca2406a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2b39a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fca2406bd70 0x7fca240b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2b39a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca24142e20 con 0x7fca2406e6a0 2023-06-09T11:11:43.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2b39a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2406acd0 con 0x7fca2406bd70 2023-06-09T11:11:43.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2b39a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2406afb0 con 0x7fca24142a50 2023-06-09T11:11:43.942 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2ab99700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fca2406e6a0 0x7fca241431f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:45924/0 (socket says 172.21.15.187:45924) 2023-06-09T11:11:43.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2ab99700 1 -- 172.21.15.187:0/2997168823 learned_addr learned my addr 172.21.15.187:0/2997168823 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-06-09T11:11:43.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca29b97700 1 --2- 172.21.15.187:0/2997168823 >> v2:172.21.15.187:3300/0 conn(0x7fca2406bd70 0x7fca240b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.943 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca2a398700 1 --2- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca24142a50 0x7fca2406a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.944 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca29396700 1 -- 172.21.15.187:0/2997168823 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204797176 0 0) 0x7fca24142e20 con 0x7fca2406e6a0 2023-06-09T11:11:43.944 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca29396700 1 -- 172.21.15.187:0/2997168823 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca100035d0 con 0x7fca2406e6a0 2023-06-09T11:11:43.944 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca29b97700 1 -- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca24142a50 msgr2=0x7fca2406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:43.944 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca29b97700 1 --2- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca24142a50 0x7fca2406a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.944 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca29b97700 1 -- 172.21.15.187:0/2997168823 >> v1:172.21.15.187:6789/0 conn(0x7fca2406e6a0 legacy=0x7fca241431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.930+0000 7fca29b97700 1 -- 172.21.15.187:0/2997168823 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2406b290 con 0x7fca2406bd70 2023-06-09T11:11:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca29b97700 1 --2- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406bd70 0x7fca240b6930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fca14009850 tx=0x7fca14009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd708459d644261e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca29396700 1 -- 172.21.15.187:0/2997168823 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14011830 con 0x7fca2406bd70 2023-06-09T11:11:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca29396700 1 -- 172.21.15.187:0/2997168823 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca14011990 con 0x7fca2406bd70 2023-06-09T11:11:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca29396700 1 -- 172.21.15.187:0/2997168823 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14011d40 con 0x7fca2406bd70 2023-06-09T11:11:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 -- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406bd70 msgr2=0x7fca240b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.945 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 --2- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406bd70 0x7fca240b6930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fca14009850 tx=0x7fca14009b60 comp rx=0 tx=0).stop 2023-06-09T11:11:43.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 -- 172.21.15.187:0/2997168823 shutdown_connections 2023-06-09T11:11:43.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 --2- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406bd70 0x7fca240b6930 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 --2- 172.21.15.187:0/2997168823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca24142a50 0x7fca2406a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.946 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 -- 172.21.15.187:0/2997168823 >> 172.21.15.187:0/2997168823 conn(0x7fca240b5820 msgr2=0x7fca240d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:43.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 -- 172.21.15.187:0/2997168823 shutdown_connections 2023-06-09T11:11:43.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.934+0000 7fca2b39a700 1 -- 172.21.15.187:0/2997168823 wait complete. 2023-06-09T11:11:43.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 Processor -- start 2023-06-09T11:11:43.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 -- start start 2023-06-09T11:11:43.948 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2406bd70 0x7fca240d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.948 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca2406e6a0 0x7fca241418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.948 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca24142a50 0x7fca240cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:43.948 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240d30e0 con 0x7fca2406bd70 2023-06-09T11:11:43.949 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240d2460 con 0x7fca24142a50 2023-06-09T11:11:43.949 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240d2740 con 0x7fca2406e6a0 2023-06-09T11:11:43.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca24142a50 0x7fca240cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca24142a50 0x7fca240cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53584/0 (socket says 172.21.15.187:53584) 2023-06-09T11:11:43.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 -- 172.21.15.187:0/1807630796 learned_addr learned my addr 172.21.15.187:0/1807630796 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:43.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca29b97700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca2406e6a0 0x7fca241418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2a398700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2406bd70 0x7fca240d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:43.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 -- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca2406e6a0 msgr2=0x7fca241418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca2406e6a0 0x7fca241418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 -- 172.21.15.187:0/1807630796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2406bd70 msgr2=0x7fca240d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2406bd70 0x7fca240d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 -- 172.21.15.187:0/1807630796 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca140094b0 con 0x7fca24142a50 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2a398700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2406bd70 0x7fca240d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2ab99700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca24142a50 0x7fca240cf6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00cb30 tx=0x7fca1c00cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca1affd700 1 -- 172.21.15.187:0/1807630796 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00a7b0 con 0x7fca24142a50 2023-06-09T11:11:43.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca1affd700 1 -- 172.21.15.187:0/1807630796 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c00a910 con 0x7fca24142a50 2023-06-09T11:11:43.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca1affd700 1 -- 172.21.15.187:0/1807630796 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00ac80 con 0x7fca24142a50 2023-06-09T11:11:43.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2406b850 con 0x7fca24142a50 2023-06-09T11:11:43.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2406b570 con 0x7fca24142a50 2023-06-09T11:11:43.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca1affd700 1 -- 172.21.15.187:0/1807630796 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca1c01c440 con 0x7fca24142a50 2023-06-09T11:11:43.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.938+0000 7fca1affd700 1 -- 172.21.15.187:0/1807630796 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fca1c01cb80 con 0x7fca24142a50 2023-06-09T11:11:43.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.942+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca240b6e70 con 0x7fca24142a50 2023-06-09T11:11:43.954 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:43.942+0000 7fca1affd700 1 -- 172.21.15.187:0/1807630796 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fca1c021060 con 0x7fca24142a50 2023-06-09T11:11:44.032 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.022+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c29c757a-5e70-44c0-b09d-0d47603e9b33", "id": 3} v 0) v1 -- 0x7fca24156130 con 0x7fca24142a50 2023-06-09T11:11:44.043 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca1affd700 1 -- 172.21.15.187:0/1807630796 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c29c757a-5e70-44c0-b09d-0d47603e9b33", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca1c017070 con 0x7fca24142a50 2023-06-09T11:11:44.043 INFO:teuthology.orchestra.run.smithi187.stdout:3 2023-06-09T11:11:44.044 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca24142a50 msgr2=0x7fca240cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.045 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca24142a50 0x7fca240cf6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00cb30 tx=0x7fca1c00cb60 comp rx=0 tx=0).stop 2023-06-09T11:11:44.045 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 shutdown_connections 2023-06-09T11:11:44.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca24142a50 0x7fca240cf6e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca2406e6a0 0x7fca241418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 --2- 172.21.15.187:0/1807630796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2406bd70 0x7fca240d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 >> 172.21.15.187:0/1807630796 conn(0x7fca240b5820 msgr2=0x7fca2406fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:44.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 shutdown_connections 2023-06-09T11:11:44.046 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.034+0000 7fca2b39a700 1 -- 172.21.15.187:0/1807630796 wait complete. 2023-06-09T11:11:44.052 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:44.042+0000 7fb4693c22c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T11:11:44.066 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 0d4ffc37-9318-4d59-aa09-a2ce589977a9 4 2023-06-09T11:11:44.136 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:44.125+0000 7f89c57022c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T11:11:44.224 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:44.213+0000 7f89c57022c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T11:11:44.226 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.214+0000 7fabd359e700 1 Processor -- start 2023-06-09T11:11:44.227 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd359e700 1 -- start start 2023-06-09T11:11:44.229 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd359e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40af250 0x7fabd40b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.229 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabd40cc3d0 0x7fabd40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.229 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd359e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd4071d60 con 0x7fabd40718e0 2023-06-09T11:11:44.229 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd359e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40b39c0 con 0x7fabd40cc3d0 2023-06-09T11:11:44.230 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd359e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40b0850 con 0x7fabd40af250 2023-06-09T11:11:44.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40af250 0x7fabd40b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd1d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabd40cc3d0 0x7fabd40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd1d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fabd40cc3d0 0x7fabd40713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.187:57552/0 (socket says 172.21.15.187:57552) 2023-06-09T11:11:44.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd1d9b700 1 -- 172.21.15.187:0/3201872444 learned_addr learned my addr 172.21.15.187:0/3201872444 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:44.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40af250 0x7fabd40b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:40280/0 (socket says 172.21.15.187:40280) 2023-06-09T11:11:44.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd1d9b700 1 -- 172.21.15.187:0/3201872444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40af250 msgr2=0x7fabd40b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:44.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.218+0000 7fabd1d9b700 1 --2- 172.21.15.187:0/3201872444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40af250 0x7fabd40b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd1d9b700 1 -- 172.21.15.187:0/3201872444 >> v1:172.21.15.78:6789/0 conn(0x7fabd40718e0 legacy=0x7fabd40b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd1d9b700 1 -- 172.21.15.187:0/3201872444 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40b0b10 con 0x7fabd40cc3d0 2023-06-09T11:11:44.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd259c700 1 --2- 172.21.15.187:0/3201872444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40af250 0x7fabd40b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:11:44.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd1d9b700 1 --2- 172.21.15.187:0/3201872444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40cc3d0 0x7fabd40713a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009910 tx=0x7fabc8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deed6ebc704fed25 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:44.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd159a700 1 -- 172.21.15.187:0/3201872444 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011830 con 0x7fabd40cc3d0 2023-06-09T11:11:44.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd159a700 1 -- 172.21.15.187:0/3201872444 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8011990 con 0x7fabd40cc3d0 2023-06-09T11:11:44.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd159a700 1 -- 172.21.15.187:0/3201872444 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011d40 con 0x7fabd40cc3d0 2023-06-09T11:11:44.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 -- 172.21.15.187:0/3201872444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40cc3d0 msgr2=0x7fabd40713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 --2- 172.21.15.187:0/3201872444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40cc3d0 0x7fabd40713a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009910 tx=0x7fabc8009c20 comp rx=0 tx=0).stop 2023-06-09T11:11:44.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 -- 172.21.15.187:0/3201872444 shutdown_connections 2023-06-09T11:11:44.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 --2- 172.21.15.187:0/3201872444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40cc3d0 0x7fabd40713a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 --2- 172.21.15.187:0/3201872444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40af250 0x7fabd40b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 -- 172.21.15.187:0/3201872444 >> 172.21.15.187:0/3201872444 conn(0x7fabd40b2aa0 msgr2=0x7fabd40b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:44.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 -- 172.21.15.187:0/3201872444 shutdown_connections 2023-06-09T11:11:44.236 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.222+0000 7fabd359e700 1 -- 172.21.15.187:0/3201872444 wait complete. 2023-06-09T11:11:44.236 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 Processor -- start 2023-06-09T11:11:44.236 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 -- start start 2023-06-09T11:11:44.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40718e0 0x7fabd41f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40af250 0x7fabd4153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd40cc3d0 0x7fabd40c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4156900 con 0x7fabd40af250 2023-06-09T11:11:44.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd41f5b40 con 0x7fabd40cc3d0 2023-06-09T11:11:44.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd359e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4154f00 con 0x7fabd40718e0 2023-06-09T11:11:44.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40718e0 0x7fabd41f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40718e0 0x7fabd41f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:40294/0 (socket says 172.21.15.187:40294) 2023-06-09T11:11:44.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 -- 172.21.15.187:0/1259141245 learned_addr learned my addr 172.21.15.187:0/1259141245 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:44.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd2d9d700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd40cc3d0 0x7fabd40c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd1d9b700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40af250 0x7fabd4153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 -- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd40cc3d0 msgr2=0x7fabd40c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd40cc3d0 0x7fabd40c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 -- 172.21.15.187:0/1259141245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40af250 msgr2=0x7fabd4153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40af250 0x7fabd4153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd259c700 1 -- 172.21.15.187:0/1259141245 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4009450 con 0x7fabd40718e0 2023-06-09T11:11:44.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.226+0000 7fabd2d9d700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd40cc3d0 0x7fabd40c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:11:44.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabd259c700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40718e0 0x7fabd41f5600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabc400ebe0 tx=0x7fabc400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:44.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabc2ffd700 1 -- 172.21.15.187:0/1259141245 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400c850 con 0x7fabd40718e0 2023-06-09T11:11:44.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabc2ffd700 1 -- 172.21.15.187:0/1259141245 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc400c9b0 con 0x7fabd40718e0 2023-06-09T11:11:44.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabc2ffd700 1 -- 172.21.15.187:0/1259141245 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400cd40 con 0x7fabd40718e0 2023-06-09T11:11:44.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc8009570 con 0x7fabd40718e0 2023-06-09T11:11:44.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd40b10d0 con 0x7fabd40718e0 2023-06-09T11:11:44.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabc2ffd700 1 -- 172.21.15.187:0/1259141245 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fabc4005d40 con 0x7fabd40718e0 2023-06-09T11:11:44.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabc2ffd700 1 -- 172.21.15.187:0/1259141245 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fabc4006840 con 0x7fabd40718e0 2023-06-09T11:11:44.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.230+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd40b0df0 con 0x7fabd40718e0 2023-06-09T11:11:44.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.234+0000 7fabc2ffd700 1 -- 172.21.15.187:0/1259141245 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fabc4021060 con 0x7fabd40718e0 2023-06-09T11:11:44.318 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:44.309+0000 7f89c57022c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T11:11:44.324 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.314+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d4ffc37-9318-4d59-aa09-a2ce589977a9", "id": 4} v 0) v1 -- 0x7fabd40ca240 con 0x7fabd40718e0 2023-06-09T11:11:44.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.322+0000 7fabc2ffd700 1 -- 172.21.15.187:0/1259141245 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d4ffc37-9318-4d59-aa09-a2ce589977a9", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabc40290b0 con 0x7fabd40718e0 2023-06-09T11:11:44.334 INFO:teuthology.orchestra.run.smithi187.stdout:4 2023-06-09T11:11:44.335 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40718e0 msgr2=0x7fabd41f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40718e0 0x7fabd41f5600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabc400ebe0 tx=0x7fabc400eef0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 shutdown_connections 2023-06-09T11:11:44.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd40cc3d0 0x7fabd40c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabd40af250 0x7fabd4153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 --2- 172.21.15.187:0/1259141245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabd40718e0 0x7fabd41f5600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 >> 172.21.15.187:0/1259141245 conn(0x7fabd40b2aa0 msgr2=0x7fabd40708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:44.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 shutdown_connections 2023-06-09T11:11:44.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.326+0000 7fabd359e700 1 -- 172.21.15.187:0/1259141245 wait complete. 2023-06-09T11:11:44.355 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994 5 2023-06-09T11:11:44.463 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:44.454+0000 7fb4693c22c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T11:11:44.516 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbdd57a700 1 Processor -- start 2023-06-09T11:11:44.516 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbdd57a700 1 -- start start 2023-06-09T11:11:44.517 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbdd57a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbd806d790 0x7fbbd80d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.518 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbdd57a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbbd80d11b0 0x7fbbd80cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.518 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbdd57a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd80cda60 con 0x7fbbd815c9f0 2023-06-09T11:11:44.518 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbdd57a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80d15d0 con 0x7fbbd80d11b0 2023-06-09T11:11:44.518 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbdd57a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd8160d70 con 0x7fbbd806d790 2023-06-09T11:11:44.519 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd67fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbd806d790 0x7fbbd80d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.520 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd67fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbd806d790 0x7fbbd80d0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53610/0 (socket says 172.21.15.187:53610) 2023-06-09T11:11:44.520 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd67fc700 1 -- 172.21.15.187:0/3863833013 learned_addr learned my addr 172.21.15.187:0/3863833013 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:44.520 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd77fe700 1 --2- 172.21.15.187:0/3863833013 >> v2:172.21.15.78:3300/0 conn(0x7fbbd80d11b0 0x7fbbd80cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.520 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd67fc700 1 -- 172.21.15.187:0/3863833013 >> v2:172.21.15.78:3300/0 conn(0x7fbbd80d11b0 msgr2=0x7fbbd80cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:44.520 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd67fc700 1 --2- 172.21.15.187:0/3863833013 >> v2:172.21.15.78:3300/0 conn(0x7fbbd80d11b0 0x7fbbd80cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.520 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd67fc700 1 -- 172.21.15.187:0/3863833013 >> v1:172.21.15.187:6789/0 conn(0x7fbbd815c9f0 legacy=0x7fbbd8160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.520 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.506+0000 7fbbd67fc700 1 -- 172.21.15.187:0/3863833013 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8161050 con 0x7fbbd806d790 2023-06-09T11:11:44.521 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbd77fe700 1 --2- 172.21.15.187:0/3863833013 >> v2:172.21.15.78:3300/0 conn(0x7fbbd80d11b0 0x7fbbd80cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:11:44.521 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbd67fc700 1 --2- 172.21.15.187:0/3863833013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80d0c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80716e0 tx=0x7fbbcc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=903c0eee6d02bbef server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:44.521 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbd5ffb700 1 -- 172.21.15.187:0/3863833013 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc00b8a0 con 0x7fbbd806d790 2023-06-09T11:11:44.521 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbd5ffb700 1 -- 172.21.15.187:0/3863833013 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc00ba00 con 0x7fbbd806d790 2023-06-09T11:11:44.521 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbd5ffb700 1 -- 172.21.15.187:0/3863833013 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc00bd90 con 0x7fbbd806d790 2023-06-09T11:11:44.522 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 -- 172.21.15.187:0/3863833013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 msgr2=0x7fbbd80d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.522 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 --2- 172.21.15.187:0/3863833013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80d0c70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80716e0 tx=0x7fbbcc009bf0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.522 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 -- 172.21.15.187:0/3863833013 shutdown_connections 2023-06-09T11:11:44.522 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 --2- 172.21.15.187:0/3863833013 >> v2:172.21.15.78:3300/0 conn(0x7fbbd80d11b0 0x7fbbd80cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.523 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 --2- 172.21.15.187:0/3863833013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80d0c70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.523 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 -- 172.21.15.187:0/3863833013 >> 172.21.15.187:0/3863833013 conn(0x7fbbd80b4c90 msgr2=0x7fbbd80b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:44.523 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 -- 172.21.15.187:0/3863833013 shutdown_connections 2023-06-09T11:11:44.523 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.510+0000 7fbbdd57a700 1 -- 172.21.15.187:0/3863833013 wait complete. 2023-06-09T11:11:44.525 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 Processor -- start 2023-06-09T11:11:44.525 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 -- start start 2023-06-09T11:11:44.526 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.527 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbd80d11b0 0x7fbbd81f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.527 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd815c9f0 0x7fbbd81f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.527 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd81f5ba0 con 0x7fbbd815c9f0 2023-06-09T11:11:44.528 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80b61a0 con 0x7fbbd806d790 2023-06-09T11:11:44.528 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbdd57a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd81f1f40 con 0x7fbbd80d11b0 2023-06-09T11:11:44.528 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.514+0000 7fbbd67fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbd80d11b0 0x7fbbd81f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.528 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.528 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53624/0 (socket says 172.21.15.187:53624) 2023-06-09T11:11:44.529 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd6ffd700 1 -- 172.21.15.187:0/2447310574 learned_addr learned my addr 172.21.15.187:0/2447310574 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:44.529 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd67fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbd80d11b0 0x7fbbd81f5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:40300/0 (socket says 172.21.15.187:40300) 2023-06-09T11:11:44.530 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd77fe700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd815c9f0 0x7fbbd81f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.530 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd67fc700 1 -- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 msgr2=0x7fbbd80cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.531 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd67fc700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.531 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd67fc700 1 -- 172.21.15.187:0/2447310574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd815c9f0 msgr2=0x7fbbd81f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.531 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd67fc700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd815c9f0 0x7fbbd81f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.531 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd67fc700 1 -- 172.21.15.187:0/2447310574 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc009570 con 0x7fbbd80d11b0 2023-06-09T11:11:44.531 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd6ffd700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:11:44.531 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbd67fc700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbd80d11b0 0x7fbbd81f5660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc016000 tx=0x7fbbcc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:44.531 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbbf7fe700 1 -- 172.21.15.187:0/2447310574 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0038c0 con 0x7fbbd80d11b0 2023-06-09T11:11:44.532 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbbf7fe700 1 -- 172.21.15.187:0/2447310574 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc01e070 con 0x7fbbd80d11b0 2023-06-09T11:11:44.532 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbbf7fe700 1 -- 172.21.15.187:0/2447310574 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc003c80 con 0x7fbbd80d11b0 2023-06-09T11:11:44.532 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd80cd6f0 con 0x7fbbd80d11b0 2023-06-09T11:11:44.532 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd8161330 con 0x7fbbd80d11b0 2023-06-09T11:11:44.533 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbbf7fe700 1 -- 172.21.15.187:0/2447310574 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbbcc025780 con 0x7fbbd80d11b0 2023-06-09T11:11:44.533 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbbf7fe700 1 -- 172.21.15.187:0/2447310574 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbbcc020070 con 0x7fbbd80d11b0 2023-06-09T11:11:44.533 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.518+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd815cdc0 con 0x7fbbd80d11b0 2023-06-09T11:11:44.533 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.522+0000 7fbbbf7fe700 1 -- 172.21.15.187:0/2447310574 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fbbcc02a020 con 0x7fbbd80d11b0 2023-06-09T11:11:44.609 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.598+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994", "id": 5} v 0) v1 -- 0x7fbbd8065b40 con 0x7fbbd80d11b0 2023-06-09T11:11:44.621 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.610+0000 7fbbbf7fe700 1 -- 172.21.15.187:0/2447310574 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbbcc015020 con 0x7fbbd80d11b0 2023-06-09T11:11:44.622 INFO:teuthology.orchestra.run.smithi187.stdout:5 2023-06-09T11:11:44.623 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.610+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbd80d11b0 msgr2=0x7fbbd81f5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.623 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.610+0000 7fbbdd57a700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbd80d11b0 0x7fbbd81f5660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc016000 tx=0x7fbbcc004770 comp rx=0 tx=0).stop 2023-06-09T11:11:44.623 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.614+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 shutdown_connections 2023-06-09T11:11:44.623 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.614+0000 7fbbdd57a700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbd815c9f0 0x7fbbd81f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.623 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.614+0000 7fbbdd57a700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbd80d11b0 0x7fbbd81f5660 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.614+0000 7fbbdd57a700 1 --2- 172.21.15.187:0/2447310574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd806d790 0x7fbbd80cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.614+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 >> 172.21.15.187:0/2447310574 conn(0x7fbbd80b4c90 msgr2=0x7fbbd80c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:44.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.614+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 shutdown_connections 2023-06-09T11:11:44.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.614+0000 7fbbdd57a700 1 -- 172.21.15.187:0/2447310574 wait complete. 2023-06-09T11:11:44.643 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 6d5e6997-f8f0-4a38-b2b9-8d71a78d3823 6 2023-06-09T11:11:44.702 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:44.690+0000 7fb4693c22c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T11:11:44.797 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:44.785+0000 7f89c57022c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T11:11:44.802 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:44.790+0000 7fb4693c22c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T11:11:44.803 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd64aee700 1 Processor -- start 2023-06-09T11:11:44.803 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd64aee700 1 -- start start 2023-06-09T11:11:44.805 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd64aee700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600b2930 0x7fbd600b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.805 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd64aee700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd600cbf50 0x7fbd600cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.805 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd64aee700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd600b32c0 con 0x7fbd6015c9c0 2023-06-09T11:11:44.806 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd64aee700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6015cd90 con 0x7fbd600cbf50 2023-06-09T11:11:44.806 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd64aee700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600cb500 con 0x7fbd600b2930 2023-06-09T11:11:44.806 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600b2930 0x7fbd600b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.807 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd5ed9d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd600cbf50 0x7fbd600cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.807 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600b2930 0x7fbd600b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:40314/0 (socket says 172.21.15.187:40314) 2023-06-09T11:11:44.807 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1062247547 learned_addr learned my addr 172.21.15.187:0/1062247547 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:44.807 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1062247547 >> v2:172.21.15.187:3300/0 conn(0x7fbd600cbf50 msgr2=0x7fbd600cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:44.807 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd5dd9b700 1 --2- 172.21.15.187:0/1062247547 >> v2:172.21.15.187:3300/0 conn(0x7fbd600cbf50 0x7fbd600cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.807 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.794+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1062247547 >> v1:172.21.15.78:6789/0 conn(0x7fbd6015c9c0 legacy=0x7fbd60160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:44.807 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1062247547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd60160eb0 con 0x7fbd600b2930 2023-06-09T11:11:44.808 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd5dd9b700 1 --2- 172.21.15.187:0/1062247547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600b2930 0x7fbd600b2d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009910 tx=0x7fbd54009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb5012ed3ed8208b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:44.808 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd5d59a700 1 -- 172.21.15.187:0/1062247547 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54011830 con 0x7fbd600b2930 2023-06-09T11:11:44.809 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd5d59a700 1 -- 172.21.15.187:0/1062247547 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54011990 con 0x7fbd600b2930 2023-06-09T11:11:44.809 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd5d59a700 1 -- 172.21.15.187:0/1062247547 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54011d40 con 0x7fbd600b2930 2023-06-09T11:11:44.809 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 -- 172.21.15.187:0/1062247547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600b2930 msgr2=0x7fbd600b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.809 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 --2- 172.21.15.187:0/1062247547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600b2930 0x7fbd600b2d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009910 tx=0x7fbd54009c20 comp rx=0 tx=0).stop 2023-06-09T11:11:44.810 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 -- 172.21.15.187:0/1062247547 shutdown_connections 2023-06-09T11:11:44.810 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 --2- 172.21.15.187:0/1062247547 >> v2:172.21.15.187:3300/0 conn(0x7fbd600cbf50 0x7fbd600cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.810 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 --2- 172.21.15.187:0/1062247547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600b2930 0x7fbd600b2d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.810 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 -- 172.21.15.187:0/1062247547 >> 172.21.15.187:0/1062247547 conn(0x7fbd600cd930 msgr2=0x7fbd600cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:44.810 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 -- 172.21.15.187:0/1062247547 shutdown_connections 2023-06-09T11:11:44.810 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.798+0000 7fbd64aee700 1 -- 172.21.15.187:0/1062247547 wait complete. 2023-06-09T11:11:44.812 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 Processor -- start 2023-06-09T11:11:44.812 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 -- start start 2023-06-09T11:11:44.817 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd600b2930 0x7fbd6014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.817 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cbf50 0x7fbd60158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.818 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015c9c0 0x7fbd60158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:44.818 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c81f0 con 0x7fbd600b2930 2023-06-09T11:11:44.819 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6014ca90 con 0x7fbd6015c9c0 2023-06-09T11:11:44.819 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd64aee700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6006b650 con 0x7fbd600cbf50 2023-06-09T11:11:44.819 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cbf50 0x7fbd60158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cbf50 0x7fbd60158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:40328/0 (socket says 172.21.15.187:40328) 2023-06-09T11:11:44.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.802+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1530257011 learned_addr learned my addr 172.21.15.187:0/1530257011 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:44.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5ed9d700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015c9c0 0x7fbd60158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5e59c700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd600b2930 0x7fbd6014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015c9c0 msgr2=0x7fbd60158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5dd9b700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015c9c0 0x7fbd60158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1530257011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd600b2930 msgr2=0x7fbd6014c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5dd9b700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd600b2930 0x7fbd6014c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5dd9b700 1 -- 172.21.15.187:0/1530257011 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009570 con 0x7fbd600cbf50 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5e59c700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd600b2930 0x7fbd6014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5ed9d700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015c9c0 0x7fbd60158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:11:44.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd5dd9b700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cbf50 0x7fbd60158800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd600cb640 tx=0x7fbd54004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:44.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd4effd700 1 -- 172.21.15.187:0/1530257011 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54004590 con 0x7fbd600cbf50 2023-06-09T11:11:44.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd4effd700 1 -- 172.21.15.187:0/1530257011 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5401e070 con 0x7fbd600cbf50 2023-06-09T11:11:44.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600cb750 con 0x7fbd600cbf50 2023-06-09T11:11:44.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd4effd700 1 -- 172.21.15.187:0/1530257011 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54003900 con 0x7fbd600cbf50 2023-06-09T11:11:44.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd60161190 con 0x7fbd600cbf50 2023-06-09T11:11:44.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd4effd700 1 -- 172.21.15.187:0/1530257011 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbd5401a420 con 0x7fbd600cbf50 2023-06-09T11:11:44.823 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd4effd700 1 -- 172.21.15.187:0/1530257011 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fbd5401acc0 con 0x7fbd600cbf50 2023-06-09T11:11:44.823 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.806+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600cba30 con 0x7fbd600cbf50 2023-06-09T11:11:44.824 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.810+0000 7fbd4effd700 1 -- 172.21.15.187:0/1530257011 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fbd54020070 con 0x7fbd600cbf50 2023-06-09T11:11:44.890 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:44.878+0000 7fb4693c22c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T11:11:44.894 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.882+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6d5e6997-f8f0-4a38-b2b9-8d71a78d3823", "id": 6} v 0) v1 -- 0x7fbd60156a70 con 0x7fbd600cbf50 2023-06-09T11:11:44.905 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.894+0000 7fbd4effd700 1 -- 172.21.15.187:0/1530257011 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d5e6997-f8f0-4a38-b2b9-8d71a78d3823", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd54015020 con 0x7fbd600cbf50 2023-06-09T11:11:44.906 INFO:teuthology.orchestra.run.smithi187.stdout:6 2023-06-09T11:11:44.906 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.894+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cbf50 msgr2=0x7fbd60158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:44.906 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.894+0000 7fbd64aee700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cbf50 0x7fbd60158800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd600cb640 tx=0x7fbd54004770 comp rx=0 tx=0).stop 2023-06-09T11:11:44.907 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.894+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 shutdown_connections 2023-06-09T11:11:44.907 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.894+0000 7fbd64aee700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015c9c0 0x7fbd60158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.907 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.898+0000 7fbd64aee700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cbf50 0x7fbd60158800 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.907 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.898+0000 7fbd64aee700 1 --2- 172.21.15.187:0/1530257011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd600b2930 0x7fbd6014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:44.908 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.898+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 >> 172.21.15.187:0/1530257011 conn(0x7fbd600cd930 msgr2=0x7fbd600d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:44.908 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.898+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 shutdown_connections 2023-06-09T11:11:44.908 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:44.898+0000 7fbd64aee700 1 -- 172.21.15.187:0/1530257011 wait complete. 2023-06-09T11:11:44.927 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6 7 2023-06-09T11:11:44.960 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:44.949+0000 7f89c57022c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T11:11:45.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.078+0000 7f21d7107700 1 Processor -- start 2023-06-09T11:11:45.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.078+0000 7f21d7107700 1 -- start start 2023-06-09T11:11:45.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d7107700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f21d015a160 0x7f21d015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d7107700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f21d00d26d0 0x7f21d00d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d7107700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0070890 0x7f21d0070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d7107700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d0071210 con 0x7f21d015a160 2023-06-09T11:11:45.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d7107700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d006d730 con 0x7f21d00d26d0 2023-06-09T11:11:45.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d7107700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d015a530 con 0x7f21d0070890 2023-06-09T11:11:45.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d5904700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f21d00d26d0 0x7f21d00d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d5904700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f21d00d26d0 0x7f21d00d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53652/0 (socket says 172.21.15.187:53652) 2023-06-09T11:11:45.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d5904700 1 -- 172.21.15.187:0/1661467370 learned_addr learned my addr 172.21.15.187:0/1661467370 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:45.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6105700 1 --2- 172.21.15.187:0/1661467370 >> v2:172.21.15.78:3300/0 conn(0x7f21d015a160 0x7f21d015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6906700 1 --2- 172.21.15.187:0/1661467370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0070890 0x7f21d0070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6105700 1 -- 172.21.15.187:0/1661467370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0070890 msgr2=0x7f21d0070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:45.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6105700 1 --2- 172.21.15.187:0/1661467370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0070890 0x7f21d0070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6105700 1 -- 172.21.15.187:0/1661467370 >> v2:172.21.15.187:3300/0 conn(0x7f21d00d26d0 msgr2=0x7f21d00d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:45.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6105700 1 --2- 172.21.15.187:0/1661467370 >> v2:172.21.15.187:3300/0 conn(0x7f21d00d26d0 0x7f21d00d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6105700 1 -- 172.21.15.187:0/1661467370 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d015d180 con 0x7f21d015a160 2023-06-09T11:11:45.096 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d6105700 1 --2- 172.21.15.187:0/1661467370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 0x7f21d015cb30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f21d00b5b60 tx=0x7f21cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7afb4cae250dce0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:45.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.082+0000 7f21d5103700 1 -- 172.21.15.187:0/1661467370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00e070 con 0x7f21d015a160 2023-06-09T11:11:45.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d5103700 1 -- 172.21.15.187:0/1661467370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc00bb20 con 0x7f21d015a160 2023-06-09T11:11:45.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d5103700 1 -- 172.21.15.187:0/1661467370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc012430 con 0x7f21d015a160 2023-06-09T11:11:45.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 -- 172.21.15.187:0/1661467370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 msgr2=0x7f21d015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 --2- 172.21.15.187:0/1661467370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 0x7f21d015cb30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f21d00b5b60 tx=0x7f21cc00b330 comp rx=0 tx=0).stop 2023-06-09T11:11:45.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 -- 172.21.15.187:0/1661467370 shutdown_connections 2023-06-09T11:11:45.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 --2- 172.21.15.187:0/1661467370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0070890 0x7f21d0070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 --2- 172.21.15.187:0/1661467370 >> v2:172.21.15.187:3300/0 conn(0x7f21d00d26d0 0x7f21d00d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 --2- 172.21.15.187:0/1661467370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 0x7f21d015cb30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 -- 172.21.15.187:0/1661467370 >> 172.21.15.187:0/1661467370 conn(0x7f21d00cf930 msgr2=0x7f21d00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:45.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 -- 172.21.15.187:0/1661467370 shutdown_connections 2023-06-09T11:11:45.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.086+0000 7f21d7107700 1 -- 172.21.15.187:0/1661467370 wait complete. 2023-06-09T11:11:45.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 Processor -- start 2023-06-09T11:11:45.100 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 -- start start 2023-06-09T11:11:45.101 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0070890 0x7f21d014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.101 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d00d26d0 0x7f21d01f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 0x7f21d00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d015ace0 con 0x7f21d015a160 2023-06-09T11:11:45.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d015afc0 con 0x7f21d0070890 2023-06-09T11:11:45.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d7107700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d015b2a0 con 0x7f21d00d26d0 2023-06-09T11:11:45.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0070890 0x7f21d014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0070890 0x7f21d014dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:53666/0 (socket says 172.21.15.187:53666) 2023-06-09T11:11:45.102 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 -- 172.21.15.187:0/4062507677 learned_addr learned my addr 172.21.15.187:0/4062507677 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-06-09T11:11:45.103 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d5904700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d00d26d0 0x7f21d01f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.104 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6906700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 0x7f21d00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.104 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 -- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d00d26d0 msgr2=0x7f21d01f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.104 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d00d26d0 0x7f21d01f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.104 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 -- 172.21.15.187:0/4062507677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 msgr2=0x7f21d00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.104 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 0x7f21d00b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.104 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 -- 172.21.15.187:0/4062507677 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc009a70 con 0x7f21d0070890 2023-06-09T11:11:45.105 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.090+0000 7f21d6105700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0070890 0x7f21d014dc30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21cc014040 tx=0x7f21cc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:45.105 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21c6ffd700 1 -- 172.21.15.187:0/4062507677 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0098f0 con 0x7f21d0070890 2023-06-09T11:11:45.105 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21c6ffd700 1 -- 172.21.15.187:0/4062507677 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc020070 con 0x7f21d0070890 2023-06-09T11:11:45.105 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d015d740 con 0x7f21d0070890 2023-06-09T11:11:45.105 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21c6ffd700 1 -- 172.21.15.187:0/4062507677 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0276c0 con 0x7f21d0070890 2023-06-09T11:11:45.105 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d015d460 con 0x7f21d0070890 2023-06-09T11:11:45.105 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21c6ffd700 1 -- 172.21.15.187:0/4062507677 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f21cc027b20 con 0x7f21d0070890 2023-06-09T11:11:45.106 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21c6ffd700 1 -- 172.21.15.187:0/4062507677 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f21cc022070 con 0x7f21d0070890 2023-06-09T11:11:45.106 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.094+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d015da20 con 0x7f21d0070890 2023-06-09T11:11:45.107 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.098+0000 7f21c6ffd700 1 -- 172.21.15.187:0/4062507677 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f21cc02c060 con 0x7f21d0070890 2023-06-09T11:11:45.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.178+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6", "id": 7} v 0) v1 -- 0x7f21d0067610 con 0x7f21d0070890 2023-06-09T11:11:45.199 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21c6ffd700 1 -- 172.21.15.187:0/4062507677 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f21cc012430 con 0x7f21d0070890 2023-06-09T11:11:45.200 INFO:teuthology.orchestra.run.smithi187.stdout:7 2023-06-09T11:11:45.201 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0070890 msgr2=0x7f21d014dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.201 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0070890 0x7f21d014dc30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21cc014040 tx=0x7f21cc004af0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.201 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 shutdown_connections 2023-06-09T11:11:45.201 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21d015a160 0x7f21d00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.201 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d00d26d0 0x7f21d01f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.201 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 --2- 172.21.15.187:0/4062507677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0070890 0x7f21d014dc30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.201 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 >> 172.21.15.187:0/4062507677 conn(0x7f21d00cf930 msgr2=0x7f21d00d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:45.202 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 shutdown_connections 2023-06-09T11:11:45.202 INFO:teuthology.orchestra.run.smithi187.stderr:2023-06-09T11:11:45.190+0000 7f21d7107700 1 -- 172.21.15.187:0/4062507677 wait complete. 2023-06-09T11:11:45.218 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-09T11:11:45.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-09T11:11:45.225 INFO:tasks.ceph.osd.0:Started 2023-06-09T11:11:45.225 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-09T11:11:45.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-09T11:11:45.229 INFO:tasks.ceph.osd.1:Started 2023-06-09T11:11:45.230 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-09T11:11:45.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-09T11:11:45.234 INFO:tasks.ceph.osd.2:Started 2023-06-09T11:11:45.234 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-09T11:11:45.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-09T11:11:45.240 INFO:tasks.ceph.osd.3:Started 2023-06-09T11:11:45.241 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-09T11:11:45.241 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-09T11:11:45.248 INFO:tasks.ceph.osd.4:Started 2023-06-09T11:11:45.248 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-09T11:11:45.248 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-09T11:11:45.253 INFO:tasks.ceph.osd.5:Started 2023-06-09T11:11:45.253 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-09T11:11:45.253 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-09T11:11:45.258 INFO:tasks.ceph.osd.6:Started 2023-06-09T11:11:45.258 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-09T11:11:45.258 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-09T11:11:45.264 INFO:tasks.ceph.osd.7:Started 2023-06-09T11:11:45.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:11:45.327 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:45.317+0000 7f89c57022c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T11:11:45.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.441+0000 7f1843fff700 1 Processor -- start 2023-06-09T11:11:45.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.441+0000 7f1843fff700 1 -- start start 2023-06-09T11:11:45.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1843fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f184415c790 0x7f184406f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1843fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1843fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18440711d0 con 0x7f184415dbf0 2023-06-09T11:11:45.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1843fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184415cf40 con 0x7f184415c790 2023-06-09T11:11:45.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1843fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184406ff60 con 0x7f18440cfa00 2023-06-09T11:11:45.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1842ffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f184415c790 0x7f184406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:48848/0 (socket says 172.21.15.78:48848) 2023-06-09T11:11:45.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1842ffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f184415c790 0x7f184406f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:44504/0 (socket says 172.21.15.78:44504) 2023-06-09T11:11:45.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 -- 172.21.15.78:0/1023032015 learned_addr learned my addr 172.21.15.78:0/1023032015 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:11:45.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 -- 172.21.15.78:0/1023032015 >> v2:172.21.15.187:3300/0 conn(0x7f184415c790 msgr2=0x7f184406f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:45.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 --2- 172.21.15.78:0/1023032015 >> v2:172.21.15.187:3300/0 conn(0x7f184415c790 0x7f184406f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 -- 172.21.15.78:0/1023032015 >> v1:172.21.15.187:6789/0 conn(0x7f184415dbf0 legacy=0x7f184406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 -- 172.21.15.78:0/1023032015 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844070240 con 0x7f18440cfa00 2023-06-09T11:11:45.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f183bfff700 1 --2- 172.21.15.78:0/1023032015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415d6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f182c00bbb0 tx=0x7f182c00bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85cf9e35ec37728 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:45.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f18427fc700 1 -- 172.21.15.78:0/1023032015 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c00dd30 con 0x7f18440cfa00 2023-06-09T11:11:45.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f18427fc700 1 -- 172.21.15.78:0/1023032015 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c00de90 con 0x7f18440cfa00 2023-06-09T11:11:45.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f18427fc700 1 -- 172.21.15.78:0/1023032015 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c010690 con 0x7f18440cfa00 2023-06-09T11:11:45.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1843fff700 1 -- 172.21.15.78:0/1023032015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 msgr2=0x7f184415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.445+0000 7f1843fff700 1 --2- 172.21.15.78:0/1023032015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415d6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f182c00bbb0 tx=0x7f182c00bec0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 -- 172.21.15.78:0/1023032015 shutdown_connections 2023-06-09T11:11:45.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 --2- 172.21.15.78:0/1023032015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415d6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 --2- 172.21.15.78:0/1023032015 >> v2:172.21.15.187:3300/0 conn(0x7f184415c790 0x7f184406f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 -- 172.21.15.78:0/1023032015 >> 172.21.15.78:0/1023032015 conn(0x7f18440cc530 msgr2=0x7f18440cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 -- 172.21.15.78:0/1023032015 shutdown_connections 2023-06-09T11:11:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 -- 172.21.15.78:0/1023032015 wait complete. 2023-06-09T11:11:45.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 Processor -- start 2023-06-09T11:11:45.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 -- start start 2023-06-09T11:11:45.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.449+0000 7f1843fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f184415c790 0x7f18440c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184415dbf0 0x7f1844150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440c2cf0 con 0x7f184415dbf0 2023-06-09T11:11:45.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440c2f50 con 0x7f184415c790 2023-06-09T11:11:45.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440c3230 con 0x7f18440cfa00 2023-06-09T11:11:45.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184415dbf0 0x7f1844150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1842ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184415dbf0 0x7f1844150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51786/0 (socket says 172.21.15.78:51786) 2023-06-09T11:11:45.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 -- 172.21.15.78:0/3766376751 learned_addr learned my addr 172.21.15.78:0/3766376751 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:11:45.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f183bfff700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f184415c790 0x7f18440c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:45.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 -- 172.21.15.78:0/3766376751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 msgr2=0x7f184415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 -- 172.21.15.78:0/3766376751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f184415c790 msgr2=0x7f18440c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f184415c790 0x7f18440c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 -- 172.21.15.78:0/3766376751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c00b810 con 0x7f184415dbf0 2023-06-09T11:11:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f18437fe700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184415dbf0 0x7f1844150180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f183c00cbc0 tx=0x7f183c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f183b7fe700 1 -- 172.21.15.78:0/3766376751 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c003c20 con 0x7f184415dbf0 2023-06-09T11:11:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f183b7fe700 1 -- 172.21.15.78:0/3766376751 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c003d80 con 0x7f184415dbf0 2023-06-09T11:11:45.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f183b7fe700 1 -- 172.21.15.78:0/3766376751 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00aa20 con 0x7f184415dbf0 2023-06-09T11:11:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184415d190 con 0x7f184415dbf0 2023-06-09T11:11:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1844070520 con 0x7f184415dbf0 2023-06-09T11:11:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f183b7fe700 1 -- 172.21.15.78:0/3766376751 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f183c0050d0 con 0x7f184415dbf0 2023-06-09T11:11:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f183b7fe700 1 -- 172.21.15.78:0/3766376751 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f183c012510 con 0x7f184415dbf0 2023-06-09T11:11:45.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.453+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184415cb60 con 0x7f184415dbf0 2023-06-09T11:11:45.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.461+0000 7f183b7fe700 1 -- 172.21.15.78:0/3766376751 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f183c005380 con 0x7f184415dbf0 2023-06-09T11:11:45.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.529+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f184406ec40 con 0x7f184415dbf0 2023-06-09T11:11:45.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f183b7fe700 1 -- 172.21.15.78:0/3766376751 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f183c005520 con 0x7f184415dbf0 2023-06-09T11:11:45.542 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:11:45.542 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:11:45.185617+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:11:45.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184415dbf0 msgr2=0x7f1844150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:45.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184415dbf0 0x7f1844150180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f183c00cbc0 tx=0x7f183c00ced0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 shutdown_connections 2023-06-09T11:11:45.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f184415dbf0 0x7f1844150180 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f184415c790 0x7f18440c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 --2- 172.21.15.78:0/3766376751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18440cfa00 0x7f184415b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 >> 172.21.15.78:0/3766376751 conn(0x7f18440cc530 msgr2=0x7f18440cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 shutdown_connections 2023-06-09T11:11:45.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:11:45.533+0000 7f1843fff700 1 -- 172.21.15.78:0/3766376751 wait complete. 2023-06-09T11:11:45.561 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-09T11:11:45.562 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-09T11:11:45.567 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:45.557+0000 7f89c57022c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T11:11:45.657 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:45.645+0000 7f89c57022c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T11:11:45.736 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:45.725+0000 7f89c57022c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T11:11:45.844 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:45.834+0000 7fb4693c22c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T11:11:45.907 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T11:11:45.897+0000 7f2cce8f2700 -1 Falling back to public interface 2023-06-09T11:11:45.909 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T11:11:45.897+0000 7f90519ec700 -1 Falling back to public interface 2023-06-09T11:11:45.920 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T11:11:45.909+0000 7f53fac43700 -1 Falling back to public interface 2023-06-09T11:11:45.921 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T11:11:45.909+0000 7f9d0bfba700 -1 Falling back to public interface 2023-06-09T11:11:45.926 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T11:11:45.914+0000 7f4a48084700 -1 Falling back to public interface 2023-06-09T11:11:45.941 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:45.930+0000 7fb4693c22c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T11:11:45.953 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T11:11:45.942+0000 7fbd10c72700 -1 Falling back to public interface 2023-06-09T11:11:45.954 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T11:11:45.942+0000 7f2dd501a700 -1 Falling back to public interface 2023-06-09T11:11:45.963 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T11:11:45.954+0000 7fbd0fc3d700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6821/0: (98) Address already in use 2023-06-09T11:11:45.964 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T11:11:45.954+0000 7f87af78a700 -1 Falling back to public interface 2023-06-09T11:11:46.134 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:46.122+0000 7fb4693c22c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T11:11:46.221 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:46.210+0000 7fb4693c22c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T11:11:46.322 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:46.310+0000 7fb4693c22c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T11:11:46.369 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T11:11:46.518 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc99616700 1 Processor -- start 2023-06-09T11:11:46.518 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc99616700 1 -- start start 2023-06-09T11:11:46.520 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc99616700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbc9415c7b0 0x7fbc940d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:46.520 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc99616700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9415cb80 con 0x7fbc940d2750 2023-06-09T11:11:46.520 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc99616700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc940d1310 con 0x7fbc940c8430 2023-06-09T11:11:46.520 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc99616700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc940cd590 con 0x7fbc9415c7b0 2023-06-09T11:11:46.523 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc927fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbc940d2750 0x7fbc940c7d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33072/0 (socket says 172.21.15.78:33072) 2023-06-09T11:11:46.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc927fc700 1 -- 172.21.15.78:0/488816399 learned_addr learned my addr 172.21.15.78:0/488816399 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:11:46.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc92ffd700 1 --2- 172.21.15.78:0/488816399 >> v2:172.21.15.187:3300/0 conn(0x7fbc9415c7b0 0x7fbc940d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:46.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc91ffb700 1 -- 172.21.15.78:0/488816399 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402826768 0 0) 0x7fbc9415cb80 con 0x7fbc940d2750 2023-06-09T11:11:46.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc91ffb700 1 -- 172.21.15.78:0/488816399 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc7c0035d0 con 0x7fbc940d2750 2023-06-09T11:11:46.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.509+0000 7fbc92ffd700 1 -- 172.21.15.78:0/488816399 >> v1:172.21.15.187:6789/0 conn(0x7fbc940c8430 legacy=0x7fbc940cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:46.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc92ffd700 1 -- 172.21.15.78:0/488816399 >> v1:172.21.15.78:6789/0 conn(0x7fbc940d2750 legacy=0x7fbc940c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc92ffd700 1 -- 172.21.15.78:0/488816399 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940d15f0 con 0x7fbc9415c7b0 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc92ffd700 1 --2- 172.21.15.78:0/488816399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9415c7b0 0x7fbc940d0a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009850 tx=0x7fbc84009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1762da38587431b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc91ffb700 1 -- 172.21.15.78:0/488816399 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84011830 con 0x7fbc9415c7b0 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc91ffb700 1 -- 172.21.15.78:0/488816399 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc84011990 con 0x7fbc9415c7b0 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc91ffb700 1 -- 172.21.15.78:0/488816399 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84011d40 con 0x7fbc9415c7b0 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc99616700 1 -- 172.21.15.78:0/488816399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9415c7b0 msgr2=0x7fbc940d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc99616700 1 --2- 172.21.15.78:0/488816399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9415c7b0 0x7fbc940d0a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009850 tx=0x7fbc84009b60 comp rx=0 tx=0).stop 2023-06-09T11:11:46.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc99616700 1 -- 172.21.15.78:0/488816399 shutdown_connections 2023-06-09T11:11:46.526 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc99616700 1 --2- 172.21.15.78:0/488816399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9415c7b0 0x7fbc940d0a10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:46.526 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc99616700 1 -- 172.21.15.78:0/488816399 >> 172.21.15.78:0/488816399 conn(0x7fbc940b4ab0 msgr2=0x7fbc940b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:46.526 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc99616700 1 -- 172.21.15.78:0/488816399 shutdown_connections 2023-06-09T11:11:46.526 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.513+0000 7fbc99616700 1 -- 172.21.15.78:0/488816399 wait complete. 2023-06-09T11:11:46.527 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 Processor -- start 2023-06-09T11:11:46.527 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 -- start start 2023-06-09T11:11:46.528 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc940c8430 0x7fbc94151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:46.528 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc940d2750 0x7fbc9415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:46.528 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9415c7b0 0x7fbc9415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:46.528 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9415ed00 con 0x7fbc940c8430 2023-06-09T11:11:46.528 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9415ea20 con 0x7fbc940d2750 2023-06-09T11:11:46.528 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc99616700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9415ceb0 con 0x7fbc9415c7b0 2023-06-09T11:11:46.529 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc940c8430 0x7fbc94151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:46.529 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc940c8430 0x7fbc94151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51796/0 (socket says 172.21.15.78:51796) 2023-06-09T11:11:46.529 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 -- 172.21.15.78:0/3352200098 learned_addr learned my addr 172.21.15.78:0/3352200098 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:11:46.530 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc927fc700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc940d2750 0x7fbc9415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:46.530 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc937fe700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9415c7b0 0x7fbc9415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:46.530 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 -- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9415c7b0 msgr2=0x7fbc9415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9415c7b0 0x7fbc9415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 -- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc940d2750 msgr2=0x7fbc9415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc940d2750 0x7fbc9415d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 -- 172.21.15.78:0/3352200098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840094b0 con 0x7fbc940c8430 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.517+0000 7fbc92ffd700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc940c8430 0x7fbc94151240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc84000c00 tx=0x7fbc84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc7b7fe700 1 -- 172.21.15.78:0/3352200098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8401aac0 con 0x7fbc940c8430 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc7b7fe700 1 -- 172.21.15.78:0/3352200098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8401f070 con 0x7fbc940c8430 2023-06-09T11:11:46.531 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc7b7fe700 1 -- 172.21.15.78:0/3352200098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8401ae60 con 0x7fbc940c8430 2023-06-09T11:11:46.532 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc940d1bb0 con 0x7fbc940c8430 2023-06-09T11:11:46.532 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc940d18d0 con 0x7fbc940c8430 2023-06-09T11:11:46.532 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc7b7fe700 1 -- 172.21.15.78:0/3352200098 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbc8401b730 con 0x7fbc940c8430 2023-06-09T11:11:46.532 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc7b7fe700 1 -- 172.21.15.78:0/3352200098 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbc84025df0 con 0x7fbc940c8430 2023-06-09T11:11:46.532 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.521+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc940d0f50 con 0x7fbc940c8430 2023-06-09T11:11:46.537 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.525+0000 7fbc7b7fe700 1 -- 172.21.15.78:0/3352200098 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fbc84033060 con 0x7fbc940c8430 2023-06-09T11:11:46.547 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:46.538+0000 7fb4693c22c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T11:11:46.607 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.597+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc9415cd10 con 0x7fbc940c8430 2023-06-09T11:11:46.609 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.597+0000 7fbc7b7fe700 1 -- 172.21.15.78:0/3352200098 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbc9415cd10 con 0x7fbc940c8430 2023-06-09T11:11:46.610 INFO:teuthology.misc.health.smithi078.stdout: 2023-06-09T11:11:46.610 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:11:45.185617+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:11:46.611 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc940c8430 msgr2=0x7fbc94151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:46.611 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc940c8430 0x7fbc94151240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc84000c00 tx=0x7fbc84004770 comp rx=0 tx=0).stop 2023-06-09T11:11:46.611 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 shutdown_connections 2023-06-09T11:11:46.611 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9415c7b0 0x7fbc9415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:46.612 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc940d2750 0x7fbc9415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:46.612 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 --2- 172.21.15.78:0/3352200098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc940c8430 0x7fbc94151240 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:46.612 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 >> 172.21.15.78:0/3352200098 conn(0x7fbc940b4ab0 msgr2=0x7fbc940b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:46.612 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 shutdown_connections 2023-06-09T11:11:46.612 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:46.601+0000 7fbc99616700 1 -- 172.21.15.78:0/3352200098 wait complete. 2023-06-09T11:11:46.628 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T11:11:46.682 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:46.673+0000 7f89c57022c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T11:11:46.770 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:46.761+0000 7f89c57022c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T11:11:46.813 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:46.802+0000 7fb4693c22c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T11:11:46.943 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:46.933+0000 7f89c57022c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T11:11:47.031 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:47.021+0000 7f89c57022c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T11:11:47.129 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:47.117+0000 7f89c57022c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T11:11:47.353 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:47.341+0000 7f89c57022c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T11:11:47.582 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:47.570+0000 7fb4693c22c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T11:11:47.613 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:47.601+0000 7f89c57022c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T11:11:48.377 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-09T11:11:48.365+0000 7f89c57022c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T11:11:48.628 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-06-09T11:11:48.618+0000 7fb45067f700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-09T11:11:49.859 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T11:11:49.850+0000 7f4a48084700 -1 osd.6 0 log_to_monitors true 2023-06-09T11:11:49.928 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T11:11:49.918+0000 7fbd10c72700 -1 osd.7 0 log_to_monitors true 2023-06-09T11:11:49.976 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T11:11:49.966+0000 7f87af78a700 -1 osd.5 0 log_to_monitors true 2023-06-09T11:11:50.041 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T11:11:50.030+0000 7f2dd501a700 -1 osd.4 0 log_to_monitors true 2023-06-09T11:11:50.129 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T11:11:50.117+0000 7f9d0bfba700 -1 osd.2 0 log_to_monitors true 2023-06-09T11:11:50.176 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T11:11:50.165+0000 7f2cce8f2700 -1 osd.0 0 log_to_monitors true 2023-06-09T11:11:50.179 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T11:11:50.169+0000 7f90519ec700 -1 osd.3 0 log_to_monitors true 2023-06-09T11:11:50.239 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T11:11:50.229+0000 7f53fac43700 -1 osd.1 0 log_to_monitors true 2023-06-09T11:11:53.435 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T11:11:53.642 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f128dc34700 1 Processor -- start 2023-06-09T11:11:53.643 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f128dc34700 1 -- start start 2023-06-09T11:11:53.643 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f128dc34700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12800e6d20 0x7f1280005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:53.643 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f12877fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12800e6d20 0x7f1280005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:53.644 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f12877fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12800e6d20 0x7f1280005f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51834/0 (socket says 172.21.15.78:51834) 2023-06-09T11:11:53.644 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f128dc34700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f12800e70f0 0x7f1280033f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:53.644 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f12877fe700 1 -- 172.21.15.78:0/1439051807 learned_addr learned my addr 172.21.15.78:0/1439051807 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:11:53.644 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1280006eb0 con 0x7f1280036630 2023-06-09T11:11:53.645 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1280034440 con 0x7f12800e6d20 2023-06-09T11:11:53.645 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.633+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1280006610 con 0x7f12800e70f0 2023-06-09T11:11:53.645 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12877fe700 1 -- 172.21.15.78:0/1439051807 >> v2:172.21.15.187:3300/0 conn(0x7f12800e70f0 msgr2=0x7f1280033f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:53.645 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12877fe700 1 --2- 172.21.15.78:0/1439051807 >> v2:172.21.15.187:3300/0 conn(0x7f12800e70f0 0x7f1280033f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:53.645 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12877fe700 1 -- 172.21.15.78:0/1439051807 >> v1:172.21.15.78:6789/0 conn(0x7f1280036630 legacy=0x7f1280036a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:11:53.646 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12877fe700 1 -- 172.21.15.78:0/1439051807 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800068f0 con 0x7f12800e6d20 2023-06-09T11:11:53.646 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12877fe700 1 --2- 172.21.15.78:0/1439051807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f1280005f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12800345e0 tx=0x7f128804eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ba55c115c26d8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:53.647 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12867fc700 1 -- 172.21.15.78:0/1439051807 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288070ca0 con 0x7f12800e6d20 2023-06-09T11:11:53.647 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12867fc700 1 -- 172.21.15.78:0/1439051807 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128808d070 con 0x7f12800e6d20 2023-06-09T11:11:53.647 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f12867fc700 1 -- 172.21.15.78:0/1439051807 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128804e4b0 con 0x7f12800e6d20 2023-06-09T11:11:53.647 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 msgr2=0x7f1280005f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:53.648 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 --2- 172.21.15.78:0/1439051807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f1280005f80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12800345e0 tx=0x7f128804eb50 comp rx=0 tx=0).stop 2023-06-09T11:11:53.648 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 shutdown_connections 2023-06-09T11:11:53.648 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 --2- 172.21.15.78:0/1439051807 >> v2:172.21.15.187:3300/0 conn(0x7f12800e70f0 0x7f1280033f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:53.648 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 --2- 172.21.15.78:0/1439051807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f1280005f80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:53.649 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 >> 172.21.15.78:0/1439051807 conn(0x7f1280051630 msgr2=0x7f1280051a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:53.649 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 shutdown_connections 2023-06-09T11:11:53.651 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.637+0000 7f128dc34700 1 -- 172.21.15.78:0/1439051807 wait complete. 2023-06-09T11:11:53.651 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.641+0000 7f128dc34700 1 Processor -- start 2023-06-09T11:11:53.651 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.641+0000 7f128dc34700 1 -- start start 2023-06-09T11:11:53.651 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f128dc34700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1280036630 0x7f12800d8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:53.652 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f128dc34700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f12800e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:53.652 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f12877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1280036630 0x7f12800d8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:53.652 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f12877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1280036630 0x7f12800d8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:44604/0 (socket says 172.21.15.78:44604) 2023-06-09T11:11:53.652 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f12800e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:53.652 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f12800e5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51838/0 (socket says 172.21.15.78:51838) 2023-06-09T11:11:53.653 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f128dc34700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12800e70f0 0x7f12800e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:53.653 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f12877fe700 1 -- 172.21.15.78:0/1539469966 learned_addr learned my addr 172.21.15.78:0/1539469966 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:11:53.653 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f128dc34700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12800da360 con 0x7f12800e6d20 2023-06-09T11:11:53.653 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f128dc34700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12800d8f40 con 0x7f1280036630 2023-06-09T11:11:53.654 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f128dc34700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12800d92c0 con 0x7f12800e70f0 2023-06-09T11:11:53.654 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1287fff700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12800e70f0 0x7f12800e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:53.655 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 -- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12800e70f0 msgr2=0x7f12800e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:53.656 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12800e70f0 0x7f12800e63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:53.656 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 -- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1280036630 msgr2=0x7f12800d8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:53.656 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1280036630 0x7f12800d8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:53.656 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128804e9c0 con 0x7f12800e6d20 2023-06-09T11:11:53.657 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1287fff700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12800e70f0 0x7f12800e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:11:53.657 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f12877fe700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1280036630 0x7f12800d8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:11:53.657 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1286ffd700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f12800e5e60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f127c00b3c0 tx=0x7f127c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:53.657 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1273fff700 1 -- 172.21.15.78:0/1539469966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c011620 con 0x7f12800e6d20 2023-06-09T11:11:53.658 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.645+0000 7f1273fff700 1 -- 172.21.15.78:0/1539469966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c011780 con 0x7f12800e6d20 2023-06-09T11:11:53.658 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.649+0000 7f1273fff700 1 -- 172.21.15.78:0/1539469966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c011b30 con 0x7f12800e6d20 2023-06-09T11:11:53.661 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.649+0000 7f128dc34700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1280052a50 con 0x7f12800e6d20 2023-06-09T11:11:53.661 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.649+0000 7f128dc34700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1280006bd0 con 0x7f12800e6d20 2023-06-09T11:11:53.662 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.653+0000 7f1273fff700 1 -- 172.21.15.78:0/1539469966 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f127c011c90 con 0x7f12800e6d20 2023-06-09T11:11:53.662 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.653+0000 7f1273fff700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f126c066260 0x7f126c068710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:11:53.662 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.653+0000 7f1273fff700 1 -- 172.21.15.78:0/1539469966 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f127c082b20 con 0x7f12800e6d20 2023-06-09T11:11:53.663 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.657+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1260005310 con 0x7f12800e6d20 2023-06-09T11:11:53.670 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.657+0000 7f12877fe700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f126c066260 0x7f126c068710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:11:53.671 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.657+0000 7f12877fe700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f126c066260 0x7f126c068710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1288063b50 tx=0x7f1288072000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:11:53.671 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.665+0000 7f1273fff700 1 -- 172.21.15.78:0/1539469966 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f127c015080 con 0x7f12800e6d20 2023-06-09T11:11:53.987 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T11:11:53.978+0000 7fbd0dc39700 -1 osd.7 0 waiting for initial osdmap 2023-06-09T11:11:53.997 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T11:11:53.986+0000 7fbd043f1700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:54.003 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.997+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12600055c0 con 0x7f12800e6d20 2023-06-09T11:11:54.004 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:53.997+0000 7f1273fff700 1 -- 172.21.15.78:0/1539469966 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f127c050ed0 con 0x7f12800e6d20 2023-06-09T11:11:54.006 INFO:teuthology.misc.health.smithi078.stdout: 2023-06-09T11:11:54.006 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":12,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:11:51.631261+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:11:54.007 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T11:11:53.998+0000 7f4a4504b700 -1 osd.6 0 waiting for initial osdmap 2023-06-09T11:11:54.010 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.005+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f126c066260 msgr2=0x7f126c068710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:54.011 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.005+0000 7f1271ffb700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f126c066260 0x7f126c068710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1288063b50 tx=0x7f1288072000 comp rx=0 tx=0).stop 2023-06-09T11:11:54.012 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.005+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 msgr2=0x7f12800e5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:11:54.012 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.005+0000 7f1271ffb700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f12800e5e60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f127c00b3c0 tx=0x7f127c00b6d0 comp rx=0 tx=0).stop 2023-06-09T11:11:54.012 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.005+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 shutdown_connections 2023-06-09T11:11:54.014 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.005+0000 7f1271ffb700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f126c066260 0x7f126c068710 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:54.015 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.009+0000 7f1271ffb700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12800e70f0 0x7f12800e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:54.015 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.009+0000 7f1271ffb700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12800e6d20 0x7f12800e5e60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:54.015 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.009+0000 7f1271ffb700 1 --2- 172.21.15.78:0/1539469966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1280036630 0x7f12800d8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:11:54.015 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.009+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 >> 172.21.15.78:0/1539469966 conn(0x7f1280051630 msgr2=0x7f1280005810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:11:54.015 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.009+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 shutdown_connections 2023-06-09T11:11:54.016 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:11:54.009+0000 7f1271ffb700 1 -- 172.21.15.78:0/1539469966 wait complete. 2023-06-09T11:11:54.018 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T11:11:54.006+0000 7f4a3b7f1700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:54.039 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T11:11:54.030+0000 7f2dd1fe1700 -1 osd.4 0 waiting for initial osdmap 2023-06-09T11:11:54.049 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T11:11:54.054 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T11:11:54.042+0000 7f2dc87f1700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:54.112 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T11:11:54.102+0000 7f87aada6700 -1 osd.5 0 waiting for initial osdmap 2023-06-09T11:11:54.126 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T11:11:54.114+0000 7f87a2ff1700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:54.222 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T11:11:54.217+0000 7f9d075d6700 -1 osd.2 0 waiting for initial osdmap 2023-06-09T11:11:54.224 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T11:11:54.217+0000 7f53f625f700 -1 osd.1 0 waiting for initial osdmap 2023-06-09T11:11:54.231 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T11:11:54.225+0000 7f9cff7f1700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:54.233 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T11:11:54.225+0000 7f53ee3f1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:54.245 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T11:11:54.237+0000 7f2cc9f0e700 -1 osd.0 0 waiting for initial osdmap 2023-06-09T11:11:54.253 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T11:11:54.245+0000 7f2cc1ff1700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:54.257 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T11:11:54.249+0000 7f904d008700 -1 osd.3 0 waiting for initial osdmap 2023-06-09T11:11:54.266 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T11:11:54.261+0000 7f90451f1700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T11:11:55.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:55.603 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:00.855 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:01.016 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.008+0000 7f6e7dc34700 1 Processor -- start 2023-06-09T11:12:01.017 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.008+0000 7f6e7dc34700 1 -- start start 2023-06-09T11:12:01.020 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e7dc34700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e780cc6b0 0x7f6e780ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.020 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e7dc34700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e7806f920 0x7f6e7806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.021 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e7dc34700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780cf200 con 0x7f6e7815a820 2023-06-09T11:12:01.021 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e7dc34700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e78065cb0 con 0x7f6e780cc6b0 2023-06-09T11:12:01.021 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e7dc34700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780702a0 con 0x7f6e7806f920 2023-06-09T11:12:01.022 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e6ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e780cc6b0 0x7f6e780ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.022 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e6ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e780cc6b0 0x7f6e780ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37054/0 (socket says 172.21.15.78:37054) 2023-06-09T11:12:01.022 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e6ffff700 1 -- 172.21.15.78:0/573834736 learned_addr learned my addr 172.21.15.78:0/573834736 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:01.022 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e77fff700 1 --2- 172.21.15.78:0/573834736 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806f920 0x7f6e7806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.023 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.012+0000 7f6e6ffff700 1 -- 172.21.15.78:0/573834736 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806f920 msgr2=0x7f6e7806fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:01.023 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e6ffff700 1 --2- 172.21.15.78:0/573834736 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806f920 0x7f6e7806fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.023 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e6ffff700 1 -- 172.21.15.78:0/573834736 >> v1:172.21.15.187:6789/0 conn(0x7f6e7815a820 legacy=0x7f6e780af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:01.023 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e6ffff700 1 -- 172.21.15.78:0/573834736 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780ccb40 con 0x7f6e780cc6b0 2023-06-09T11:12:01.023 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e6ffff700 1 --2- 172.21.15.78:0/573834736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e780ae870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e7815e2c0 tx=0x7f6e60009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abbdc91dc2cd547 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:01.024 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e76ffd700 1 -- 172.21.15.78:0/573834736 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000b8a0 con 0x7f6e780cc6b0 2023-06-09T11:12:01.024 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e76ffd700 1 -- 172.21.15.78:0/573834736 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6000ba00 con 0x7f6e780cc6b0 2023-06-09T11:12:01.024 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e76ffd700 1 -- 172.21.15.78:0/573834736 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000bd90 con 0x7f6e780cc6b0 2023-06-09T11:12:01.024 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 -- 172.21.15.78:0/573834736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 msgr2=0x7f6e780ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.025 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/573834736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e780ae870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e7815e2c0 tx=0x7f6e60009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.025 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 -- 172.21.15.78:0/573834736 shutdown_connections 2023-06-09T11:12:01.025 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/573834736 >> v2:172.21.15.187:3300/0 conn(0x7f6e7806f920 0x7f6e7806fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.025 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/573834736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e780ae870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.025 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 -- 172.21.15.78:0/573834736 >> 172.21.15.78:0/573834736 conn(0x7f6e780b2370 msgr2=0x7f6e780b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:01.025 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 -- 172.21.15.78:0/573834736 shutdown_connections 2023-06-09T11:12:01.025 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.016+0000 7f6e7dc34700 1 -- 172.21.15.78:0/573834736 wait complete. 2023-06-09T11:12:01.027 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 Processor -- start 2023-06-09T11:12:01.027 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 -- start start 2023-06-09T11:12:01.029 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806f920 0x7f6e781f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.030 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e781f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.030 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7815a820 0x7f6e780b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.030 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781f3020 con 0x7f6e780cc6b0 2023-06-09T11:12:01.030 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781f24a0 con 0x7f6e7815a820 2023-06-09T11:12:01.031 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.020+0000 7f6e7dc34700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781f2780 con 0x7f6e7806f920 2023-06-09T11:12:01.032 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e781f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.032 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e781f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37058/0 (socket says 172.21.15.78:37058) 2023-06-09T11:12:01.032 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 -- 172.21.15.78:0/2203164928 learned_addr learned my addr 172.21.15.78:0/2203164928 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:01.032 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e77fff700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7815a820 0x7f6e780b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.033 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e777fe700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806f920 0x7f6e781f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.033 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 -- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806f920 msgr2=0x7f6e781f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.033 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806f920 0x7f6e781f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.033 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 -- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7815a820 msgr2=0x7f6e780b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.033 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7815a820 0x7f6e780b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.033 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 -- 172.21.15.78:0/2203164928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009570 con 0x7f6e780cc6b0 2023-06-09T11:12:01.033 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e6ffff700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e781f1e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e780ccfa0 tx=0x7f6e60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:01.034 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e74ff9700 1 -- 172.21.15.78:0/2203164928 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600038c0 con 0x7f6e780cc6b0 2023-06-09T11:12:01.034 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e74ff9700 1 -- 172.21.15.78:0/2203164928 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6001f070 con 0x7f6e780cc6b0 2023-06-09T11:12:01.034 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e74ff9700 1 -- 172.21.15.78:0/2203164928 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60003c60 con 0x7f6e780cc6b0 2023-06-09T11:12:01.034 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e780661e0 con 0x7f6e780cc6b0 2023-06-09T11:12:01.034 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.024+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e78065f00 con 0x7f6e780cc6b0 2023-06-09T11:12:01.035 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.028+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7815abf0 con 0x7f6e780cc6b0 2023-06-09T11:12:01.035 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.028+0000 7f6e74ff9700 1 -- 172.21.15.78:0/2203164928 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e60026480 con 0x7f6e780cc6b0 2023-06-09T11:12:01.038 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.028+0000 7f6e74ff9700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e580662f0 0x7f6e580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.038 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.032+0000 7f6e74ff9700 1 -- 172.21.15.78:0/2203164928 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e60021070 con 0x7f6e780cc6b0 2023-06-09T11:12:01.038 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.032+0000 7f6e777fe700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e580662f0 0x7f6e580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.039 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.032+0000 7f6e777fe700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e580662f0 0x7f6e580687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6e680016e0 tx=0x7f6e68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:01.045 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.036+0000 7f6e74ff9700 1 -- 172.21.15.78:0/2203164928 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6e60052d80 con 0x7f6e780cc6b0 2023-06-09T11:12:01.223 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.216+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e780ccff0 con 0x7f6e780cc6b0 2023-06-09T11:12:01.225 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e74ff9700 1 -- 172.21.15.78:0/2203164928 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f6e780ccff0 con 0x7f6e780cc6b0 2023-06-09T11:12:01.226 INFO:teuthology.misc.health.smithi078.stdout: 2023-06-09T11:12:01.226 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":16,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:11:58.033971+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:01.228 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e580662f0 msgr2=0x7f6e580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.228 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e580662f0 0x7f6e580687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6e680016e0 tx=0x7f6e68009040 comp rx=0 tx=0).stop 2023-06-09T11:12:01.229 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 msgr2=0x7f6e781f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.229 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e781f1e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e780ccfa0 tx=0x7f6e60004770 comp rx=0 tx=0).stop 2023-06-09T11:12:01.229 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 shutdown_connections 2023-06-09T11:12:01.230 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e580662f0 0x7f6e580687a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.230 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e7815a820 0x7f6e780b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.230 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e780cc6b0 0x7f6e781f1e10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.230 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 --2- 172.21.15.78:0/2203164928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e7806f920 0x7f6e781f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.230 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 >> 172.21.15.78:0/2203164928 conn(0x7f6e780b2370 msgr2=0x7f6e780af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:01.230 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 shutdown_connections 2023-06-09T11:12:01.230 INFO:teuthology.misc.health.smithi078.stderr:2023-06-09T11:12:01.220+0000 7f6e7dc34700 1 -- 172.21.15.78:0/2203164928 wait complete. 2023-06-09T11:12:01.247 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-09T11:12:01.247 INFO:tasks.ceph:Creating RBD pool 2023-06-09T11:12:01.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-09T11:12:01.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6bae6f700 1 Processor -- start 2023-06-09T11:12:01.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6bae6f700 1 -- start start 2023-06-09T11:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6bae6f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6b4146c50 0x7fc6b40b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6bae6f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4161610 0x7fc6b406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6bae6f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b406a070 con 0x7fc6b406b6e0 2023-06-09T11:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6bae6f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b406a310 con 0x7fc6b4146c50 2023-06-09T11:12:01.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6bae6f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b406a5f0 con 0x7fc6b4161610 2023-06-09T11:12:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6b9e6d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6b4146c50 0x7fc6b40b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6b9e6d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6b4146c50 0x7fc6b40b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37066/0 (socket says 172.21.15.78:37066) 2023-06-09T11:12:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.408+0000 7fc6b9e6d700 1 -- 172.21.15.78:0/3138820580 learned_addr learned my addr 172.21.15.78:0/3138820580 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:01.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b9e6d700 1 -- 172.21.15.78:0/3138820580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4161610 msgr2=0x7fc6b406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b9e6d700 1 --2- 172.21.15.78:0/3138820580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4161610 0x7fc6b406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b9e6d700 1 -- 172.21.15.78:0/3138820580 >> v1:172.21.15.78:6789/0 conn(0x7fc6b406b6e0 legacy=0x7fc6b4160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b9e6d700 1 -- 172.21.15.78:0/3138820580 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b406a8d0 con 0x7fc6b4146c50 2023-06-09T11:12:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b9e6d700 1 --2- 172.21.15.78:0/3138820580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4146c50 0x7fc6b40b2590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009910 tx=0x7fc6b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d13424f429beb0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b8e6b700 1 -- 172.21.15.78:0/3138820580 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0004230 con 0x7fc6b4146c50 2023-06-09T11:12:01.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b8e6b700 1 -- 172.21.15.78:0/3138820580 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0004390 con 0x7fc6b4146c50 2023-06-09T11:12:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6b8e6b700 1 -- 172.21.15.78:0/3138820580 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0009e60 con 0x7fc6b4146c50 2023-06-09T11:12:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 -- 172.21.15.78:0/3138820580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4146c50 msgr2=0x7fc6b40b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/3138820580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4146c50 0x7fc6b40b2590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009910 tx=0x7fc6b0009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 -- 172.21.15.78:0/3138820580 shutdown_connections 2023-06-09T11:12:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/3138820580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4161610 0x7fc6b406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/3138820580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4146c50 0x7fc6b40b2590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 -- 172.21.15.78:0/3138820580 >> 172.21.15.78:0/3138820580 conn(0x7fc6b40b0780 msgr2=0x7fc6b40b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 -- 172.21.15.78:0/3138820580 shutdown_connections 2023-06-09T11:12:01.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.412+0000 7fc6bae6f700 1 -- 172.21.15.78:0/3138820580 wait complete. 2023-06-09T11:12:01.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.416+0000 7fc6bae6f700 1 Processor -- start 2023-06-09T11:12:01.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.416+0000 7fc6bae6f700 1 -- start start 2023-06-09T11:12:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b406b6e0 0x7fc6b4145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4146c50 0x7fc6b41639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4161610 0x7fc6b4162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40ca400 con 0x7fc6b4161610 2023-06-09T11:12:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40c9880 con 0x7fc6b406b6e0 2023-06-09T11:12:01.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40c9b60 con 0x7fc6b4146c50 2023-06-09T11:12:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4161610 0x7fc6b4162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4161610 0x7fc6b4162e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37074/0 (socket says 172.21.15.78:37074) 2023-06-09T11:12:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 -- 172.21.15.78:0/2329647301 learned_addr learned my addr 172.21.15.78:0/2329647301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6b966c700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4146c50 0x7fc6b41639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6b9e6d700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b406b6e0 0x7fc6b4145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 -- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4146c50 msgr2=0x7fc6b41639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4146c50 0x7fc6b41639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 -- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b406b6e0 msgr2=0x7fc6b4145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b406b6e0 0x7fc6b4145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 -- 172.21.15.78:0/2329647301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009570 con 0x7fc6b4161610 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6ba66e700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4161610 0x7fc6b4162e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00b970 tx=0x7fc6ac00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6aa7fc700 1 -- 172.21.15.78:0/2329647301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac00c9b0 con 0x7fc6b4161610 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6aa7fc700 1 -- 172.21.15.78:0/2329647301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac00cb30 con 0x7fc6b4161610 2023-06-09T11:12:01.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b406b0d0 con 0x7fc6b4161610 2023-06-09T11:12:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6aa7fc700 1 -- 172.21.15.78:0/2329647301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac014440 con 0x7fc6b4161610 2023-06-09T11:12:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.420+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b406abb0 con 0x7fc6b4161610 2023-06-09T11:12:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.424+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b40b2ad0 con 0x7fc6b4161610 2023-06-09T11:12:01.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.424+0000 7fc6aa7fc700 1 -- 172.21.15.78:0/2329647301 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6ac01d3b0 con 0x7fc6b4161610 2023-06-09T11:12:01.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.424+0000 7fc6aa7fc700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc6980662f0 0x7fc6980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.424+0000 7fc6aa7fc700 1 -- 172.21.15.78:0/2329647301 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6ac083720 con 0x7fc6b4161610 2023-06-09T11:12:01.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.424+0000 7fc6b9e6d700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc6980662f0 0x7fc6980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:01.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.428+0000 7fc6b9e6d700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc6980662f0 0x7fc6980687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009910 tx=0x7fc6b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:01.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.432+0000 7fc6aa7fc700 1 -- 172.21.15.78:0/2329647301 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc6ac050f20 con 0x7fc6b4161610 2023-06-09T11:12:01.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:01.604+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc6b40c39f0 con 0x7fc6b4161610 2023-06-09T11:12:02.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.176+0000 7fc6aa7fc700 1 -- 172.21.15.78:0/2329647301 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc6b40c39f0 con 0x7fc6b4161610 2023-06-09T11:12:02.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc6980662f0 msgr2=0x7fc6980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:02.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc6980662f0 0x7fc6980687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009910 tx=0x7fc6b0008030 comp rx=0 tx=0).stop 2023-06-09T11:12:02.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4161610 msgr2=0x7fc6b4162e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:02.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4161610 0x7fc6b4162e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00b970 tx=0x7fc6ac00bd30 comp rx=0 tx=0).stop 2023-06-09T11:12:02.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 shutdown_connections 2023-06-09T11:12:02.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc6980662f0 0x7fc6980687a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:02.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b4161610 0x7fc6b4162e10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:02.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b4146c50 0x7fc6b41639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:02.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 --2- 172.21.15.78:0/2329647301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b406b6e0 0x7fc6b4145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 >> 172.21.15.78:0/2329647301 conn(0x7fc6b40b0780 msgr2=0x7fc6b40cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 shutdown_connections 2023-06-09T11:12:02.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.180+0000 7fc6bae6f700 1 -- 172.21.15.78:0/2329647301 wait complete. 2023-06-09T11:12:02.194 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'rbd' created 2023-06-09T11:12:02.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-09T11:12:02.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f4800898700 1 Processor -- start 2023-06-09T11:12:02.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f4800898700 1 -- start start 2023-06-09T11:12:02.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f4800898700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47fc0d0190 0x7f47fc0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:02.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f4800898700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0cc750 con 0x7f47fc15c720 2023-06-09T11:12:02.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f4800898700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0cbb40 con 0x7f47fc0cf6f0 2023-06-09T11:12:02.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f4800898700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc0cb950 con 0x7f47fc0d0190 2023-06-09T11:12:02.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f47fb7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f47fc15c720 0x7f47fc0cb240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58164/0 (socket says 172.21.15.78:58164) 2023-06-09T11:12:02.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f47fb7fe700 1 -- 172.21.15.78:0/482006404 learned_addr learned my addr 172.21.15.78:0/482006404 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:02.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.368+0000 7f47faffd700 1 --2- 172.21.15.78:0/482006404 >> v2:172.21.15.187:3300/0 conn(0x7f47fc0d0190 0x7f47fc0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47fa7fc700 1 -- 172.21.15.78:0/482006404 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542795672 0 0) 0x7f47fc0cc750 con 0x7f47fc15c720 2023-06-09T11:12:02.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47fa7fc700 1 -- 172.21.15.78:0/482006404 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e40035d0 con 0x7f47fc15c720 2023-06-09T11:12:02.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47faffd700 1 -- 172.21.15.78:0/482006404 >> v1:172.21.15.187:6789/0 conn(0x7f47fc0cf6f0 legacy=0x7f47fc0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:02.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47faffd700 1 -- 172.21.15.78:0/482006404 >> v1:172.21.15.78:6789/0 conn(0x7f47fc15c720 legacy=0x7f47fc0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:02.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47faffd700 1 -- 172.21.15.78:0/482006404 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc0cbe20 con 0x7f47fc0d0190 2023-06-09T11:12:02.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47faffd700 1 --2- 172.21.15.78:0/482006404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0d0190 0x7f47fc0cf1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009850 tx=0x7f47f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8908f6fb3323ed3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:02.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47fa7fc700 1 -- 172.21.15.78:0/482006404 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0011830 con 0x7f47fc0d0190 2023-06-09T11:12:02.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47fa7fc700 1 -- 172.21.15.78:0/482006404 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0011990 con 0x7f47fc0d0190 2023-06-09T11:12:02.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f47fa7fc700 1 -- 172.21.15.78:0/482006404 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0011d40 con 0x7f47fc0d0190 2023-06-09T11:12:02.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f4800898700 1 -- 172.21.15.78:0/482006404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0d0190 msgr2=0x7f47fc0cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:02.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f4800898700 1 --2- 172.21.15.78:0/482006404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0d0190 0x7f47fc0cf1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009850 tx=0x7f47f0009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f4800898700 1 -- 172.21.15.78:0/482006404 shutdown_connections 2023-06-09T11:12:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f4800898700 1 --2- 172.21.15.78:0/482006404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0d0190 0x7f47fc0cf1b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f4800898700 1 -- 172.21.15.78:0/482006404 >> 172.21.15.78:0/482006404 conn(0x7f47fc0d0bf0 msgr2=0x7f47fc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f4800898700 1 -- 172.21.15.78:0/482006404 shutdown_connections 2023-06-09T11:12:02.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.372+0000 7f4800898700 1 -- 172.21.15.78:0/482006404 wait complete. 2023-06-09T11:12:02.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 Processor -- start 2023-06-09T11:12:02.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 -- start start 2023-06-09T11:12:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0cf6f0 0x7f47fc15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47fc0d0190 0x7f47fc1f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:02.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47fc15c720 0x7f47fc15f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc15ec90 con 0x7f47fc0d0190 2023-06-09T11:12:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0c4e80 con 0x7f47fc0cf6f0 2023-06-09T11:12:02.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f4800898700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc15f990 con 0x7f47fc15c720 2023-06-09T11:12:02.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f47faffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47fc0d0190 0x7f47fc1f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:02.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f47faffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47fc0d0190 0x7f47fc1f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37084/0 (socket says 172.21.15.78:37084) 2023-06-09T11:12:02.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f47faffd700 1 -- 172.21.15.78:0/3566664164 learned_addr learned my addr 172.21.15.78:0/3566664164 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:02.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f47fb7fe700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0cf6f0 0x7f47fc15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:02.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f47faffd700 1 -- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47fc15c720 msgr2=0x7f47fc15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f47faffd700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47fc15c720 0x7f47fc15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.376+0000 7f47faffd700 1 -- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0cf6f0 msgr2=0x7f47fc15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47faffd700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0cf6f0 0x7f47fc15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47faffd700 1 -- 172.21.15.78:0/3566664164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f00094b0 con 0x7f47fc0d0190 2023-06-09T11:12:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47fb7fe700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0cf6f0 0x7f47fc15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47faffd700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47fc0d0190 0x7f47fc1f4ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47f00090b0 tx=0x7f47f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:02.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47e3fff700 1 -- 172.21.15.78:0/3566664164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f001aac0 con 0x7f47fc0d0190 2023-06-09T11:12:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47e3fff700 1 -- 172.21.15.78:0/3566664164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f001f070 con 0x7f47fc0d0190 2023-06-09T11:12:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc0cc3e0 con 0x7f47fc0d0190 2023-06-09T11:12:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47e3fff700 1 -- 172.21.15.78:0/3566664164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f001ae60 con 0x7f47fc0d0190 2023-06-09T11:12:02.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc0cc100 con 0x7f47fc0d0190 2023-06-09T11:12:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc0ccbe0 con 0x7f47fc0d0190 2023-06-09T11:12:02.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.380+0000 7f47e3fff700 1 -- 172.21.15.78:0/3566664164 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47f001b430 con 0x7f47fc0d0190 2023-06-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.384+0000 7f47e3fff700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47e80662f0 0x7f47e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.384+0000 7f47e3fff700 1 -- 172.21.15.78:0/3566664164 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f47f0084b40 con 0x7f47fc0d0190 2023-06-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.384+0000 7f47fb7fe700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47e80662f0 0x7f47e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.384+0000 7f47fb7fe700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47e80662f0 0x7f47e80687a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0011e0 tx=0x7f47ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:02.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.388+0000 7f47e3fff700 1 -- 172.21.15.78:0/3566664164 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f47f0052330 con 0x7f47fc0d0190 2023-06-09T11:12:02.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:02.560+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f47fc15a7b0 con 0x7f47fc0d0190 2023-06-09T11:12:03.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.184+0000 7f47e3fff700 1 -- 172.21.15.78:0/3566664164 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f47f00210c0 con 0x7f47fc0d0190 2023-06-09T11:12:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47e80662f0 msgr2=0x7f47e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47e80662f0 0x7f47e80687a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0011e0 tx=0x7f47ec009040 comp rx=0 tx=0).stop 2023-06-09T11:12:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47fc0d0190 msgr2=0x7f47fc1f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47fc0d0190 0x7f47fc1f4ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47f00090b0 tx=0x7f47f0004770 comp rx=0 tx=0).stop 2023-06-09T11:12:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 shutdown_connections 2023-06-09T11:12:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47e80662f0 0x7f47e80687a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47fc15c720 0x7f47fc15f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47fc0d0190 0x7f47fc1f4ce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 --2- 172.21.15.78:0/3566664164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47fc0cf6f0 0x7f47fc15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 >> 172.21.15.78:0/3566664164 conn(0x7f47fc0d0bf0 msgr2=0x7f47fc06f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:03.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 shutdown_connections 2023-06-09T11:12:03.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.188+0000 7f4800898700 1 -- 172.21.15.78:0/3566664164 wait complete. 2023-06-09T11:12:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-09T11:12:03.219 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-09T11:12:03.220 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T11:12:03.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T11:12:03.227 INFO:tasks.ceph.mds.a:Started 2023-06-09T11:12:03.227 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T11:12:03.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T11:12:03.233 INFO:tasks.ceph.mds.c:Started 2023-06-09T11:12:03.234 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T11:12:03.234 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T11:12:03.243 INFO:tasks.ceph.mds.b:Started 2023-06-09T11:12:03.244 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T11:12:03.244 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T11:12:03.249 INFO:tasks.ceph.mds.d:Started 2023-06-09T11:12:03.249 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-09T11:12:03.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:03.347 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-06-09T11:12:03.348 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-06-09T11:12:03.356 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-06-09T11:12:03.371 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-06-09T11:12:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 Processor -- start 2023-06-09T11:12:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 -- start start 2023-06-09T11:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f76a013eff0 0x7f76a015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a013f3c0 0x7f76a013fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76a01400e0 0x7f76a006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a015dac0 con 0x7f76a01400e0 2023-06-09T11:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a015cff0 con 0x7f76a013eff0 2023-06-09T11:12:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a5098700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a015d220 con 0x7f76a013f3c0 2023-06-09T11:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f769f7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a013f3c0 0x7f76a013fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f769f7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a013f3c0 0x7f76a013fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:37886/0 (socket says 172.21.15.78:37886) 2023-06-09T11:12:03.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f769f7fe700 1 -- 172.21.15.78:0/3371467430 learned_addr learned my addr 172.21.15.78:0/3371467430 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.416+0000 7f76a4897700 1 --2- 172.21.15.78:0/3371467430 >> v2:172.21.15.78:3300/0 conn(0x7f76a01400e0 0x7f76a006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769ffff700 1 --2- 172.21.15.78:0/3371467430 >> v2:172.21.15.187:3300/0 conn(0x7f76a013eff0 0x7f76a015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769f7fe700 1 -- 172.21.15.78:0/3371467430 >> v2:172.21.15.187:3300/0 conn(0x7f76a013eff0 msgr2=0x7f76a015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769f7fe700 1 --2- 172.21.15.78:0/3371467430 >> v2:172.21.15.187:3300/0 conn(0x7f76a013eff0 0x7f76a015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769f7fe700 1 -- 172.21.15.78:0/3371467430 >> v2:172.21.15.78:3300/0 conn(0x7f76a01400e0 msgr2=0x7f76a006dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769f7fe700 1 --2- 172.21.15.78:0/3371467430 >> v2:172.21.15.78:3300/0 conn(0x7f76a01400e0 0x7f76a006dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769f7fe700 1 -- 172.21.15.78:0/3371467430 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a015d500 con 0x7f76a013f3c0 2023-06-09T11:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a4897700 1 --2- 172.21.15.78:0/3371467430 >> v2:172.21.15.78:3300/0 conn(0x7f76a01400e0 0x7f76a006dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769f7fe700 1 --2- 172.21.15.78:0/3371467430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a013f3c0 0x7f76a013fba0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f76a00722f0 tx=0x7f7694009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a3550f35bd86a9c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769effd700 1 -- 172.21.15.78:0/3371467430 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694011830 con 0x7f76a013f3c0 2023-06-09T11:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769effd700 1 -- 172.21.15.78:0/3371467430 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7694011990 con 0x7f76a013f3c0 2023-06-09T11:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f769effd700 1 -- 172.21.15.78:0/3371467430 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694011d20 con 0x7f76a013f3c0 2023-06-09T11:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 -- 172.21.15.78:0/3371467430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a013f3c0 msgr2=0x7f76a013fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 --2- 172.21.15.78:0/3371467430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a013f3c0 0x7f76a013fba0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f76a00722f0 tx=0x7f7694009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 -- 172.21.15.78:0/3371467430 shutdown_connections 2023-06-09T11:12:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 --2- 172.21.15.78:0/3371467430 >> v2:172.21.15.78:3300/0 conn(0x7f76a01400e0 0x7f76a006dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 --2- 172.21.15.78:0/3371467430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a013f3c0 0x7f76a013fba0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 --2- 172.21.15.78:0/3371467430 >> v2:172.21.15.187:3300/0 conn(0x7f76a013eff0 0x7f76a015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 -- 172.21.15.78:0/3371467430 >> 172.21.15.78:0/3371467430 conn(0x7f76a00cf970 msgr2=0x7f76a00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 -- 172.21.15.78:0/3371467430 shutdown_connections 2023-06-09T11:12:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.420+0000 7f76a5098700 1 -- 172.21.15.78:0/3371467430 wait complete. 2023-06-09T11:12:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 Processor -- start 2023-06-09T11:12:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 -- start start 2023-06-09T11:12:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76a013eff0 0x7f76a0151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76a013f3c0 0x7f76a01f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a01400e0 0x7f76a00b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00b5e20 con 0x7f76a013eff0 2023-06-09T11:12:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00b63e0 con 0x7f76a013f3c0 2023-06-09T11:12:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f76a5098700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0152b80 con 0x7f76a01400e0 2023-06-09T11:12:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f769ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76a013eff0 0x7f76a0151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f769ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76a013eff0 0x7f76a0151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37142/0 (socket says 172.21.15.78:37142) 2023-06-09T11:12:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.424+0000 7f769ffff700 1 -- 172.21.15.78:0/3014105167 learned_addr learned my addr 172.21.15.78:0/3014105167 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f76a4897700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a01400e0 0x7f76a00b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769f7fe700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76a013f3c0 0x7f76a01f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769ffff700 1 -- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a01400e0 msgr2=0x7f76a00b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769ffff700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a01400e0 0x7f76a00b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769ffff700 1 -- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76a013f3c0 msgr2=0x7f76a01f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769ffff700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76a013f3c0 0x7f76a01f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769ffff700 1 -- 172.21.15.78:0/3014105167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698009a70 con 0x7f76a013eff0 2023-06-09T11:12:03.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769ffff700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76a013eff0 0x7f76a0151ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f769000d830 tx=0x7f769000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769cff9700 1 -- 172.21.15.78:0/3014105167 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76900125f0 con 0x7f76a013eff0 2023-06-09T11:12:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769cff9700 1 -- 172.21.15.78:0/3014105167 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690012750 con 0x7f76a013eff0 2023-06-09T11:12:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f769cff9700 1 -- 172.21.15.78:0/3014105167 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690012ae0 con 0x7f76a013eff0 2023-06-09T11:12:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7694009570 con 0x7f76a013eff0 2023-06-09T11:12:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a006d830 con 0x7f76a013eff0 2023-06-09T11:12:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.428+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a015d7e0 con 0x7f76a013eff0 2023-06-09T11:12:03.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.432+0000 7f769cff9700 1 -- 172.21.15.78:0/3014105167 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7690012c40 con 0x7f76a013eff0 2023-06-09T11:12:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.432+0000 7f769cff9700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f768c0662f0 0x7f768c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.432+0000 7f769cff9700 1 -- 172.21.15.78:0/3014105167 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7690083cf0 con 0x7f76a013eff0 2023-06-09T11:12:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.432+0000 7f769f7fe700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f768c0662f0 0x7f768c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.436+0000 7f769f7fe700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f768c0662f0 0x7f768c0687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7694000c00 tx=0x7f7694008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.436+0000 7f769cff9700 1 -- 172.21.15.78:0/3014105167 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7690051390 con 0x7f76a013eff0 2023-06-09T11:12:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.616+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76a013f830 con 0x7f76a013eff0 2023-06-09T11:12:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.616+0000 7f769cff9700 1 -- 172.21.15.78:0/3014105167 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14613 (secure 0 0 0) 0x7f769000b440 con 0x7f76a013eff0 2023-06-09T11:12:03.625 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:03.625 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:03.177241+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f768c0662f0 msgr2=0x7f768c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f768c0662f0 0x7f768c0687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7694000c00 tx=0x7f7694008030 comp rx=0 tx=0).stop 2023-06-09T11:12:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76a013eff0 msgr2=0x7f76a0151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76a013eff0 0x7f76a0151ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f769000d830 tx=0x7f769000db40 comp rx=0 tx=0).stop 2023-06-09T11:12:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 shutdown_connections 2023-06-09T11:12:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f768c0662f0 0x7f768c0687a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76a01400e0 0x7f76a00b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76a013f3c0 0x7f76a01f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 --2- 172.21.15.78:0/3014105167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76a013eff0 0x7f76a0151ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 >> 172.21.15.78:0/3014105167 conn(0x7f76a00cf970 msgr2=0x7f76a015f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 shutdown_connections 2023-06-09T11:12:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.620+0000 7f76a5098700 1 -- 172.21.15.78:0/3014105167 wait complete. 2023-06-09T11:12:03.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:03.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.816+0000 7f0636151700 1 Processor -- start 2023-06-09T11:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.816+0000 7f0636151700 1 -- start start 2023-06-09T11:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0636151700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0630156d50 0x7f06300ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0636151700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063015d4c0 con 0x7f063015cd50 2023-06-09T11:12:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0636151700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063015d7a0 con 0x7f06300b2da0 2023-06-09T11:12:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0636151700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0630159760 con 0x7f0630156d50 2023-06-09T11:12:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f063494e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f063015cd50 0x7f0630159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58176/0 (socket says 172.21.15.78:58176) 2023-06-09T11:12:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f063494e700 1 -- 172.21.15.78:0/196724624 learned_addr learned my addr 172.21.15.78:0/196724624 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f063514f700 1 --2- 172.21.15.78:0/196724624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0630156d50 0x7f06300ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0627fff700 1 -- 172.21.15.78:0/196724624 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195086672 0 0) 0x7f063015d4c0 con 0x7f063015cd50 2023-06-09T11:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0627fff700 1 -- 172.21.15.78:0/196724624 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f061c0057e0 con 0x7f063015cd50 2023-06-09T11:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0627fff700 1 -- 172.21.15.78:0/196724624 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677634524 0 0) 0x7f063015d7a0 con 0x7f06300b2da0 2023-06-09T11:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f0627fff700 1 -- 172.21.15.78:0/196724624 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f063015d4c0 con 0x7f06300b2da0 2023-06-09T11:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f063514f700 1 -- 172.21.15.78:0/196724624 >> v1:172.21.15.187:6789/0 conn(0x7f06300b2da0 legacy=0x7f06300cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f063514f700 1 -- 172.21.15.78:0/196724624 >> v1:172.21.15.78:6789/0 conn(0x7f063015cd50 legacy=0x7f0630159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f063514f700 1 -- 172.21.15.78:0/196724624 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063015da80 con 0x7f0630156d50 2023-06-09T11:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.820+0000 7f063514f700 1 --2- 172.21.15.78:0/196724624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0630156d50 0x7f06300ce3d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f062c009880 tx=0x7f062c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47145d01777bf671 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0627fff700 1 -- 172.21.15.78:0/196724624 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c011830 con 0x7f0630156d50 2023-06-09T11:12:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0627fff700 1 -- 172.21.15.78:0/196724624 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c011990 con 0x7f0630156d50 2023-06-09T11:12:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0627fff700 1 -- 172.21.15.78:0/196724624 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c011d20 con 0x7f0630156d50 2023-06-09T11:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0636151700 1 -- 172.21.15.78:0/196724624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0630156d50 msgr2=0x7f06300ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0636151700 1 --2- 172.21.15.78:0/196724624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0630156d50 0x7f06300ce3d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f062c009880 tx=0x7f062c009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0636151700 1 -- 172.21.15.78:0/196724624 shutdown_connections 2023-06-09T11:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0636151700 1 --2- 172.21.15.78:0/196724624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0630156d50 0x7f06300ce3d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0636151700 1 -- 172.21.15.78:0/196724624 >> 172.21.15.78:0/196724624 conn(0x7f06300b0780 msgr2=0x7f06300b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:03.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0636151700 1 -- 172.21.15.78:0/196724624 shutdown_connections 2023-06-09T11:12:03.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.824+0000 7f0636151700 1 -- 172.21.15.78:0/196724624 wait complete. 2023-06-09T11:12:03.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 Processor -- start 2023-06-09T11:12:03.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 -- start start 2023-06-09T11:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300b2da0 0x7f0630148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0630156d50 0x7f0630145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015cd50 0x7f063006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301465c0 con 0x7f06300b2da0 2023-06-09T11:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630148ae0 con 0x7f0630156d50 2023-06-09T11:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0636151700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0630148dc0 con 0x7f063015cd50 2023-06-09T11:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300b2da0 0x7f0630148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300b2da0 0x7f0630148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37144/0 (socket says 172.21.15.78:37144) 2023-06-09T11:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 -- 172.21.15.78:0/2460181853 learned_addr learned my addr 172.21.15.78:0/2460181853 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063494e700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0630156d50 0x7f0630145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f0635950700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015cd50 0x7f063006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 -- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015cd50 msgr2=0x7f063006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015cd50 0x7f063006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 -- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0630156d50 msgr2=0x7f0630145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0630156d50 0x7f0630145840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063514f700 1 -- 172.21.15.78:0/2460181853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0094b0 con 0x7f06300b2da0 2023-06-09T11:12:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.828+0000 7f063494e700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0630156d50 0x7f0630145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.832+0000 7f063514f700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300b2da0 0x7f0630148240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f062c013040 tx=0x7f062c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.832+0000 7f0625ffb700 1 -- 172.21.15.78:0/2460181853 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0198d0 con 0x7f06300b2da0 2023-06-09T11:12:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.832+0000 7f0625ffb700 1 -- 172.21.15.78:0/2460181853 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c01e070 con 0x7f06300b2da0 2023-06-09T11:12:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.832+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630157120 con 0x7f06300b2da0 2023-06-09T11:12:03.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.832+0000 7f0625ffb700 1 -- 172.21.15.78:0/2460181853 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c019c50 con 0x7f06300b2da0 2023-06-09T11:12:03.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.832+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0630159950 con 0x7f06300b2da0 2023-06-09T11:12:03.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.832+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063015d1a0 con 0x7f06300b2da0 2023-06-09T11:12:03.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.836+0000 7f0625ffb700 1 -- 172.21.15.78:0/2460181853 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f062c02d450 con 0x7f06300b2da0 2023-06-09T11:12:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.836+0000 7f0625ffb700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f06140662f0 0x7f06140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.836+0000 7f0625ffb700 1 -- 172.21.15.78:0/2460181853 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f062c084990 con 0x7f06300b2da0 2023-06-09T11:12:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.836+0000 7f063494e700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f06140662f0 0x7f06140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:03.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.840+0000 7f063494e700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f06140662f0 0x7f06140687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06300ca030 tx=0x7f0620009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:03.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:03.844+0000 7f0625ffb700 1 -- 172.21.15.78:0/2460181853 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f062c052200 con 0x7f06300b2da0 2023-06-09T11:12:04.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.016+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0630067270 con 0x7f06300b2da0 2023-06-09T11:12:04.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.016+0000 7f0625ffb700 1 -- 172.21.15.78:0/2460181853 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f062c020020 con 0x7f06300b2da0 2023-06-09T11:12:04.023 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f06140662f0 msgr2=0x7f06140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f06140662f0 0x7f06140687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06300ca030 tx=0x7f0620009040 comp rx=0 tx=0).stop 2023-06-09T11:12:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300b2da0 msgr2=0x7f0630148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300b2da0 0x7f0630148240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f062c013040 tx=0x7f062c004770 comp rx=0 tx=0).stop 2023-06-09T11:12:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 shutdown_connections 2023-06-09T11:12:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f06140662f0 0x7f06140687a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015cd50 0x7f063006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0630156d50 0x7f0630145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 --2- 172.21.15.78:0/2460181853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300b2da0 0x7f0630148240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 >> 172.21.15.78:0/2460181853 conn(0x7f06300b0780 msgr2=0x7f06300cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 shutdown_connections 2023-06-09T11:12:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.020+0000 7f0636151700 1 -- 172.21.15.78:0/2460181853 wait complete. 2023-06-09T11:12:04.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:04.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.212+0000 7fa065076700 1 Processor -- start 2023-06-09T11:12:04.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa065076700 1 -- start start 2023-06-09T11:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa065076700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa0600c4740 0x7fa06006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa065076700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600708e0 con 0x7fa0600b00a0 2023-06-09T11:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa065076700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600b0470 con 0x7fa06006c620 2023-06-09T11:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa05ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa0600b00a0 0x7fa0600cb240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58190/0 (socket says 172.21.15.78:58190) 2023-06-09T11:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa05ffff700 1 -- 172.21.15.78:0/850165199 learned_addr learned my addr 172.21.15.78:0/850165199 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa065076700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06006caa0 con 0x7fa0600c4740 2023-06-09T11:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.216+0000 7fa0577fe700 1 --2- 172.21.15.78:0/850165199 >> v2:172.21.15.187:3300/0 conn(0x7fa0600c4740 0x7fa06006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa05f7fe700 1 -- 172.21.15.78:0/850165199 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655001424 0 0) 0x7fa0600708e0 con 0x7fa0600b00a0 2023-06-09T11:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa05f7fe700 1 -- 172.21.15.78:0/850165199 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c0035d0 con 0x7fa0600b00a0 2023-06-09T11:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa0577fe700 1 -- 172.21.15.78:0/850165199 >> v1:172.21.15.187:6789/0 conn(0x7fa06006c620 legacy=0x7fa0600ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa05f7fe700 1 -- 172.21.15.78:0/850165199 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1695260836 0 0) 0x7fa04c0035d0 con 0x7fa0600b00a0 2023-06-09T11:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa0577fe700 1 -- 172.21.15.78:0/850165199 >> v1:172.21.15.78:6789/0 conn(0x7fa0600b00a0 legacy=0x7fa0600cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa0577fe700 1 -- 172.21.15.78:0/850165199 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600ccca0 con 0x7fa0600c4740 2023-06-09T11:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa0577fe700 1 --2- 172.21.15.78:0/850165199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600c4740 0x7fa06006c0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa048009850 tx=0x7fa048009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528d54e2af4bcc3f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa05f7fe700 1 -- 172.21.15.78:0/850165199 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500019f0 con 0x7fa0600c4740 2023-06-09T11:12:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa05f7fe700 1 -- 172.21.15.78:0/850165199 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048004030 con 0x7fa0600c4740 2023-06-09T11:12:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa05f7fe700 1 -- 172.21.15.78:0/850165199 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0480043c0 con 0x7fa0600c4740 2023-06-09T11:12:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa065076700 1 -- 172.21.15.78:0/850165199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600c4740 msgr2=0x7fa06006c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa065076700 1 --2- 172.21.15.78:0/850165199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600c4740 0x7fa06006c0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa048009850 tx=0x7fa048009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:04.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa065076700 1 -- 172.21.15.78:0/850165199 shutdown_connections 2023-06-09T11:12:04.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa065076700 1 --2- 172.21.15.78:0/850165199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600c4740 0x7fa06006c0e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa065076700 1 -- 172.21.15.78:0/850165199 >> 172.21.15.78:0/850165199 conn(0x7fa0600d0bf0 msgr2=0x7fa0600d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:04.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa065076700 1 -- 172.21.15.78:0/850165199 shutdown_connections 2023-06-09T11:12:04.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.220+0000 7fa065076700 1 -- 172.21.15.78:0/850165199 wait complete. 2023-06-09T11:12:04.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.224+0000 7fa065076700 1 Processor -- start 2023-06-09T11:12:04.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.224+0000 7fa065076700 1 -- start start 2023-06-09T11:12:04.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006c620 0x7fa06014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600b00a0 0x7fa06015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0600c4740 0x7fa06006ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa060150490 con 0x7fa0600c4740 2023-06-09T11:12:04.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015d410 con 0x7fa0600b00a0 2023-06-09T11:12:04.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015d8a0 con 0x7fa06006c620 2023-06-09T11:12:04.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0600c4740 0x7fa06006ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0600c4740 0x7fa06006ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37152/0 (socket says 172.21.15.78:37152) 2023-06-09T11:12:04.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 -- 172.21.15.78:0/3383935183 learned_addr learned my addr 172.21.15.78:0/3383935183 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:04.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa0577fe700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600b00a0 0x7fa06015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa05ffff700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006c620 0x7fa06014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 -- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006c620 msgr2=0x7fa06014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006c620 0x7fa06014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 -- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600b00a0 msgr2=0x7fa06015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600b00a0 0x7fa06015be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 -- 172.21.15.78:0/3383935183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480094b0 con 0x7fa0600c4740 2023-06-09T11:12:04.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa05ffff700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006c620 0x7fa06014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:04.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa064875700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0600c4740 0x7fa06006ae30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c430 tx=0x7fa05800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:04.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa05d7fa700 1 -- 172.21.15.78:0/3383935183 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0580052d0 con 0x7fa0600c4740 2023-06-09T11:12:04.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa05d7fa700 1 -- 172.21.15.78:0/3383935183 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa058005430 con 0x7fa0600c4740 2023-06-09T11:12:04.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa060070600 con 0x7fa0600c4740 2023-06-09T11:12:04.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa05d7fa700 1 -- 172.21.15.78:0/3383935183 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0580055a0 con 0x7fa0600c4740 2023-06-09T11:12:04.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.228+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600c4b90 con 0x7fa0600c4740 2023-06-09T11:12:04.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.232+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600ccf40 con 0x7fa0600c4740 2023-06-09T11:12:04.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.232+0000 7fa05d7fa700 1 -- 172.21.15.78:0/3383935183 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa0580038e0 con 0x7fa0600c4740 2023-06-09T11:12:04.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.236+0000 7fa05d7fa700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa0400662f0 0x7fa0400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.236+0000 7fa05d7fa700 1 -- 172.21.15.78:0/3383935183 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa058082d70 con 0x7fa0600c4740 2023-06-09T11:12:04.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.236+0000 7fa05ffff700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa0400662f0 0x7fa0400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.236+0000 7fa05ffff700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa0400662f0 0x7fa0400687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa050001560 tx=0x7fa050001970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:04.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.240+0000 7fa05d7fa700 1 -- 172.21.15.78:0/3383935183 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa0580504a0 con 0x7fa0600c4740 2023-06-09T11:12:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.408+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa060067610 con 0x7fa0600c4740 2023-06-09T11:12:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa05d7fa700 1 -- 172.21.15.78:0/3383935183 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0580170a0 con 0x7fa0600c4740 2023-06-09T11:12:04.418 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:04.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa0400662f0 msgr2=0x7fa0400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa0400662f0 0x7fa0400687a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa050001560 tx=0x7fa050001970 comp rx=0 tx=0).stop 2023-06-09T11:12:04.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0600c4740 msgr2=0x7fa06006ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0600c4740 0x7fa06006ae30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c430 tx=0x7fa05800c740 comp rx=0 tx=0).stop 2023-06-09T11:12:04.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 shutdown_connections 2023-06-09T11:12:04.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa0400662f0 0x7fa0400687a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0600c4740 0x7fa06006ae30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600b00a0 0x7fa06015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 --2- 172.21.15.78:0/3383935183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006c620 0x7fa06014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 >> 172.21.15.78:0/3383935183 conn(0x7fa0600d0bf0 msgr2=0x7fa0600cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 shutdown_connections 2023-06-09T11:12:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.412+0000 7fa065076700 1 -- 172.21.15.78:0/3383935183 wait complete. 2023-06-09T11:12:04.438 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:04.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.604+0000 7fb0ff862700 1 Processor -- start 2023-06-09T11:12:04.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0ff862700 1 -- start start 2023-06-09T11:12:04.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0ff862700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f815e670 0x7fb0f806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0ff862700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb0f80ce470 0x7fb0f806f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0ff862700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80cc8e0 con 0x7fb0f815a3e0 2023-06-09T11:12:04.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0ff862700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f815a7b0 con 0x7fb0f80ce470 2023-06-09T11:12:04.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0ff862700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80ccb80 con 0x7fb0f815e670 2023-06-09T11:12:04.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0fcdfd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f815e670 0x7fb0f806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0fddff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb0f80ce470 0x7fb0f806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0fcdfd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f815e670 0x7fb0f806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:37926/0 (socket says 172.21.15.78:37926) 2023-06-09T11:12:04.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.608+0000 7fb0fcdfd700 1 -- 172.21.15.78:0/29942514 learned_addr learned my addr 172.21.15.78:0/29942514 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:04.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0fddff700 1 -- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f815e670 msgr2=0x7fb0f806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:04.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0fddff700 1 --2- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f815e670 0x7fb0f806e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0fddff700 1 -- 172.21.15.78:0/29942514 >> v1:172.21.15.187:6789/0 conn(0x7fb0f815a3e0 legacy=0x7fb0f815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0effff700 1 -- 172.21.15.78:0/29942514 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898821887 0 0) 0x7fb0f80cc8e0 con 0x7fb0f815a3e0 2023-06-09T11:12:04.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0fddff700 1 -- 172.21.15.78:0/29942514 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f806b470 con 0x7fb0f80ce470 2023-06-09T11:12:04.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0fcdfd700 1 --2- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f815e670 0x7fb0f806e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:04.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0fddff700 1 --2- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f80ce470 0x7fb0f806f090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009d90 tx=0x7fb0f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed21cb61d6dbb5b4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:04.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0effff700 1 -- 172.21.15.78:0/29942514 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f000e070 con 0x7fb0f80ce470 2023-06-09T11:12:04.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0effff700 1 -- 172.21.15.78:0/29942514 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f000bb20 con 0x7fb0f80ce470 2023-06-09T11:12:04.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0effff700 1 -- 172.21.15.78:0/29942514 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0012430 con 0x7fb0f80ce470 2023-06-09T11:12:04.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 -- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f80ce470 msgr2=0x7fb0f806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 --2- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f80ce470 0x7fb0f806f090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009d90 tx=0x7fb0f000b330 comp rx=0 tx=0).stop 2023-06-09T11:12:04.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 -- 172.21.15.78:0/29942514 shutdown_connections 2023-06-09T11:12:04.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 --2- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f80ce470 0x7fb0f806f090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 --2- 172.21.15.78:0/29942514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f815e670 0x7fb0f806e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 -- 172.21.15.78:0/29942514 >> 172.21.15.78:0/29942514 conn(0x7fb0f80cf670 msgr2=0x7fb0f80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:04.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 -- 172.21.15.78:0/29942514 shutdown_connections 2023-06-09T11:12:04.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.612+0000 7fb0ff862700 1 -- 172.21.15.78:0/29942514 wait complete. 2023-06-09T11:12:04.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 Processor -- start 2023-06-09T11:12:04.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 -- start start 2023-06-09T11:12:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f80ce470 0x7fb0f81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f815a3e0 0x7fb0f813e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0f815e670 0x7fb0f80b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80b1420 con 0x7fb0f815e670 2023-06-09T11:12:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80b0b80 con 0x7fb0f815a3e0 2023-06-09T11:12:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.616+0000 7fb0ff862700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80b0e60 con 0x7fb0f80ce470 2023-06-09T11:12:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0f815e670 0x7fb0f80b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0f815e670 0x7fb0f80b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37158/0 (socket says 172.21.15.78:37158) 2023-06-09T11:12:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 -- 172.21.15.78:0/296033626 learned_addr learned my addr 172.21.15.78:0/296033626 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fd5fe700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f80ce470 0x7fb0f81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fcdfd700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f815a3e0 0x7fb0f813e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 -- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f80ce470 msgr2=0x7fb0f81580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f80ce470 0x7fb0f81580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 -- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f815a3e0 msgr2=0x7fb0f813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f815a3e0 0x7fb0f813e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 -- 172.21.15.78:0/296033626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009570 con 0x7fb0f815e670 2023-06-09T11:12:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0fddff700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0f815e670 0x7fb0f80b02a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0014040 tx=0x7fb0f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0edffb700 1 -- 172.21.15.78:0/296033626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0004830 con 0x7fb0f815e670 2023-06-09T11:12:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0edffb700 1 -- 172.21.15.78:0/296033626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0020070 con 0x7fb0f815e670 2023-06-09T11:12:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0edffb700 1 -- 172.21.15.78:0/296033626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00276c0 con 0x7fb0f815e670 2023-06-09T11:12:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f0009a70 con 0x7fb0f815e670 2023-06-09T11:12:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.620+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f8070240 con 0x7fb0f815e670 2023-06-09T11:12:04.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.624+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f806b750 con 0x7fb0f815e670 2023-06-09T11:12:04.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.624+0000 7fb0edffb700 1 -- 172.21.15.78:0/296033626 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0f0012430 con 0x7fb0f815e670 2023-06-09T11:12:04.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.628+0000 7fb0edffb700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0dc066340 0x7fb0dc0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:04.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.628+0000 7fb0edffb700 1 -- 172.21.15.78:0/296033626 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb0f0022070 con 0x7fb0f815e670 2023-06-09T11:12:04.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.628+0000 7fb0fd5fe700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0dc066340 0x7fb0dc0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:04.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.628+0000 7fb0fd5fe700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0dc066340 0x7fb0dc0687f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4007fd0 tx=0x7fb0f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:04.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.628+0000 7fb0edffb700 1 -- 172.21.15.78:0/296033626 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb0f0053230 con 0x7fb0f815e670 2023-06-09T11:12:04.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.836+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0f80703d0 con 0x7fb0f815e670 2023-06-09T11:12:04.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.836+0000 7fb0edffb700 1 -- 172.21.15.78:0/296033626 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fb0f0056850 con 0x7fb0f815e670 2023-06-09T11:12:04.845 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:04.845 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-09T11:12:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0dc066340 msgr2=0x7fb0dc0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0dc066340 0x7fb0dc0687f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4007fd0 tx=0x7fb0f4009040 comp rx=0 tx=0).stop 2023-06-09T11:12:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0f815e670 msgr2=0x7fb0f80b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:04.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0f815e670 0x7fb0f80b02a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0014040 tx=0x7fb0f0004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 shutdown_connections 2023-06-09T11:12:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0dc066340 0x7fb0dc0687f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0f815e670 0x7fb0f80b02a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0f815a3e0 0x7fb0f813e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 --2- 172.21.15.78:0/296033626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0f80ce470 0x7fb0f81580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 >> 172.21.15.78:0/296033626 conn(0x7fb0f80cf670 msgr2=0x7fb0f8070870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:04.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 shutdown_connections 2023-06-09T11:12:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:04.840+0000 7fb0ff862700 1 -- 172.21.15.78:0/296033626 wait complete. 2023-06-09T11:12:04.850 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2023-06-09T11:12:04.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:05.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.032+0000 7f095d130700 1 Processor -- start 2023-06-09T11:12:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.032+0000 7f095d130700 1 -- start start 2023-06-09T11:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f095d130700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f095806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f095d130700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f095815e670 0x7f095806f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f095d130700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580cc8e0 con 0x7f09580ce470 2023-06-09T11:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f095d130700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095815a7b0 con 0x7f095815e670 2023-06-09T11:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f095d130700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580ccb80 con 0x7f095815a3e0 2023-06-09T11:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f094f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f09580ce470 0x7f095815df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43338/0 (socket says 172.21.15.78:43338) 2023-06-09T11:12:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f094f7fe700 1 -- 172.21.15.78:0/2713716318 learned_addr learned my addr 172.21.15.78:0/2713716318 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f0957fff700 1 --2- 172.21.15.78:0/2713716318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f095806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f095c92f700 1 --2- 172.21.15.78:0/2713716318 >> v2:172.21.15.187:3300/0 conn(0x7f095815e670 0x7f095806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f09577fe700 1 -- 172.21.15.78:0/2713716318 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410761091 0 0) 0x7f09580cc8e0 con 0x7f09580ce470 2023-06-09T11:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f09577fe700 1 -- 172.21.15.78:0/2713716318 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09440035d0 con 0x7f09580ce470 2023-06-09T11:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f0957fff700 1 -- 172.21.15.78:0/2713716318 >> v2:172.21.15.187:3300/0 conn(0x7f095815e670 msgr2=0x7f095806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f0957fff700 1 --2- 172.21.15.78:0/2713716318 >> v2:172.21.15.187:3300/0 conn(0x7f095815e670 0x7f095806f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f0957fff700 1 -- 172.21.15.78:0/2713716318 >> v1:172.21.15.78:6789/0 conn(0x7f09580ce470 legacy=0x7f095815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f0957fff700 1 -- 172.21.15.78:0/2713716318 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095806b470 con 0x7f095815a3e0 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f0957fff700 1 --2- 172.21.15.78:0/2713716318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f095806e960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0948009850 tx=0x7f0948009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38dd210297d08fd9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f09577fe700 1 -- 172.21.15.78:0/2713716318 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948011830 con 0x7f095815a3e0 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f09577fe700 1 -- 172.21.15.78:0/2713716318 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0948011990 con 0x7f095815a3e0 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.036+0000 7f09577fe700 1 -- 172.21.15.78:0/2713716318 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948011d40 con 0x7f095815a3e0 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 -- 172.21.15.78:0/2713716318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 msgr2=0x7f095806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 --2- 172.21.15.78:0/2713716318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f095806e960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0948009850 tx=0x7f0948009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 -- 172.21.15.78:0/2713716318 shutdown_connections 2023-06-09T11:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 --2- 172.21.15.78:0/2713716318 >> v2:172.21.15.187:3300/0 conn(0x7f095815e670 0x7f095806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 --2- 172.21.15.78:0/2713716318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f095806e960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 -- 172.21.15.78:0/2713716318 >> 172.21.15.78:0/2713716318 conn(0x7f09580cf670 msgr2=0x7f09580cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 -- 172.21.15.78:0/2713716318 shutdown_connections 2023-06-09T11:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.040+0000 7f095d130700 1 -- 172.21.15.78:0/2713716318 wait complete. 2023-06-09T11:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 Processor -- start 2023-06-09T11:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 -- start start 2023-06-09T11:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09580ce470 0x7f095814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f09580ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f095815e670 0x7f09580ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580c7930 con 0x7f09580ce470 2023-06-09T11:12:05.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580c7c10 con 0x7f095815e670 2023-06-09T11:12:05.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095d130700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580c7ef0 con 0x7f095815a3e0 2023-06-09T11:12:05.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09580ce470 0x7f095814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09580ce470 0x7f095814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42106/0 (socket says 172.21.15.78:42106) 2023-06-09T11:12:05.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 -- 172.21.15.78:0/564534792 learned_addr learned my addr 172.21.15.78:0/564534792 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:05.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f094f7fe700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f09580ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f095c92f700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f095815e670 0x7f09580ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 -- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 msgr2=0x7f09580ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f09580ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 -- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f095815e670 msgr2=0x7f09580ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f095815e670 0x7f09580ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 -- 172.21.15.78:0/564534792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480094b0 con 0x7f09580ce470 2023-06-09T11:12:05.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.044+0000 7f0957fff700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09580ce470 0x7f095814a9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09480090b0 tx=0x7f0948004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.048+0000 7f09557fa700 1 -- 172.21.15.78:0/564534792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948004240 con 0x7f09580ce470 2023-06-09T11:12:05.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.048+0000 7f09557fa700 1 -- 172.21.15.78:0/564534792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094801f070 con 0x7f09580ce470 2023-06-09T11:12:05.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.048+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0958070240 con 0x7f09580ce470 2023-06-09T11:12:05.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.048+0000 7f09557fa700 1 -- 172.21.15.78:0/564534792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948004600 con 0x7f09580ce470 2023-06-09T11:12:05.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.048+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095806b750 con 0x7f09580ce470 2023-06-09T11:12:05.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.048+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09580703d0 con 0x7f09580ce470 2023-06-09T11:12:05.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.048+0000 7f09557fa700 1 -- 172.21.15.78:0/564534792 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0948021030 con 0x7f09580ce470 2023-06-09T11:12:05.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.052+0000 7f09557fa700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f09380662f0 0x7f09380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.052+0000 7f09557fa700 1 -- 172.21.15.78:0/564534792 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0948084890 con 0x7f09580ce470 2023-06-09T11:12:05.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.052+0000 7f094f7fe700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f09380662f0 0x7f09380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.052+0000 7f094f7fe700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f09380662f0 0x7f09380687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09581f0ba0 tx=0x7f0940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.056+0000 7f09557fa700 1 -- 172.21.15.78:0/564534792 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f09480521b0 con 0x7f09580ce470 2023-06-09T11:12:05.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.232+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09580c83e0 con 0x7f09580ce470 2023-06-09T11:12:05.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f09557fa700 1 -- 172.21.15.78:0/564534792 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14600 (secure 0 0 0) 0x7f0948015090 con 0x7f09580ce470 2023-06-09T11:12:05.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:05.242 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:04.193074+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:05.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f09380662f0 msgr2=0x7f09380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f09380662f0 0x7f09380687a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09581f0ba0 tx=0x7f0940009040 comp rx=0 tx=0).stop 2023-06-09T11:12:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09580ce470 msgr2=0x7f095814a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09580ce470 0x7f095814a9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09480090b0 tx=0x7f0948004770 comp rx=0 tx=0).stop 2023-06-09T11:12:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 shutdown_connections 2023-06-09T11:12:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f09380662f0 0x7f09380687a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f095815e670 0x7f09580ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f095815a3e0 0x7f09580ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 --2- 172.21.15.78:0/564534792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09580ce470 0x7f095814a9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 >> 172.21.15.78:0/564534792 conn(0x7f09580cf670 msgr2=0x7f09580c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:05.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 shutdown_connections 2023-06-09T11:12:05.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.236+0000 7f095d130700 1 -- 172.21.15.78:0/564534792 wait complete. 2023-06-09T11:12:05.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:05.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:05.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 Processor -- start 2023-06-09T11:12:05.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 -- start start 2023-06-09T11:12:05.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b0015a160 0x7f3b0015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3b00070890 0x7f3b00070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b00071250 con 0x7f3b0015a160 2023-06-09T11:12:05.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0006d730 con 0x7f3b00070890 2023-06-09T11:12:05.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.432+0000 7f3b058ee700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015a530 con 0x7f3b000d26d0 2023-06-09T11:12:05.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b0015a160 0x7f3b0015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b0015a160 0x7f3b0015cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42114/0 (socket says 172.21.15.78:42114) 2023-06-09T11:12:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3aff7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3b00070890 0x7f3b00070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 -- 172.21.15.78:0/47311895 learned_addr learned my addr 172.21.15.78:0/47311895 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afe7fc700 1 --2- 172.21.15.78:0/47311895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 -- 172.21.15.78:0/47311895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 msgr2=0x7f3b000d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 --2- 172.21.15.78:0/47311895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 -- 172.21.15.78:0/47311895 >> v2:172.21.15.187:3300/0 conn(0x7f3b00070890 msgr2=0x7f3b00070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:05.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 --2- 172.21.15.78:0/47311895 >> v2:172.21.15.187:3300/0 conn(0x7f3b00070890 0x7f3b00070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 -- 172.21.15.78:0/47311895 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0015d180 con 0x7f3b0015a160 2023-06-09T11:12:05.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afeffd700 1 --2- 172.21.15.78:0/47311895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015cb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b000d0970 tx=0x7f3af0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3181a5c1274c62de server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afdffb700 1 -- 172.21.15.78:0/47311895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0011830 con 0x7f3b0015a160 2023-06-09T11:12:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afdffb700 1 -- 172.21.15.78:0/47311895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0011990 con 0x7f3b0015a160 2023-06-09T11:12:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3afdffb700 1 -- 172.21.15.78:0/47311895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0011d20 con 0x7f3b0015a160 2023-06-09T11:12:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 -- 172.21.15.78:0/47311895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 msgr2=0x7f3b0015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 --2- 172.21.15.78:0/47311895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015cb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b000d0970 tx=0x7f3af0009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 -- 172.21.15.78:0/47311895 shutdown_connections 2023-06-09T11:12:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 --2- 172.21.15.78:0/47311895 >> v2:172.21.15.187:3300/0 conn(0x7f3b00070890 0x7f3b00070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 --2- 172.21.15.78:0/47311895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 --2- 172.21.15.78:0/47311895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015cb30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 -- 172.21.15.78:0/47311895 >> 172.21.15.78:0/47311895 conn(0x7f3b000cf930 msgr2=0x7f3b000cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.436+0000 7f3b058ee700 1 -- 172.21.15.78:0/47311895 shutdown_connections 2023-06-09T11:12:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.440+0000 7f3b058ee700 1 -- 172.21.15.78:0/47311895 wait complete. 2023-06-09T11:12:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.440+0000 7f3b058ee700 1 Processor -- start 2023-06-09T11:12:05.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.440+0000 7f3b058ee700 1 -- start start 2023-06-09T11:12:05.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b00070890 0x7f3b0014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015a670 con 0x7f3b0015a160 2023-06-09T11:12:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001f5ad0 con 0x7f3b00070890 2023-06-09T11:12:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001f5db0 con 0x7f3b000d26d0 2023-06-09T11:12:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3aff7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42118/0 (socket says 172.21.15.78:42118) 2023-06-09T11:12:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3aff7fe700 1 -- 172.21.15.78:0/1953194922 learned_addr learned my addr 172.21.15.78:0/1953194922 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afeffd700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b00070890 0x7f3b0014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afe7fc700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afeffd700 1 -- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 msgr2=0x7f3b000b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afeffd700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afeffd700 1 -- 172.21.15.78:0/1953194922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 msgr2=0x7f3b0015ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afeffd700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afeffd700 1 -- 172.21.15.78:0/1953194922 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0009570 con 0x7f3b00070890 2023-06-09T11:12:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3afeffd700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b00070890 0x7f3b0014e900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3af0016000 tx=0x7f3af0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3ae7fff700 1 -- 172.21.15.78:0/1953194922 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0004240 con 0x7f3b00070890 2023-06-09T11:12:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3ae7fff700 1 -- 172.21.15.78:0/1953194922 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af001f070 con 0x7f3b00070890 2023-06-09T11:12:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0015d740 con 0x7f3b00070890 2023-06-09T11:12:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3ae7fff700 1 -- 172.21.15.78:0/1953194922 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0004600 con 0x7f3b00070890 2023-06-09T11:12:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.444+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0015d460 con 0x7f3b00070890 2023-06-09T11:12:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.448+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0015da20 con 0x7f3b00070890 2023-06-09T11:12:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.448+0000 7f3ae7fff700 1 -- 172.21.15.78:0/1953194922 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3af0021070 con 0x7f3b00070890 2023-06-09T11:12:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.448+0000 7f3ae7fff700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3aec0662f0 0x7f3aec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.448+0000 7f3ae7fff700 1 -- 172.21.15.78:0/1953194922 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3af0084a20 con 0x7f3b00070890 2023-06-09T11:12:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.452+0000 7f3afe7fc700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3aec0662f0 0x7f3aec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.452+0000 7f3afe7fc700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3aec0662f0 0x7f3aec0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b00152240 tx=0x7f3af4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.460+0000 7f3ae7fff700 1 -- 172.21.15.78:0/1953194922 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3af0052160 con 0x7f3b00070890 2023-06-09T11:12:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.628+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b00067610 con 0x7f3b00070890 2023-06-09T11:12:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.628+0000 7f3ae7fff700 1 -- 172.21.15.78:0/1953194922 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3af0055780 con 0x7f3b00070890 2023-06-09T11:12:05.637 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:05.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3aec0662f0 msgr2=0x7f3aec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3aec0662f0 0x7f3aec0687a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b00152240 tx=0x7f3af4009240 comp rx=0 tx=0).stop 2023-06-09T11:12:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b00070890 msgr2=0x7f3b0014e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b00070890 0x7f3b0014e900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3af0016000 tx=0x7f3af0004770 comp rx=0 tx=0).stop 2023-06-09T11:12:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 shutdown_connections 2023-06-09T11:12:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3aec0662f0 0x7f3aec0687a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b0015a160 0x7f3b0015ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b000d26d0 0x7f3b000b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 --2- 172.21.15.78:0/1953194922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b00070890 0x7f3b0014e900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 >> 172.21.15.78:0/1953194922 conn(0x7f3b000cf930 msgr2=0x7f3b000cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:05.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 shutdown_connections 2023-06-09T11:12:05.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.632+0000 7f3b058ee700 1 -- 172.21.15.78:0/1953194922 wait complete. 2023-06-09T11:12:05.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:05.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af759e700 1 Processor -- start 2023-06-09T11:12:05.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af759e700 1 -- start start 2023-06-09T11:12:05.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af759e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2af815cb30 0x7f2af80d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af8070890 0x7f2af8070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af759e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af8071210 con 0x7f2af815a160 2023-06-09T11:12:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af759e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af806d730 con 0x7f2af815cb30 2023-06-09T11:12:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af815a530 con 0x7f2af8070890 2023-06-09T11:12:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2aeffff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2af815cb30 0x7f2af80d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af659c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2af815a160 0x7f2af80d26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43342/0 (socket says 172.21.15.78:43342) 2023-06-09T11:12:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af659c700 1 -- 172.21.15.78:0/344313975 learned_addr learned my addr 172.21.15.78:0/344313975 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2af6d9d700 1 --2- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af8070890 0x7f2af8070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2aeffff700 1 -- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af8070890 msgr2=0x7f2af8070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2aeffff700 1 --2- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af8070890 0x7f2af8070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2aeffff700 1 -- 172.21.15.78:0/344313975 >> v1:172.21.15.78:6789/0 conn(0x7f2af815a160 legacy=0x7f2af80d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.832+0000 7f2aeffff700 1 -- 172.21.15.78:0/344313975 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af815d180 con 0x7f2af815cb30 2023-06-09T11:12:05.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2aeffff700 1 --2- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af815cb30 0x7f2af80d0a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009850 tx=0x7f2ae0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eab2abb345a16e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af5d9b700 1 -- 172.21.15.78:0/344313975 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0011830 con 0x7f2af815cb30 2023-06-09T11:12:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af5d9b700 1 -- 172.21.15.78:0/344313975 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0011990 con 0x7f2af815cb30 2023-06-09T11:12:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af5d9b700 1 -- 172.21.15.78:0/344313975 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0011d40 con 0x7f2af815cb30 2023-06-09T11:12:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 -- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af815cb30 msgr2=0x7f2af80d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 --2- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af815cb30 0x7f2af80d0a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009850 tx=0x7f2ae0009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 -- 172.21.15.78:0/344313975 shutdown_connections 2023-06-09T11:12:05.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 --2- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af8070890 0x7f2af8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 --2- 172.21.15.78:0/344313975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af815cb30 0x7f2af80d0a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 -- 172.21.15.78:0/344313975 >> 172.21.15.78:0/344313975 conn(0x7f2af80cf930 msgr2=0x7f2af80cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:05.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 -- 172.21.15.78:0/344313975 shutdown_connections 2023-06-09T11:12:05.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.836+0000 7f2af759e700 1 -- 172.21.15.78:0/344313975 wait complete. 2023-06-09T11:12:05.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.840+0000 7f2af759e700 1 Processor -- start 2023-06-09T11:12:05.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.840+0000 7f2af759e700 1 -- start start 2023-06-09T11:12:05.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8070890 0x7f2af80b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af815a160 0x7f2af814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2af815cb30 0x7f2af8156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af814ef60 con 0x7f2af815cb30 2023-06-09T11:12:05.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8157660 con 0x7f2af8070890 2023-06-09T11:12:05.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8157af0 con 0x7f2af815a160 2023-06-09T11:12:05.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2af815cb30 0x7f2af8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2af815cb30 0x7f2af8156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42134/0 (socket says 172.21.15.78:42134) 2023-06-09T11:12:05.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 -- 172.21.15.78:0/3183635249 learned_addr learned my addr 172.21.15.78:0/3183635249 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:05.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af659c700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8070890 0x7f2af80b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2aeffff700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af815a160 0x7f2af814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 -- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af815a160 msgr2=0x7f2af814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af815a160 0x7f2af814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 -- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8070890 msgr2=0x7f2af80b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:05.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8070890 0x7f2af80b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:05.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 -- 172.21.15.78:0/3183635249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00094b0 con 0x7f2af815cb30 2023-06-09T11:12:05.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af6d9d700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2af815cb30 0x7f2af8156170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2af000efc0 tx=0x7f2af000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2aeeffd700 1 -- 172.21.15.78:0/3183635249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af000cad0 con 0x7f2af815cb30 2023-06-09T11:12:05.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2aeeffd700 1 -- 172.21.15.78:0/3183635249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af000f040 con 0x7f2af815cb30 2023-06-09T11:12:05.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af815d740 con 0x7f2af815cb30 2023-06-09T11:12:05.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2aeeffd700 1 -- 172.21.15.78:0/3183635249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af000ce70 con 0x7f2af815cb30 2023-06-09T11:12:05.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af815d460 con 0x7f2af815cb30 2023-06-09T11:12:05.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.844+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af815da20 con 0x7f2af815cb30 2023-06-09T11:12:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.848+0000 7f2aeeffd700 1 -- 172.21.15.78:0/3183635249 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2af0014480 con 0x7f2af815cb30 2023-06-09T11:12:05.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.848+0000 7f2aeeffd700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ad80662f0 0x7f2ad80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.848+0000 7f2aeeffd700 1 -- 172.21.15.78:0/3183635249 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2af0084100 con 0x7f2af815cb30 2023-06-09T11:12:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.848+0000 7f2af659c700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ad80662f0 0x7f2ad80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:05.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.852+0000 7f2af659c700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ad80662f0 0x7f2ad80687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000f60 tx=0x7f2ae8007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:05.856+0000 7f2aeeffd700 1 -- 172.21.15.78:0/3183635249 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2af00554a0 con 0x7f2af815cb30 2023-06-09T11:12:06.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.028+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2af8067610 con 0x7f2af815cb30 2023-06-09T11:12:06.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.028+0000 7f2aeeffd700 1 -- 172.21.15.78:0/3183635249 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2af0055030 con 0x7f2af815cb30 2023-06-09T11:12:06.035 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ad80662f0 msgr2=0x7f2ad80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ad80662f0 0x7f2ad80687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000f60 tx=0x7f2ae8007f30 comp rx=0 tx=0).stop 2023-06-09T11:12:06.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2af815cb30 msgr2=0x7f2af8156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2af815cb30 0x7f2af8156170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2af000efc0 tx=0x7f2af000c0c0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 shutdown_connections 2023-06-09T11:12:06.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ad80662f0 0x7f2ad80687a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2af815cb30 0x7f2af8156170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2af815a160 0x7f2af814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 --2- 172.21.15.78:0/3183635249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8070890 0x7f2af80b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 >> 172.21.15.78:0/3183635249 conn(0x7f2af80cf930 msgr2=0x7f2af81599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:06.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 shutdown_connections 2023-06-09T11:12:06.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.032+0000 7f2af759e700 1 -- 172.21.15.78:0/3183635249 wait complete. 2023-06-09T11:12:06.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T11:12:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.216+0000 7f7d79950700 1 Processor -- start 2023-06-09T11:12:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.216+0000 7f7d79950700 1 -- start start 2023-06-09T11:12:06.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d79950700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7406f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d79950700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d740cfde0 0x7f7d7406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d79950700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d740c9970 con 0x7f7d7415c7c0 2023-06-09T11:12:06.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d79950700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740d02e0 con 0x7f7d740cfde0 2023-06-09T11:12:06.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d79950700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74161290 con 0x7f7d740cd600 2023-06-09T11:12:06.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d72ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7d7415c7c0 0x7f7d740ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43352/0 (socket says 172.21.15.78:43352) 2023-06-09T11:12:06.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d72ffd700 1 -- 172.21.15.78:0/3481920997 learned_addr learned my addr 172.21.15.78:0/3481920997 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:06.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d737fe700 1 --2- 172.21.15.78:0/3481920997 >> v2:172.21.15.78:3300/0 conn(0x7f7d740cfde0 0x7f7d7406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d727fc700 1 --2- 172.21.15.78:0/3481920997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d737fe700 1 -- 172.21.15.78:0/3481920997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 msgr2=0x7f7d7406f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:06.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d737fe700 1 --2- 172.21.15.78:0/3481920997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7406f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d737fe700 1 -- 172.21.15.78:0/3481920997 >> v1:172.21.15.78:6789/0 conn(0x7f7d7415c7c0 legacy=0x7f7d740ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.220+0000 7f7d737fe700 1 -- 172.21.15.78:0/3481920997 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7415cb90 con 0x7f7d740cfde0 2023-06-09T11:12:06.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d737fe700 1 --2- 172.21.15.78:0/3481920997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d7406fdc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009dc0 tx=0x7f7d6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc907c9af18a246a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:06.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d71ffb700 1 -- 172.21.15.78:0/3481920997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00e070 con 0x7f7d740cfde0 2023-06-09T11:12:06.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d71ffb700 1 -- 172.21.15.78:0/3481920997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c00bae0 con 0x7f7d740cfde0 2023-06-09T11:12:06.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d71ffb700 1 -- 172.21.15.78:0/3481920997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00be90 con 0x7f7d740cfde0 2023-06-09T11:12:06.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 -- 172.21.15.78:0/3481920997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 msgr2=0x7f7d7406fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 --2- 172.21.15.78:0/3481920997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d7406fdc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009dc0 tx=0x7f7d6c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:06.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 -- 172.21.15.78:0/3481920997 shutdown_connections 2023-06-09T11:12:06.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 --2- 172.21.15.78:0/3481920997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d7406fdc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 --2- 172.21.15.78:0/3481920997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7406f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 -- 172.21.15.78:0/3481920997 >> 172.21.15.78:0/3481920997 conn(0x7f7d740b1ac0 msgr2=0x7f7d740cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:06.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 -- 172.21.15.78:0/3481920997 shutdown_connections 2023-06-09T11:12:06.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 -- 172.21.15.78:0/3481920997 wait complete. 2023-06-09T11:12:06.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.224+0000 7f7d79950700 1 Processor -- start 2023-06-09T11:12:06.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 -- start start 2023-06-09T11:12:06.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d740c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d7415c7c0 0x7f7d740ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740b2cb0 con 0x7f7d740cfde0 2023-06-09T11:12:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c91b0 con 0x7f7d7415c7c0 2023-06-09T11:12:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7415eb00 con 0x7f7d740cd600 2023-06-09T11:12:06.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d740c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d740c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42146/0 (socket says 172.21.15.78:42146) 2023-06-09T11:12:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 -- 172.21.15.78:0/2614264600 learned_addr learned my addr 172.21.15.78:0/2614264600 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d72ffd700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d737fe700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d7415c7c0 0x7f7d740ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 -- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 msgr2=0x7f7d7415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 -- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d7415c7c0 msgr2=0x7f7d740ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d7415c7c0 0x7f7d740ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 -- 172.21.15.78:0/2614264600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c009a70 con 0x7f7d740cfde0 2023-06-09T11:12:06.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d727fc700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d740c8c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009fd0 tx=0x7f7d6800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:06.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d5bfff700 1 -- 172.21.15.78:0/2614264600 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680095a0 con 0x7f7d740cfde0 2023-06-09T11:12:06.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d5bfff700 1 -- 172.21.15.78:0/2614264600 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d68013680 con 0x7f7d740cfde0 2023-06-09T11:12:06.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d5bfff700 1 -- 172.21.15.78:0/2614264600 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68013a30 con 0x7f7d740cfde0 2023-06-09T11:12:06.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d741607b0 con 0x7f7d740cfde0 2023-06-09T11:12:06.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.228+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d741604d0 con 0x7f7d740cfde0 2023-06-09T11:12:06.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.232+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d74160a90 con 0x7f7d740cfde0 2023-06-09T11:12:06.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.232+0000 7f7d5bfff700 1 -- 172.21.15.78:0/2614264600 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d68013b90 con 0x7f7d740cfde0 2023-06-09T11:12:06.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.232+0000 7f7d5bfff700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7d60066320 0x7f7d600687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.232+0000 7f7d5bfff700 1 -- 172.21.15.78:0/2614264600 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7d68083be0 con 0x7f7d740cfde0 2023-06-09T11:12:06.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.236+0000 7f7d72ffd700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7d60066320 0x7f7d600687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.236+0000 7f7d72ffd700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7d60066320 0x7f7d600687d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005930 tx=0x7f7d64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:06.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.240+0000 7f7d5bfff700 1 -- 172.21.15.78:0/2614264600 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7d680513a0 con 0x7f7d740cfde0 2023-06-09T11:12:06.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.412+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7d740741c0 con 0x7f7d740cfde0 2023-06-09T11:12:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.412+0000 7f7d5bfff700 1 -- 172.21.15.78:0/2614264600 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7d68021090 con 0x7f7d740cfde0 2023-06-09T11:12:06.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:06.421 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-06-09T11:12:06.421 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:12:06.421 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-06-09T11:12:06.421 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-06-09T11:12:06.422 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:12:06.422 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:12:06.422 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-06-09T11:12:06.422 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-06-09T11:12:06.422 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:12:06.422 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-06-09T11:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7d60066320 msgr2=0x7f7d600687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7d60066320 0x7f7d600687d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005930 tx=0x7f7d64009040 comp rx=0 tx=0).stop 2023-06-09T11:12:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 msgr2=0x7f7d740c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d740c8c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009fd0 tx=0x7f7d6800eb20 comp rx=0 tx=0).stop 2023-06-09T11:12:06.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 shutdown_connections 2023-06-09T11:12:06.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7d60066320 0x7f7d600687d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d7415c7c0 0x7f7d740ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d740cfde0 0x7f7d740c8c70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 --2- 172.21.15.78:0/2614264600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d740cd600 0x7f7d7415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 >> 172.21.15.78:0/2614264600 conn(0x7f7d740b1ac0 msgr2=0x7f7d740ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:06.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 shutdown_connections 2023-06-09T11:12:06.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.416+0000 7f7d79950700 1 -- 172.21.15.78:0/2614264600 wait complete. 2023-06-09T11:12:06.444 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T11:12:06.445 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T11:12:06.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.616+0000 7f87fd7ba700 1 Processor -- start 2023-06-09T11:12:06.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.616+0000 7f87fd7ba700 1 -- start start 2023-06-09T11:12:06.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87fd7ba700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f87f815b470 0x7f87f80ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87fd7ba700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80ced20 0x7f87f806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87fd7ba700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f80cb260 con 0x7f87f80b6590 2023-06-09T11:12:06.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87fd7ba700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f815b8e0 con 0x7f87f815b470 2023-06-09T11:12:06.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87fd7ba700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f806fab0 con 0x7f87f80ced20 2023-06-09T11:12:06.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87f6ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f87f80b6590 0x7f87f80cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:57528/0 (socket says 172.21.15.78:57528) 2023-06-09T11:12:06.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87f6ffd700 1 -- 172.21.15.78:0/4111419482 learned_addr learned my addr 172.21.15.78:0/4111419482 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:06.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87effff700 1 --2- 172.21.15.78:0/4111419482 >> v2:172.21.15.187:3300/0 conn(0x7f87f815b470 0x7f87f80ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87f77fe700 1 --2- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80ced20 0x7f87f806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87f67fc700 1 -- 172.21.15.78:0/4111419482 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376590348 0 0) 0x7f87f80cb260 con 0x7f87f80b6590 2023-06-09T11:12:06.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.620+0000 7f87f67fc700 1 -- 172.21.15.78:0/4111419482 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e40035d0 con 0x7f87f80b6590 2023-06-09T11:12:06.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87effff700 1 -- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80ced20 msgr2=0x7f87f806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:06.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87effff700 1 --2- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80ced20 0x7f87f806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87effff700 1 -- 172.21.15.78:0/4111419482 >> v1:172.21.15.187:6789/0 conn(0x7f87f80b6590 legacy=0x7f87f80cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87effff700 1 -- 172.21.15.78:0/4111419482 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f80cba70 con 0x7f87f815b470 2023-06-09T11:12:06.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87effff700 1 --2- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 0x7f87f80ce7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009850 tx=0x7f87e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1dd72ddbc09104 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:06.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87f67fc700 1 -- 172.21.15.78:0/4111419482 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0011830 con 0x7f87f815b470 2023-06-09T11:12:06.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87f67fc700 1 -- 172.21.15.78:0/4111419482 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0011990 con 0x7f87f815b470 2023-06-09T11:12:06.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87f67fc700 1 -- 172.21.15.78:0/4111419482 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0011d40 con 0x7f87f815b470 2023-06-09T11:12:06.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 -- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 msgr2=0x7f87f80ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 0x7f87f80ce7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009850 tx=0x7f87e0009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:06.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 -- 172.21.15.78:0/4111419482 shutdown_connections 2023-06-09T11:12:06.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80ced20 0x7f87f806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/4111419482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 0x7f87f80ce7e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 -- 172.21.15.78:0/4111419482 >> 172.21.15.78:0/4111419482 conn(0x7f87f80d0c10 msgr2=0x7f87f80d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:06.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 -- 172.21.15.78:0/4111419482 shutdown_connections 2023-06-09T11:12:06.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.624+0000 7f87fd7ba700 1 -- 172.21.15.78:0/4111419482 wait complete. 2023-06-09T11:12:06.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 Processor -- start 2023-06-09T11:12:06.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 -- start start 2023-06-09T11:12:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80b6590 0x7f87f8153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87f80ced20 0x7f87f80b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 0x7f87f80c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c7620 con 0x7f87f80ced20 2023-06-09T11:12:06.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80c6e50 con 0x7f87f815b470 2023-06-09T11:12:06.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87fd7ba700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f80b2140 con 0x7f87f80b6590 2023-06-09T11:12:06.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87effff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87f80ced20 0x7f87f80b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87effff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87f80ced20 0x7f87f80b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42160/0 (socket says 172.21.15.78:42160) 2023-06-09T11:12:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87f6ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80b6590 0x7f87f8153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87effff700 1 -- 172.21.15.78:0/137198591 learned_addr learned my addr 172.21.15.78:0/137198591 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.628+0000 7f87f77fe700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 0x7f87f80c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87effff700 1 -- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80b6590 msgr2=0x7f87f8153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87effff700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80b6590 0x7f87f8153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87effff700 1 -- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 msgr2=0x7f87f80c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87effff700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 0x7f87f80c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87effff700 1 -- 172.21.15.78:0/137198591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00094b0 con 0x7f87f80ced20 2023-06-09T11:12:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87effff700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87f80ced20 0x7f87f80b0670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f87e0014040 tx=0x7f87e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87ef7fe700 1 -- 172.21.15.78:0/137198591 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0004510 con 0x7f87f80ced20 2023-06-09T11:12:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87ef7fe700 1 -- 172.21.15.78:0/137198591 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e001e070 con 0x7f87f80ced20 2023-06-09T11:12:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f80cb790 con 0x7f87f80ced20 2023-06-09T11:12:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87ef7fe700 1 -- 172.21.15.78:0/137198591 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0003900 con 0x7f87f80ced20 2023-06-09T11:12:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f80cb4b0 con 0x7f87f80ced20 2023-06-09T11:12:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.632+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f8070480 con 0x7f87f80ced20 2023-06-09T11:12:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.636+0000 7f87ef7fe700 1 -- 172.21.15.78:0/137198591 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87e0003a60 con 0x7f87f80ced20 2023-06-09T11:12:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.636+0000 7f87ef7fe700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87d8066320 0x7f87d80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:06.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.636+0000 7f87ef7fe700 1 -- 172.21.15.78:0/137198591 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f87e0020070 con 0x7f87f80ced20 2023-06-09T11:12:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.636+0000 7f87f6ffd700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87d8066320 0x7f87d80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:06.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.640+0000 7f87f6ffd700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87d8066320 0x7f87d80687d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87e8007fd0 tx=0x7f87e8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:06.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.644+0000 7f87ef7fe700 1 -- 172.21.15.78:0/137198591 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f87e00524e0 con 0x7f87f80ced20 2023-06-09T11:12:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:06.820+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f87f80741c0 con 0x7f87f80ced20 2023-06-09T11:12:07.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.240+0000 7f87ef7fe700 1 -- 172.21.15.78:0/137198591 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f87e0006ce0 con 0x7f87f80ced20 2023-06-09T11:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87d8066320 msgr2=0x7f87d80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87d8066320 0x7f87d80687d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87e8007fd0 tx=0x7f87e8007de0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87f80ced20 msgr2=0x7f87f80b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87f80ced20 0x7f87f80b0670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f87e0014040 tx=0x7f87e0004770 comp rx=0 tx=0).stop 2023-06-09T11:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 shutdown_connections 2023-06-09T11:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87d8066320 0x7f87d80687d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f815b470 0x7f87f80c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87f80ced20 0x7f87f80b0670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 --2- 172.21.15.78:0/137198591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f80b6590 0x7f87f8153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 >> 172.21.15.78:0/137198591 conn(0x7f87f80d0c10 msgr2=0x7f87f806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 shutdown_connections 2023-06-09T11:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.244+0000 7f87fd7ba700 1 -- 172.21.15.78:0/137198591 wait complete. 2023-06-09T11:12:07.255 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-06-09T11:12:07.275 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T11:12:07.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.448+0000 7f6f9e584700 1 Processor -- start 2023-06-09T11:12:07.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.448+0000 7f6f9e584700 1 -- start start 2023-06-09T11:12:07.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9e584700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6f98142bc0 0x7f6f98069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:07.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9e584700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980707a0 0x7f6f98070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9e584700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f98142f90 con 0x7f6f980d0c00 2023-06-09T11:12:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9e584700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f98071260 con 0x7f6f98142bc0 2023-06-09T11:12:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9e584700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980c8120 con 0x7f6f980707a0 2023-06-09T11:12:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6f98142bc0 0x7f6f98069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9cd81700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980707a0 0x7f6f98070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6f98142bc0 0x7f6f98069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:56132/0 (socket says 172.21.15.78:56132) 2023-06-09T11:12:07.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 -- 172.21.15.78:0/88842440 learned_addr learned my addr 172.21.15.78:0/88842440 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:07.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 -- 172.21.15.78:0/88842440 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980707a0 msgr2=0x7f6f98070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 --2- 172.21.15.78:0/88842440 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980707a0 0x7f6f98070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 -- 172.21.15.78:0/88842440 >> v1:172.21.15.187:6789/0 conn(0x7f6f980d0c00 legacy=0x7f6f980c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 -- 172.21.15.78:0/88842440 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980c8400 con 0x7f6f98142bc0 2023-06-09T11:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f9d582700 1 --2- 172.21.15.78:0/88842440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 0x7f6f98069ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009910 tx=0x7f6f94009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3366aa2864fb5ac server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f8ffff700 1 -- 172.21.15.78:0/88842440 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94011830 con 0x7f6f98142bc0 2023-06-09T11:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f8ffff700 1 -- 172.21.15.78:0/88842440 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94011990 con 0x7f6f98142bc0 2023-06-09T11:12:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.452+0000 7f6f8ffff700 1 -- 172.21.15.78:0/88842440 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94011d40 con 0x7f6f98142bc0 2023-06-09T11:12:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- 172.21.15.78:0/88842440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 msgr2=0x7f6f98069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 --2- 172.21.15.78:0/88842440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 0x7f6f98069ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009910 tx=0x7f6f94009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- 172.21.15.78:0/88842440 shutdown_connections 2023-06-09T11:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 --2- 172.21.15.78:0/88842440 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980707a0 0x7f6f98070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 --2- 172.21.15.78:0/88842440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 0x7f6f98069ed0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- 172.21.15.78:0/88842440 >> 172.21.15.78:0/88842440 conn(0x7f6f980d3ba0 msgr2=0x7f6f980cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- 172.21.15.78:0/88842440 shutdown_connections 2023-06-09T11:12:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- 172.21.15.78:0/88842440 wait complete. 2023-06-09T11:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 Processor -- start 2023-06-09T11:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- start start 2023-06-09T11:12:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f980707a0 0x7f6f98145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980d0c00 0x7f6f98142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 0x7f6f981407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98142540 con 0x7f6f980707a0 2023-06-09T11:12:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98140ce0 con 0x7f6f98142bc0 2023-06-09T11:12:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.456+0000 7f6f9e584700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98140f60 con 0x7f6f980d0c00 2023-06-09T11:12:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f980707a0 0x7f6f98145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f980707a0 0x7f6f98145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42164/0 (socket says 172.21.15.78:42164) 2023-06-09T11:12:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 -- 172.21.15.78:0/2028813037 learned_addr learned my addr 172.21.15.78:0/2028813037 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9dd83700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 0x7f6f981407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9cd81700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980d0c00 0x7f6f98142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 -- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980d0c00 msgr2=0x7f6f98142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980d0c00 0x7f6f98142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 -- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 msgr2=0x7f6f981407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 0x7f6f981407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 -- 172.21.15.78:0/2028813037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009570 con 0x7f6f980707a0 2023-06-09T11:12:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9d582700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f980707a0 0x7f6f98145be0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009f70 tx=0x7f6f94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f8dffb700 1 -- 172.21.15.78:0/2028813037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94004510 con 0x7f6f980707a0 2023-06-09T11:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f8dffb700 1 -- 172.21.15.78:0/2028813037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9401e070 con 0x7f6f980707a0 2023-06-09T11:12:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f8dffb700 1 -- 172.21.15.78:0/2028813037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94003900 con 0x7f6f980707a0 2023-06-09T11:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f980c89c0 con 0x7f6f980707a0 2023-06-09T11:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.460+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f980c86e0 con 0x7f6f980707a0 2023-06-09T11:12:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.464+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9806fab0 con 0x7f6f980707a0 2023-06-09T11:12:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.464+0000 7f6f8dffb700 1 -- 172.21.15.78:0/2028813037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f94003a60 con 0x7f6f980707a0 2023-06-09T11:12:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.468+0000 7f6f8dffb700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6f7c0662f0 0x7f6f7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.468+0000 7f6f8dffb700 1 -- 172.21.15.78:0/2028813037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f6f94084b10 con 0x7f6f980707a0 2023-06-09T11:12:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.468+0000 7f6f9cd81700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6f7c0662f0 0x7f6f7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.468+0000 7f6f9cd81700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6f7c0662f0 0x7f6f7c0687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f9806e1c0 tx=0x7f6f88009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.472+0000 7f6f8dffb700 1 -- 172.21.15.78:0/2028813037 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6f940521e0 con 0x7f6f980707a0 2023-06-09T11:12:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:07.644+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6f980741f0 con 0x7f6f980707a0 2023-06-09T11:12:08.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.260+0000 7f6f8dffb700 1 -- 172.21.15.78:0/2028813037 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6f940200d0 con 0x7f6f980707a0 2023-06-09T11:12:08.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.280+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6f7c0662f0 msgr2=0x7f6f7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.280+0000 7f6f9e584700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6f7c0662f0 0x7f6f7c0687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f9806e1c0 tx=0x7f6f88009240 comp rx=0 tx=0).stop 2023-06-09T11:12:08.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.280+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f980707a0 msgr2=0x7f6f98145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.280+0000 7f6f9e584700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f980707a0 0x7f6f98145be0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009f70 tx=0x7f6f94004770 comp rx=0 tx=0).stop 2023-06-09T11:12:08.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 shutdown_connections 2023-06-09T11:12:08.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6f7c0662f0 0x7f6f7c0687a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f98142bc0 0x7f6f981407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f980d0c00 0x7f6f98142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 --2- 172.21.15.78:0/2028813037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f980707a0 0x7f6f98145be0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 >> 172.21.15.78:0/2028813037 conn(0x7f6f980d3ba0 msgr2=0x7f6f9806fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:08.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 shutdown_connections 2023-06-09T11:12:08.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.288+0000 7f6f9e584700 1 -- 172.21.15.78:0/2028813037 wait complete. 2023-06-09T11:12:08.385 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-06-09T11:12:08.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T11:12:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.560+0000 7f85830d1700 1 Processor -- start 2023-06-09T11:12:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.560+0000 7f85830d1700 1 -- start start 2023-06-09T11:12:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.560+0000 7f85830d1700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f857c15c9f0 0x7f857c160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.560+0000 7f85830d1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c0d1380 0x7f857c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f85830d1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0cda60 con 0x7f857c06d790 2023-06-09T11:12:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f85830d1700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c160d70 con 0x7f857c15c9f0 2023-06-09T11:12:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f85830d1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c161050 con 0x7f857c0d1380 2023-06-09T11:12:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f857c15c9f0 0x7f857c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f858166e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c0d1380 0x7f857c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f857c15c9f0 0x7f857c160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:56146/0 (socket says 172.21.15.78:56146) 2023-06-09T11:12:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 -- 172.21.15.78:0/2251202623 learned_addr learned my addr 172.21.15.78:0/2251202623 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 -- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c0d1380 msgr2=0x7f857c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 --2- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c0d1380 0x7f857c0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 -- 172.21.15.78:0/2251202623 >> v1:172.21.15.187:6789/0 conn(0x7f857c06d790 legacy=0x7f857c0d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 -- 172.21.15.78:0/2251202623 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c161330 con 0x7f857c15c9f0 2023-06-09T11:12:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f857b7fe700 1 -- 172.21.15.78:0/2251202623 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927779479 0 0) 0x7f857c0cda60 con 0x7f857c06d790 2023-06-09T11:12:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f858166e700 1 --2- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c0d1380 0x7f857c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:08.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f8580e6d700 1 --2- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c15c9f0 0x7f857c160520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8570009910 tx=0x7f8570009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d7226bfacf9e83 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f857b7fe700 1 -- 172.21.15.78:0/2251202623 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011830 con 0x7f857c15c9f0 2023-06-09T11:12:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f857b7fe700 1 -- 172.21.15.78:0/2251202623 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570011990 con 0x7f857c15c9f0 2023-06-09T11:12:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.564+0000 7f857b7fe700 1 -- 172.21.15.78:0/2251202623 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011d40 con 0x7f857c15c9f0 2023-06-09T11:12:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 -- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c15c9f0 msgr2=0x7f857c160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 --2- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c15c9f0 0x7f857c160520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8570009910 tx=0x7f8570009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:08.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 -- 172.21.15.78:0/2251202623 shutdown_connections 2023-06-09T11:12:08.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 --2- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c0d1380 0x7f857c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 --2- 172.21.15.78:0/2251202623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c15c9f0 0x7f857c160520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 -- 172.21.15.78:0/2251202623 >> 172.21.15.78:0/2251202623 conn(0x7f857c0b4c90 msgr2=0x7f857c0b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:08.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 -- 172.21.15.78:0/2251202623 shutdown_connections 2023-06-09T11:12:08.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 -- 172.21.15.78:0/2251202623 wait complete. 2023-06-09T11:12:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.568+0000 7f85830d1700 1 Processor -- start 2023-06-09T11:12:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85830d1700 1 -- start start 2023-06-09T11:12:08.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85830d1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c06d790 0x7f857c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:08.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85830d1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f857c0d1380 0x7f857c0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:08.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85830d1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c15c9f0 0x7f857c0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:08.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85830d1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0c94b0 con 0x7f857c0d1380 2023-06-09T11:12:08.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85830d1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0cc860 con 0x7f857c06d790 2023-06-09T11:12:08.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85830d1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0b77f0 con 0x7f857c15c9f0 2023-06-09T11:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f857c0d1380 0x7f857c0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f857c0d1380 0x7f857c0b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42178/0 (socket says 172.21.15.78:42178) 2023-06-09T11:12:08.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 -- 172.21.15.78:0/2171971307 learned_addr learned my addr 172.21.15.78:0/2171971307 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:08.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f8580e6d700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c06d790 0x7f857c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:08.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f858166e700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c15c9f0 0x7f857c0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:08.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 -- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c15c9f0 msgr2=0x7f857c0b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c15c9f0 0x7f857c0b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 -- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c06d790 msgr2=0x7f857c0c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c06d790 0x7f857c0c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 -- 172.21.15.78:0/2171971307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574009a70 con 0x7f857c0d1380 2023-06-09T11:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f857bfff700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f857c0d1380 0x7f857c0b69a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85680011e0 tx=0x7f856800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.572+0000 7f85797fa700 1 -- 172.21.15.78:0/2171971307 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680054e0 con 0x7f857c0d1380 2023-06-09T11:12:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.576+0000 7f85797fa700 1 -- 172.21.15.78:0/2171971307 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85680036a0 con 0x7f857c0d1380 2023-06-09T11:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.576+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8570009570 con 0x7f857c0d1380 2023-06-09T11:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.576+0000 7f85797fa700 1 -- 172.21.15.78:0/2171971307 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568003a50 con 0x7f857c0d1380 2023-06-09T11:12:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.576+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c15cdc0 con 0x7f857c0d1380 2023-06-09T11:12:08.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.576+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c0cd6f0 con 0x7f857c0d1380 2023-06-09T11:12:08.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.580+0000 7f85797fa700 1 -- 172.21.15.78:0/2171971307 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8568003bb0 con 0x7f857c0d1380 2023-06-09T11:12:08.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.580+0000 7f85797fa700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f85600662f0 0x7f85600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:08.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.580+0000 7f85797fa700 1 -- 172.21.15.78:0/2171971307 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f8568083220 con 0x7f857c0d1380 2023-06-09T11:12:08.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.580+0000 7f8580e6d700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f85600662f0 0x7f85600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:08.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.580+0000 7f8580e6d700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f85600662f0 0x7f85600687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8570014040 tx=0x7f8570008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:08.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.588+0000 7f85797fa700 1 -- 172.21.15.78:0/2171971307 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f85680506f0 con 0x7f857c0d1380 2023-06-09T11:12:08.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.792+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f857c160a60 con 0x7f857c0d1380 2023-06-09T11:12:08.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.808+0000 7f85797fa700 1 -- 172.21.15.78:0/2171971307 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8568003e60 con 0x7f857c0d1380 2023-06-09T11:12:08.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.812+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f85600662f0 msgr2=0x7f85600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.812+0000 7f85830d1700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f85600662f0 0x7f85600687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8570014040 tx=0x7f8570008030 comp rx=0 tx=0).stop 2023-06-09T11:12:08.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.812+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f857c0d1380 msgr2=0x7f857c0b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:08.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.812+0000 7f85830d1700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f857c0d1380 0x7f857c0b69a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85680011e0 tx=0x7f856800cae0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 shutdown_connections 2023-06-09T11:12:08.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f85600662f0 0x7f85600687a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f857c15c9f0 0x7f857c0b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f857c0d1380 0x7f857c0b69a0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85680011e0 tx=0x7f856800cae0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 --2- 172.21.15.78:0/2171971307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f857c06d790 0x7f857c0c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:08.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 >> 172.21.15.78:0/2171971307 conn(0x7f857c0b4c90 msgr2=0x7f857c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:08.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 shutdown_connections 2023-06-09T11:12:08.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:08.816+0000 7f85830d1700 1 -- 172.21.15.78:0/2171971307 wait complete. 2023-06-09T11:12:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 3 and data pool 4 2023-06-09T11:12:08.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:09.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.016+0000 7fe145146700 1 Processor -- start 2023-06-09T11:12:09.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.016+0000 7fe145146700 1 -- start start 2023-06-09T11:12:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe145146700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe14015a4b0 0x7fe14015a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe145146700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe140071160 con 0x7fe14006dfe0 2023-06-09T11:12:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe145146700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1400b47a0 con 0x7fe14006e8f0 2023-06-09T11:12:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe145146700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe140069ed0 con 0x7fe14015a4b0 2023-06-09T11:12:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13f59e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe14006dfe0 0x7fe14006f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43364/0 (socket says 172.21.15.78:43364) 2023-06-09T11:12:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13f59e700 1 -- 172.21.15.78:0/1451063016 learned_addr learned my addr 172.21.15.78:0/1451063016 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13ed9d700 1 --2- 172.21.15.78:0/1451063016 >> v2:172.21.15.187:3300/0 conn(0x7fe14015a4b0 0x7fe14015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196274383 0 0) 0x7fe140071160 con 0x7fe14006dfe0 2023-06-09T11:12:09.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1280035d0 con 0x7fe14006dfe0 2023-06-09T11:12:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140788265 0 0) 0x7fe1280035d0 con 0x7fe14006dfe0 2023-06-09T11:12:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 >> v2:172.21.15.187:3300/0 conn(0x7fe14015a4b0 msgr2=0x7fe14015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 --2- 172.21.15.78:0/1451063016 >> v2:172.21.15.187:3300/0 conn(0x7fe14015a4b0 0x7fe14015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 >> v1:172.21.15.187:6789/0 conn(0x7fe14006e8f0 legacy=0x7fe14006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14006a0e0 con 0x7fe14006dfe0 2023-06-09T11:12:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7fe138001a10 con 0x7fe14006dfe0 2023-06-09T11:12:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 >> v1:172.21.15.78:6789/0 conn(0x7fe14006dfe0 legacy=0x7fe14006f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe128003a20 0x7fe128003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe128004410 0x7fe1280048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe12800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe140069ed0 con 0x7fe1280050d0 2023-06-09T11:12:09.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12800bf70 con 0x7fe128003a20 2023-06-09T11:12:09.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.020+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12800c130 con 0x7fe128004410 2023-06-09T11:12:09.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe12800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13ed9d700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe128003a20 0x7fe128003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13e59c700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe128004410 0x7fe1280048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 -- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe128004410 msgr2=0x7fe1280048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:09.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe128004410 0x7fe1280048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 -- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe128003a20 msgr2=0x7fe128003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:09.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe128003a20 0x7fe128003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 -- 172.21.15.78:0/1451063016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280035d0 con 0x7fe1280050d0 2023-06-09T11:12:09.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13e59c700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe128004410 0x7fe1280048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:09.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 -- 172.21.15.78:0/1451063016 reap_dead start 2023-06-09T11:12:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13f59e700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe12800ba30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe13800a7c0 tx=0x7fe1280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aebb2b444961e12 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800a2b0 con 0x7fe1280050d0 2023-06-09T11:12:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380072d0 con 0x7fe1280050d0 2023-06-09T11:12:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe13dd9b700 1 -- 172.21.15.78:0/1451063016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138007680 con 0x7fe1280050d0 2023-06-09T11:12:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe145146700 1 -- 172.21.15.78:0/1451063016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 msgr2=0x7fe12800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe145146700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe12800ba30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe13800a7c0 tx=0x7fe1280058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe145146700 1 -- 172.21.15.78:0/1451063016 shutdown_connections 2023-06-09T11:12:09.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe145146700 1 --2- 172.21.15.78:0/1451063016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe12800ba30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe145146700 1 -- 172.21.15.78:0/1451063016 >> 172.21.15.78:0/1451063016 conn(0x7fe1400b1480 msgr2=0x7fe1400cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:09.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe145146700 1 -- 172.21.15.78:0/1451063016 shutdown_connections 2023-06-09T11:12:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.024+0000 7fe145146700 1 -- 172.21.15.78:0/1451063016 wait complete. 2023-06-09T11:12:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 Processor -- start 2023-06-09T11:12:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 -- start start 2023-06-09T11:12:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe140154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1400c99c0 0x7fe14015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe14006f880 0x7fe14006fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1401f1b70 con 0x7fe1280050d0 2023-06-09T11:12:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe140070230 con 0x7fe1400c99c0 2023-06-09T11:12:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe145146700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe140156170 con 0x7fe14006f880 2023-06-09T11:12:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe140154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe140154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42186/0 (socket says 172.21.15.78:42186) 2023-06-09T11:12:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 -- 172.21.15.78:0/3045814952 learned_addr learned my addr 172.21.15.78:0/3045814952 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13f59e700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe14006f880 0x7fe14006fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13e59c700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1400c99c0 0x7fe14015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 -- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe14006f880 msgr2=0x7fe14006fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe14006f880 0x7fe14006fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 -- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1400c99c0 msgr2=0x7fe14015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1400c99c0 0x7fe14015c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 -- 172.21.15.78:0/3045814952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14006a6a0 con 0x7fe1280050d0 2023-06-09T11:12:09.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13f59e700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe14006f880 0x7fe14006fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:09.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe13ed9d700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe140154cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe1300119b0 tx=0x7fe130011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.028+0000 7fe1277fe700 1 -- 172.21.15.78:0/3045814952 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000f940 con 0x7fe1280050d0 2023-06-09T11:12:09.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.032+0000 7fe1277fe700 1 -- 172.21.15.78:0/3045814952 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13000faa0 con 0x7fe1280050d0 2023-06-09T11:12:09.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.032+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14006a3c0 con 0x7fe1280050d0 2023-06-09T11:12:09.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.032+0000 7fe1277fe700 1 -- 172.21.15.78:0/3045814952 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000fe30 con 0x7fe1280050d0 2023-06-09T11:12:09.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.032+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14006abc0 con 0x7fe1280050d0 2023-06-09T11:12:09.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.032+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400741c0 con 0x7fe1280050d0 2023-06-09T11:12:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.032+0000 7fe1277fe700 1 -- 172.21.15.78:0/3045814952 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe130014440 con 0x7fe1280050d0 2023-06-09T11:12:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.036+0000 7fe1277fe700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe12c0662f0 0x7fe12c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.036+0000 7fe1277fe700 1 -- 172.21.15.78:0/3045814952 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe130084550 con 0x7fe1280050d0 2023-06-09T11:12:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.036+0000 7fe13e59c700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe12c0662f0 0x7fe12c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.036+0000 7fe13e59c700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe12c0662f0 0x7fe12c0687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1400ce250 tx=0x7fe134009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.040+0000 7fe1277fe700 1 -- 172.21.15.78:0/3045814952 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe130055330 con 0x7fe1280050d0 2023-06-09T11:12:09.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.208+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe14006b350 con 0x7fe1280050d0 2023-06-09T11:12:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.212+0000 7fe1277fe700 1 -- 172.21.15.78:0/3045814952 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18256 (secure 0 0 0) 0x7fe130022090 con 0x7fe1280050d0 2023-06-09T11:12:09.220 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:09.220 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:08.796713+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:09.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe12c0662f0 msgr2=0x7fe12c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe12c0662f0 0x7fe12c0687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1400ce250 tx=0x7fe134009040 comp rx=0 tx=0).stop 2023-06-09T11:12:09.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 msgr2=0x7fe140154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe140154cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe1300119b0 tx=0x7fe130011d70 comp rx=0 tx=0).stop 2023-06-09T11:12:09.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 shutdown_connections 2023-06-09T11:12:09.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe12c0662f0 0x7fe12c0687a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe14006f880 0x7fe14006fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1400c99c0 0x7fe14015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 --2- 172.21.15.78:0/3045814952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1280050d0 0x7fe140154cf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 >> 172.21.15.78:0/3045814952 conn(0x7fe1400b1480 msgr2=0x7fe1400cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:09.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 shutdown_connections 2023-06-09T11:12:09.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.216+0000 7fe145146700 1 -- 172.21.15.78:0/3045814952 wait complete. 2023-06-09T11:12:09.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:09.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.404+0000 7f9d323a8700 1 Processor -- start 2023-06-09T11:12:09.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.408+0000 7f9d323a8700 1 -- start start 2023-06-09T11:12:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.408+0000 7f9d323a8700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9d2c06fc80 0x7f9d2c070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.408+0000 7f9d323a8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0c87a0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.408+0000 7f9d323a8700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c070590 con 0x7f9d2c15c880 2023-06-09T11:12:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.408+0000 7f9d323a8700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c06e660 con 0x7f9d2c06fc80 2023-06-09T11:12:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d31ba7700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9d2c0c7cb0 0x7f9d2c06a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43372/0 (socket says 172.21.15.78:43372) 2023-06-09T11:12:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d31ba7700 1 -- 172.21.15.78:0/4285873554 learned_addr learned my addr 172.21.15.78:0/4285873554 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d313a6700 1 --2- 172.21.15.78:0/4285873554 >> v2:172.21.15.187:3300/0 conn(0x7f9d2c06fc80 0x7f9d2c070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d23fff700 1 -- 172.21.15.78:0/4285873554 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305051220 0 0) 0x7f9d2c0c87a0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d23fff700 1 -- 172.21.15.78:0/4285873554 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d180035d0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d313a6700 1 -- 172.21.15.78:0/4285873554 >> v1:172.21.15.187:6789/0 conn(0x7f9d2c15c880 legacy=0x7f9d2c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d313a6700 1 -- 172.21.15.78:0/4285873554 >> v1:172.21.15.78:6789/0 conn(0x7f9d2c0c7cb0 legacy=0x7f9d2c06a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d313a6700 1 -- 172.21.15.78:0/4285873554 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0c81e0 con 0x7f9d2c06fc80 2023-06-09T11:12:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d313a6700 1 --2- 172.21.15.78:0/4285873554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c06fc80 0x7f9d2c070050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009880 tx=0x7f9d28009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179ea178807bb036 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d23fff700 1 -- 172.21.15.78:0/4285873554 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28011830 con 0x7f9d2c06fc80 2023-06-09T11:12:09.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d23fff700 1 -- 172.21.15.78:0/4285873554 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d28011990 con 0x7f9d2c06fc80 2023-06-09T11:12:09.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d23fff700 1 -- 172.21.15.78:0/4285873554 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28011d20 con 0x7f9d2c06fc80 2023-06-09T11:12:09.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d323a8700 1 -- 172.21.15.78:0/4285873554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c06fc80 msgr2=0x7f9d2c070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d323a8700 1 --2- 172.21.15.78:0/4285873554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c06fc80 0x7f9d2c070050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009880 tx=0x7f9d28009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d323a8700 1 -- 172.21.15.78:0/4285873554 shutdown_connections 2023-06-09T11:12:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d323a8700 1 --2- 172.21.15.78:0/4285873554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c06fc80 0x7f9d2c070050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d323a8700 1 -- 172.21.15.78:0/4285873554 >> 172.21.15.78:0/4285873554 conn(0x7f9d2c0cf870 msgr2=0x7f9d2c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.412+0000 7f9d323a8700 1 -- 172.21.15.78:0/4285873554 shutdown_connections 2023-06-09T11:12:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 -- 172.21.15.78:0/4285873554 wait complete. 2023-06-09T11:12:09.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 Processor -- start 2023-06-09T11:12:09.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 -- start start 2023-06-09T11:12:09.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c06fc80 0x7f9d2c159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d2c0c7cb0 0x7f9d2c15fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c15c880 0x7f9d2c15dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1f1d20 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1605a0 con 0x7f9d2c15c880 2023-06-09T11:12:09.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d323a8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c15e210 con 0x7f9d2c06fc80 2023-06-09T11:12:09.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d2c0c7cb0 0x7f9d2c15fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d2c0c7cb0 0x7f9d2c15fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42198/0 (socket says 172.21.15.78:42198) 2023-06-09T11:12:09.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 -- 172.21.15.78:0/681958 learned_addr learned my addr 172.21.15.78:0/681958 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:09.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d31ba7700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c15c880 0x7f9d2c15dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d313a6700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c06fc80 0x7f9d2c159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 -- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c06fc80 msgr2=0x7f9d2c159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c06fc80 0x7f9d2c159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 -- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c15c880 msgr2=0x7f9d2c15dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c15c880 0x7f9d2c15dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.416+0000 7f9d30ba5700 1 -- 172.21.15.78:0/681958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280094b0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.420+0000 7f9d30ba5700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d2c0c7cb0 0x7f9d2c15fea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c530 tx=0x7f9d1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.420+0000 7f9d21ffb700 1 -- 172.21.15.78:0/681958 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0052d0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.420+0000 7f9d21ffb700 1 -- 172.21.15.78:0/681958 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c005430 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.420+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c06a070 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.420+0000 7f9d21ffb700 1 -- 172.21.15.78:0/681958 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0055a0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.420+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c0c84c0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.420+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c06a350 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.424+0000 7f9d21ffb700 1 -- 172.21.15.78:0/681958 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d1c0038e0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.424+0000 7f9d21ffb700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9d100662f0 0x7f9d100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.424+0000 7f9d21ffb700 1 -- 172.21.15.78:0/681958 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d1c0830f0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.424+0000 7f9d313a6700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9d100662f0 0x7f9d100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.428+0000 7f9d313a6700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9d100662f0 0x7f9d100687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d280090b0 tx=0x7f9d28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.432+0000 7f9d21ffb700 1 -- 172.21.15.78:0/681958 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9d1c050570 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.604+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d2c0741c0 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.604+0000 7f9d21ffb700 1 -- 172.21.15.78:0/681958 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f9d1c053b90 con 0x7f9d2c0c7cb0 2023-06-09T11:12:09.614 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:09.615 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:08.796713+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:09.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9d100662f0 msgr2=0x7f9d100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9d100662f0 0x7f9d100687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d280090b0 tx=0x7f9d28008030 comp rx=0 tx=0).stop 2023-06-09T11:12:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d2c0c7cb0 msgr2=0x7f9d2c15fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d2c0c7cb0 0x7f9d2c15fea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c530 tx=0x7f9d1c00c8f0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 shutdown_connections 2023-06-09T11:12:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9d100662f0 0x7f9d100687a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d2c15c880 0x7f9d2c15dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d2c0c7cb0 0x7f9d2c15fea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 --2- 172.21.15.78:0/681958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c06fc80 0x7f9d2c159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 >> 172.21.15.78:0/681958 conn(0x7f9d2c0cf870 msgr2=0x7f9d2c0d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:09.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 shutdown_connections 2023-06-09T11:12:09.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.608+0000 7f9d323a8700 1 -- 172.21.15.78:0/681958 wait complete. 2023-06-09T11:12:09.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T11:12:09.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb566451700 1 Processor -- start 2023-06-09T11:12:09.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb566451700 1 -- start start 2023-06-09T11:12:09.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb566451700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5600ce0b0 0x7fb5600cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb566451700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5600d01b0 0x7fb5600cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb566451700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb560072210 con 0x7fb560071e40 2023-06-09T11:12:09.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb566451700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5600d0630 con 0x7fb5600d01b0 2023-06-09T11:12:09.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb566451700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56015cd60 con 0x7fb5600ce0b0 2023-06-09T11:12:09.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb55ffff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb560071e40 0x7fb560160da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:57584/0 (socket says 172.21.15.78:57584) 2023-06-09T11:12:09.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb5649ee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb5600d01b0 0x7fb5600cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb55ffff700 1 -- 172.21.15.78:0/660023647 learned_addr learned my addr 172.21.15.78:0/660023647 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:09.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.804+0000 7fb55f7fe700 1 --2- 172.21.15.78:0/660023647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5600ce0b0 0x7fb5600cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb5649ee700 1 -- 172.21.15.78:0/660023647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5600ce0b0 msgr2=0x7fb5600cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:09.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb5649ee700 1 --2- 172.21.15.78:0/660023647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5600ce0b0 0x7fb5600cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb5649ee700 1 -- 172.21.15.78:0/660023647 >> v1:172.21.15.187:6789/0 conn(0x7fb560071e40 legacy=0x7fb560160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb5649ee700 1 -- 172.21.15.78:0/660023647 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600b17a0 con 0x7fb5600d01b0 2023-06-09T11:12:09.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb5649ee700 1 --2- 172.21.15.78:0/660023647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600d01b0 0x7fb5600cc880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb558009d90 tx=0x7fb55800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c38f05a4b742843 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb55effd700 1 -- 172.21.15.78:0/660023647 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800e070 con 0x7fb5600d01b0 2023-06-09T11:12:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb55effd700 1 -- 172.21.15.78:0/660023647 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800bb20 con 0x7fb5600d01b0 2023-06-09T11:12:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.808+0000 7fb55effd700 1 -- 172.21.15.78:0/660023647 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558012430 con 0x7fb5600d01b0 2023-06-09T11:12:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 -- 172.21.15.78:0/660023647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600d01b0 msgr2=0x7fb5600cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 --2- 172.21.15.78:0/660023647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600d01b0 0x7fb5600cc880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb558009d90 tx=0x7fb55800b330 comp rx=0 tx=0).stop 2023-06-09T11:12:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 -- 172.21.15.78:0/660023647 shutdown_connections 2023-06-09T11:12:09.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 --2- 172.21.15.78:0/660023647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600d01b0 0x7fb5600cc880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 --2- 172.21.15.78:0/660023647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5600ce0b0 0x7fb5600cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 -- 172.21.15.78:0/660023647 >> 172.21.15.78:0/660023647 conn(0x7fb5600b2c70 msgr2=0x7fb5600b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:09.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 -- 172.21.15.78:0/660023647 shutdown_connections 2023-06-09T11:12:09.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 -- 172.21.15.78:0/660023647 wait complete. 2023-06-09T11:12:09.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 Processor -- start 2023-06-09T11:12:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.812+0000 7fb566451700 1 -- start start 2023-06-09T11:12:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb566451700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb560071e40 0x7fb5600ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb566451700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600ce0b0 0x7fb5601589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb566451700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5600d01b0 0x7fb560158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb566451700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600ad590 con 0x7fb5600ce0b0 2023-06-09T11:12:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb566451700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600ac9c0 con 0x7fb5600d01b0 2023-06-09T11:12:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb566451700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600acc60 con 0x7fb560071e40 2023-06-09T11:12:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb5649ee700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5600d01b0 0x7fb560158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600ce0b0 0x7fb5601589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb5649ee700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5600d01b0 0x7fb560158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:56228/0 (socket says 172.21.15.78:56228) 2023-06-09T11:12:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb5649ee700 1 -- 172.21.15.78:0/1914959819 learned_addr learned my addr 172.21.15.78:0/1914959819 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55ffff700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb560071e40 0x7fb5600ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55f7fe700 1 -- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb560071e40 msgr2=0x7fb5600ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55f7fe700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb560071e40 0x7fb5600ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55f7fe700 1 -- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5600d01b0 msgr2=0x7fb560158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55f7fe700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5600d01b0 0x7fb560158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55f7fe700 1 -- 172.21.15.78:0/1914959819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558009a70 con 0x7fb5600ce0b0 2023-06-09T11:12:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55ffff700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb560071e40 0x7fb5600ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.816+0000 7fb55f7fe700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600ce0b0 0x7fb5601589d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e900 tx=0x7fb55400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.820+0000 7fb55cff9700 1 -- 172.21.15.78:0/1914959819 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554013680 con 0x7fb5600ce0b0 2023-06-09T11:12:09.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.820+0000 7fb55cff9700 1 -- 172.21.15.78:0/1914959819 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540137e0 con 0x7fb5600ce0b0 2023-06-09T11:12:09.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.820+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5600b1d60 con 0x7fb5600ce0b0 2023-06-09T11:12:09.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.820+0000 7fb55cff9700 1 -- 172.21.15.78:0/1914959819 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554013b50 con 0x7fb5600ce0b0 2023-06-09T11:12:09.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.820+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5600b1a80 con 0x7fb5600ce0b0 2023-06-09T11:12:09.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.820+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5600b2040 con 0x7fb5600ce0b0 2023-06-09T11:12:09.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.820+0000 7fb55cff9700 1 -- 172.21.15.78:0/1914959819 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb554013cb0 con 0x7fb5600ce0b0 2023-06-09T11:12:09.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.824+0000 7fb55cff9700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb54c0662f0 0x7fb54c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:09.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.824+0000 7fb55cff9700 1 -- 172.21.15.78:0/1914959819 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb554083ca0 con 0x7fb5600ce0b0 2023-06-09T11:12:09.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.824+0000 7fb55ffff700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb54c0662f0 0x7fb54c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:09.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.824+0000 7fb55ffff700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb54c0662f0 0x7fb54c0687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb550005930 tx=0x7fb550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:09.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:09.828+0000 7fb55cff9700 1 -- 172.21.15.78:0/1914959819 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb554054ba0 con 0x7fb5600ce0b0 2023-06-09T11:12:10.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.036+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb5600b1240 con 0x7fb5600ce0b0 2023-06-09T11:12:10.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.820+0000 7fb55cff9700 1 -- 172.21.15.78:0/1914959819 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb5540210b0 con 0x7fb5600ce0b0 2023-06-09T11:12:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb54c0662f0 msgr2=0x7fb54c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb54c0662f0 0x7fb54c0687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb550005930 tx=0x7fb550009040 comp rx=0 tx=0).stop 2023-06-09T11:12:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600ce0b0 msgr2=0x7fb5601589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600ce0b0 0x7fb5601589d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e900 tx=0x7fb55400ec10 comp rx=0 tx=0).stop 2023-06-09T11:12:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 shutdown_connections 2023-06-09T11:12:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb54c0662f0 0x7fb54c0687a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5600d01b0 0x7fb560158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5600ce0b0 0x7fb5601589d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 --2- 172.21.15.78:0/1914959819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb560071e40 0x7fb5600ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 >> 172.21.15.78:0/1914959819 conn(0x7fb5600b2c70 msgr2=0x7fb560160120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 shutdown_connections 2023-06-09T11:12:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:10.828+0000 7fb566451700 1 -- 172.21.15.78:0/1914959819 wait complete. 2023-06-09T11:12:10.859 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T11:12:10.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T11:12:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.032+0000 7fbbdf59e700 1 Processor -- start 2023-06-09T11:12:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.036+0000 7fbbdf59e700 1 -- start start 2023-06-09T11:12:11.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.036+0000 7fbbdf59e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbe0146c50 0x7fbbe00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:11.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.036+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe0161610 0x7fbbe006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdf59e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe006a070 con 0x7fbbe006b6e0 2023-06-09T11:12:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdf59e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe006a310 con 0x7fbbe0146c50 2023-06-09T11:12:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe006a5f0 con 0x7fbbe0161610 2023-06-09T11:12:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbde59c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbe0146c50 0x7fbbe00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbded9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe0161610 0x7fbbe006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbded9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe0161610 0x7fbbe006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:33364/0 (socket says 172.21.15.78:33364) 2023-06-09T11:12:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbde59c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbe0146c50 0x7fbbe00b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:56230/0 (socket says 172.21.15.78:56230) 2023-06-09T11:12:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbded9d700 1 -- 172.21.15.78:0/1440173486 learned_addr learned my addr 172.21.15.78:0/1440173486 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdd59a700 1 -- 172.21.15.78:0/1440173486 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084959659 0 0) 0x7fbbe006a070 con 0x7fbbe006b6e0 2023-06-09T11:12:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdd59a700 1 -- 172.21.15.78:0/1440173486 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc80035d0 con 0x7fbbe006b6e0 2023-06-09T11:12:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbde59c700 1 -- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe0161610 msgr2=0x7fbbe006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbde59c700 1 --2- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe0161610 0x7fbbe006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:11.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbde59c700 1 -- 172.21.15.78:0/1440173486 >> v1:172.21.15.187:6789/0 conn(0x7fbbe006b6e0 legacy=0x7fbbe0160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:11.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbde59c700 1 -- 172.21.15.78:0/1440173486 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe006a8d0 con 0x7fbbe0146c50 2023-06-09T11:12:11.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbded9d700 1 --2- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe0161610 0x7fbbe006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:11.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbde59c700 1 --2- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00b2590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009d90 tx=0x7fbbd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599980b8f33f42fb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:11.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdd59a700 1 -- 172.21.15.78:0/1440173486 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000e070 con 0x7fbbe0146c50 2023-06-09T11:12:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdd59a700 1 -- 172.21.15.78:0/1440173486 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000bb20 con 0x7fbbe0146c50 2023-06-09T11:12:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.040+0000 7fbbdd59a700 1 -- 172.21.15.78:0/1440173486 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0012430 con 0x7fbbe0146c50 2023-06-09T11:12:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 -- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 msgr2=0x7fbbe00b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:11.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00b2590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009d90 tx=0x7fbbd000b330 comp rx=0 tx=0).stop 2023-06-09T11:12:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 -- 172.21.15.78:0/1440173486 shutdown_connections 2023-06-09T11:12:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe0161610 0x7fbbe006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/1440173486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00b2590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 -- 172.21.15.78:0/1440173486 >> 172.21.15.78:0/1440173486 conn(0x7fbbe00b0780 msgr2=0x7fbbe00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 -- 172.21.15.78:0/1440173486 shutdown_connections 2023-06-09T11:12:11.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 -- 172.21.15.78:0/1440173486 wait complete. 2023-06-09T11:12:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.044+0000 7fbbdf59e700 1 Processor -- start 2023-06-09T11:12:11.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 -- start start 2023-06-09T11:12:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe006b6e0 0x7fbbe00c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe0161610 0x7fbbe0145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00c3fd0 con 0x7fbbe0161610 2023-06-09T11:12:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe01f81d0 con 0x7fbbe0146c50 2023-06-09T11:12:11.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00cbe20 con 0x7fbbe006b6e0 2023-06-09T11:12:11.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe0161610 0x7fbbe0145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:11.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe0161610 0x7fbbe0145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42230/0 (socket says 172.21.15.78:42230) 2023-06-09T11:12:11.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 -- 172.21.15.78:0/2864463892 learned_addr learned my addr 172.21.15.78:0/2864463892 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:11.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbde59c700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe006b6e0 0x7fbbe00c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:11.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbddd9b700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:11.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 -- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe006b6e0 msgr2=0x7fbbe00c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:11.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe006b6e0 0x7fbbe00c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:11.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 -- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 msgr2=0x7fbbe00cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:11.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:11.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 -- 172.21.15.78:0/2864463892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009570 con 0x7fbbe0161610 2023-06-09T11:12:11.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbde59c700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe006b6e0 0x7fbbe00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:11.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbddd9b700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:11.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbded9d700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe0161610 0x7fbbe0145d00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800eb60 tx=0x7fbbd800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:11.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbceffd700 1 -- 172.21.15.78:0/2864463892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800c910 con 0x7fbbe0161610 2023-06-09T11:12:11.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbceffd700 1 -- 172.21.15.78:0/2864463892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800ca70 con 0x7fbbe0161610 2023-06-09T11:12:11.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd0009a70 con 0x7fbbe0161610 2023-06-09T11:12:11.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbceffd700 1 -- 172.21.15.78:0/2864463892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800ce20 con 0x7fbbe0161610 2023-06-09T11:12:11.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.048+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe006b0d0 con 0x7fbbe0161610 2023-06-09T11:12:11.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.052+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe006abb0 con 0x7fbbe0161610 2023-06-09T11:12:11.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.052+0000 7fbbceffd700 1 -- 172.21.15.78:0/2864463892 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbd8013470 con 0x7fbbe0161610 2023-06-09T11:12:11.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.056+0000 7fbbceffd700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbbc00662f0 0x7fbbc00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:11.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.056+0000 7fbbceffd700 1 -- 172.21.15.78:0/2864463892 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbd8084310 con 0x7fbbe0161610 2023-06-09T11:12:11.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.056+0000 7fbbde59c700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbbc00662f0 0x7fbbc00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:11.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.056+0000 7fbbde59c700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbbc00662f0 0x7fbbc00687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0000f80 tx=0x7fbbd0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.060+0000 7fbbceffd700 1 -- 172.21.15.78:0/2864463892 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbbd8055210 con 0x7fbbe0161610 2023-06-09T11:12:11.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:11.264+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbbe00b2ad0 con 0x7fbbe0161610 2023-06-09T11:12:12.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.176+0000 7fbbceffd700 1 -- 172.21.15.78:0/2864463892 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbbd8054da0 con 0x7fbbe0161610 2023-06-09T11:12:12.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbbc00662f0 msgr2=0x7fbbc00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbbc00662f0 0x7fbbc00687a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0000f80 tx=0x7fbbd0011000 comp rx=0 tx=0).stop 2023-06-09T11:12:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe0161610 msgr2=0x7fbbe0145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe0161610 0x7fbbe0145d00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800eb60 tx=0x7fbbd800ef20 comp rx=0 tx=0).stop 2023-06-09T11:12:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 shutdown_connections 2023-06-09T11:12:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbbc00662f0 0x7fbbc00687a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe0161610 0x7fbbe0145d00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe0146c50 0x7fbbe00cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 --2- 172.21.15.78:0/2864463892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe006b6e0 0x7fbbe00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 >> 172.21.15.78:0/2864463892 conn(0x7fbbe00b0780 msgr2=0x7fbbe0164bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:12.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 shutdown_connections 2023-06-09T11:12:12.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.180+0000 7fbbdf59e700 1 -- 172.21.15.78:0/2864463892 wait complete. 2023-06-09T11:12:12.212 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T11:12:12.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:12.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84251bc700 1 Processor -- start 2023-06-09T11:12:12.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84251bc700 1 -- start start 2023-06-09T11:12:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84251bc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015e670 0x7f842006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84251bc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84200ce470 0x7f842006f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84251bc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200cc8e0 con 0x7f842015a3e0 2023-06-09T11:12:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84251bc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842015a7b0 con 0x7f84200ce470 2023-06-09T11:12:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84251bc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84200ccb80 con 0x7f842015e670 2023-06-09T11:12:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f84249bb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84200ce470 0x7f842006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f841ffff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f842015a3e0 0x7f842015df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:57604/0 (socket says 172.21.15.78:57604) 2023-06-09T11:12:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f841ffff700 1 -- 172.21.15.78:0/1557741309 learned_addr learned my addr 172.21.15.78:0/1557741309 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.376+0000 7f841f7fe700 1 --2- 172.21.15.78:0/1557741309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015e670 0x7f842006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f841effd700 1 -- 172.21.15.78:0/1557741309 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640428419 0 0) 0x7f84200cc8e0 con 0x7f842015a3e0 2023-06-09T11:12:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f841effd700 1 -- 172.21.15.78:0/1557741309 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84080035d0 con 0x7f842015a3e0 2023-06-09T11:12:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84249bb700 1 -- 172.21.15.78:0/1557741309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015e670 msgr2=0x7f842006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84249bb700 1 --2- 172.21.15.78:0/1557741309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015e670 0x7f842006e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84249bb700 1 -- 172.21.15.78:0/1557741309 >> v1:172.21.15.187:6789/0 conn(0x7f842015a3e0 legacy=0x7f842015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84249bb700 1 -- 172.21.15.78:0/1557741309 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842006b470 con 0x7f84200ce470 2023-06-09T11:12:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84249bb700 1 --2- 172.21.15.78:0/1557741309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842006f090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8418009850 tx=0x7f8418009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efbf03ec0c4c52e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f841effd700 1 -- 172.21.15.78:0/1557741309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418011830 con 0x7f84200ce470 2023-06-09T11:12:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f841effd700 1 -- 172.21.15.78:0/1557741309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418011990 con 0x7f84200ce470 2023-06-09T11:12:12.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f841effd700 1 -- 172.21.15.78:0/1557741309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418011d40 con 0x7f84200ce470 2023-06-09T11:12:12.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 -- 172.21.15.78:0/1557741309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 msgr2=0x7f842006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 --2- 172.21.15.78:0/1557741309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842006f090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8418009850 tx=0x7f8418009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:12.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 -- 172.21.15.78:0/1557741309 shutdown_connections 2023-06-09T11:12:12.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 --2- 172.21.15.78:0/1557741309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842006f090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 --2- 172.21.15.78:0/1557741309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015e670 0x7f842006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 -- 172.21.15.78:0/1557741309 >> 172.21.15.78:0/1557741309 conn(0x7f84200cf670 msgr2=0x7f84200cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:12.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 -- 172.21.15.78:0/1557741309 shutdown_connections 2023-06-09T11:12:12.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.380+0000 7f84251bc700 1 -- 172.21.15.78:0/1557741309 wait complete. 2023-06-09T11:12:12.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 Processor -- start 2023-06-09T11:12:12.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 -- start start 2023-06-09T11:12:12.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015a3e0 0x7f842014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f842015e670 0x7f84200c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842015c380 con 0x7f84200ce470 2023-06-09T11:12:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842015dc90 con 0x7f842015e670 2023-06-09T11:12:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.384+0000 7f84251bc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842014ea90 con 0x7f842015a3e0 2023-06-09T11:12:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842015d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42244/0 (socket says 172.21.15.78:42244) 2023-06-09T11:12:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 -- 172.21.15.78:0/2945916507 learned_addr learned my addr 172.21.15.78:0/2945916507 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:12.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 -- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015a3e0 msgr2=0x7f842014e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015a3e0 0x7f842014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 -- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f842015e670 msgr2=0x7f84200c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f842015e670 0x7f84200c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 -- 172.21.15.78:0/2945916507 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180094b0 con 0x7f84200ce470 2023-06-09T11:12:12.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841ffff700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842015d750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f841000cbc0 tx=0x7f841000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:12.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841cff9700 1 -- 172.21.15.78:0/2945916507 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000a9e0 con 0x7f84200ce470 2023-06-09T11:12:12.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841cff9700 1 -- 172.21.15.78:0/2945916507 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000ab40 con 0x7f84200ce470 2023-06-09T11:12:12.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8420070240 con 0x7f84200ce470 2023-06-09T11:12:12.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f841cff9700 1 -- 172.21.15.78:0/2945916507 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410012400 con 0x7f84200ce470 2023-06-09T11:12:12.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842006b750 con 0x7f84200ce470 2023-06-09T11:12:12.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.388+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84200703d0 con 0x7f84200ce470 2023-06-09T11:12:12.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.392+0000 7f841cff9700 1 -- 172.21.15.78:0/2945916507 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f841001b3b0 con 0x7f84200ce470 2023-06-09T11:12:12.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.392+0000 7f841cff9700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f840c0662f0 0x7f840c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.392+0000 7f841cff9700 1 -- 172.21.15.78:0/2945916507 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8410083920 con 0x7f84200ce470 2023-06-09T11:12:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.392+0000 7f841f7fe700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f840c0662f0 0x7f840c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.396+0000 7f841f7fe700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f840c0662f0 0x7f840c0687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8414006b40 tx=0x7f8414006ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:12.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.400+0000 7f841cff9700 1 -- 172.21.15.78:0/2945916507 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8410050d00 con 0x7f84200ce470 2023-06-09T11:12:12.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.604+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84200741f0 con 0x7f84200ce470 2023-06-09T11:12:12.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.604+0000 7f841cff9700 1 -- 172.21.15.78:0/2945916507 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f8410054320 con 0x7f84200ce470 2023-06-09T11:12:12.612 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:12.613 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:12.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f840c0662f0 msgr2=0x7f840c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f840c0662f0 0x7f840c0687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8414006b40 tx=0x7f8414006ad0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 msgr2=0x7f842015d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842015d750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f841000cbc0 tx=0x7f841000cca0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 shutdown_connections 2023-06-09T11:12:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f840c0662f0 0x7f840c0687a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f842015e670 0x7f84200c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f842015a3e0 0x7f842014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 --2- 172.21.15.78:0/2945916507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84200ce470 0x7f842015d750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 >> 172.21.15.78:0/2945916507 conn(0x7f84200cf670 msgr2=0x7f84200c4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:12.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 shutdown_connections 2023-06-09T11:12:12.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.608+0000 7f84251bc700 1 -- 172.21.15.78:0/2945916507 wait complete. 2023-06-09T11:12:12.619 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:12.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:12.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.796+0000 7fd6e297f700 1 Processor -- start 2023-06-09T11:12:12.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.796+0000 7fd6e297f700 1 -- start start 2023-06-09T11:12:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6e297f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc160e90 0x7fd6dc0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6e297f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd6dc06d8d0 0x7fd6dc06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6e297f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc06fdd0 con 0x7fd6dc0adfd0 2023-06-09T11:12:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6e297f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06f880 con 0x7fd6dc06d8d0 2023-06-09T11:12:12.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6e297f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc070970 con 0x7fd6dc160e90 2023-06-09T11:12:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6dbfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd6dc0adfd0 0x7fd6dc070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:57620/0 (socket says 172.21.15.78:57620) 2023-06-09T11:12:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6dbfff700 1 -- 172.21.15.78:0/2626792073 learned_addr learned my addr 172.21.15.78:0/2626792073 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6d37fe700 1 --2- 172.21.15.78:0/2626792073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc160e90 0x7fd6dc0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6e0f1c700 1 --2- 172.21.15.78:0/2626792073 >> v2:172.21.15.187:3300/0 conn(0x7fd6dc06d8d0 0x7fd6dc06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6db7fe700 1 -- 172.21.15.78:0/2626792073 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253527961 0 0) 0x7fd6dc06fdd0 con 0x7fd6dc0adfd0 2023-06-09T11:12:12.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6db7fe700 1 -- 172.21.15.78:0/2626792073 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c80035d0 con 0x7fd6dc0adfd0 2023-06-09T11:12:12.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6d37fe700 1 -- 172.21.15.78:0/2626792073 >> v2:172.21.15.187:3300/0 conn(0x7fd6dc06d8d0 msgr2=0x7fd6dc06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:12.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6d37fe700 1 --2- 172.21.15.78:0/2626792073 >> v2:172.21.15.187:3300/0 conn(0x7fd6dc06d8d0 0x7fd6dc06dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6d37fe700 1 -- 172.21.15.78:0/2626792073 >> v1:172.21.15.187:6789/0 conn(0x7fd6dc0adfd0 legacy=0x7fd6dc070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6d37fe700 1 -- 172.21.15.78:0/2626792073 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc1612e0 con 0x7fd6dc160e90 2023-06-09T11:12:12.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.800+0000 7fd6d37fe700 1 --2- 172.21.15.78:0/2626792073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc160e90 0x7fd6dc0cc810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009850 tx=0x7fd6c4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37714574fd873aa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:12.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6db7fe700 1 -- 172.21.15.78:0/2626792073 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4011830 con 0x7fd6dc160e90 2023-06-09T11:12:12.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6db7fe700 1 -- 172.21.15.78:0/2626792073 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4011990 con 0x7fd6dc160e90 2023-06-09T11:12:12.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6db7fe700 1 -- 172.21.15.78:0/2626792073 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4011d40 con 0x7fd6dc160e90 2023-06-09T11:12:12.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 -- 172.21.15.78:0/2626792073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc160e90 msgr2=0x7fd6dc0cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 --2- 172.21.15.78:0/2626792073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc160e90 0x7fd6dc0cc810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009850 tx=0x7fd6c4009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:12.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 -- 172.21.15.78:0/2626792073 shutdown_connections 2023-06-09T11:12:12.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 --2- 172.21.15.78:0/2626792073 >> v2:172.21.15.187:3300/0 conn(0x7fd6dc06d8d0 0x7fd6dc06dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 --2- 172.21.15.78:0/2626792073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc160e90 0x7fd6dc0cc810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 -- 172.21.15.78:0/2626792073 >> 172.21.15.78:0/2626792073 conn(0x7fd6dc0b1480 msgr2=0x7fd6dc0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:12.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 -- 172.21.15.78:0/2626792073 shutdown_connections 2023-06-09T11:12:12.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.804+0000 7fd6e297f700 1 -- 172.21.15.78:0/2626792073 wait complete. 2023-06-09T11:12:12.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 Processor -- start 2023-06-09T11:12:12.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 -- start start 2023-06-09T11:12:12.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6dc06d8d0 0x7fd6dc14c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc0adfd0 0x7fd6dc0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc160e90 0x7fd6dc0ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc15acb0 con 0x7fd6dc160e90 2023-06-09T11:12:12.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc14c850 con 0x7fd6dc06d8d0 2023-06-09T11:12:12.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c7220 con 0x7fd6dc0adfd0 2023-06-09T11:12:12.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc160e90 0x7fd6dc0ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc160e90 0x7fd6dc0ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42260/0 (socket says 172.21.15.78:42260) 2023-06-09T11:12:12.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 -- 172.21.15.78:0/316353550 learned_addr learned my addr 172.21.15.78:0/316353550 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6dbfff700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6dc06d8d0 0x7fd6dc14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6d37fe700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc0adfd0 0x7fd6dc0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 -- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc0adfd0 msgr2=0x7fd6dc0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc0adfd0 0x7fd6dc0ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 -- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6dc06d8d0 msgr2=0x7fd6dc14c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:12.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6dc06d8d0 0x7fd6dc14c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:12.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 -- 172.21.15.78:0/316353550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40094b0 con 0x7fd6dc160e90 2023-06-09T11:12:12.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e0f1c700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc160e90 0x7fd6dc0ad560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400efc0 tx=0x7fd6d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:12.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6d97fa700 1 -- 172.21.15.78:0/316353550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4009ba0 con 0x7fd6dc160e90 2023-06-09T11:12:12.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6d97fa700 1 -- 172.21.15.78:0/316353550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400f040 con 0x7fd6dc160e90 2023-06-09T11:12:12.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6d97fa700 1 -- 172.21.15.78:0/316353550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4014480 con 0x7fd6dc160e90 2023-06-09T11:12:12.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.808+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0ccf40 con 0x7fd6dc160e90 2023-06-09T11:12:12.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.812+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc0ae3a0 con 0x7fd6dc160e90 2023-06-09T11:12:12.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.812+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc0cd220 con 0x7fd6dc160e90 2023-06-09T11:12:12.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.816+0000 7fd6d97fa700 1 -- 172.21.15.78:0/316353550 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6d40145e0 con 0x7fd6dc160e90 2023-06-09T11:12:12.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.816+0000 7fd6d97fa700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6bc0662f0 0x7fd6bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:12.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.816+0000 7fd6d97fa700 1 -- 172.21.15.78:0/316353550 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6d4084660 con 0x7fd6dc160e90 2023-06-09T11:12:12.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.816+0000 7fd6dbfff700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6bc0662f0 0x7fd6bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:12.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.816+0000 7fd6dbfff700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6bc0662f0 0x7fd6bc0687a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0011e0 tx=0x7fd6cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:12.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.824+0000 7fd6d97fa700 1 -- 172.21.15.78:0/316353550 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd6d4051a40 con 0x7fd6dc160e90 2023-06-09T11:12:12.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.988+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6dc0741c0 con 0x7fd6dc160e90 2023-06-09T11:12:13.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.992+0000 7fd6d97fa700 1 -- 172.21.15.78:0/316353550 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7fd6d4055060 con 0x7fd6dc160e90 2023-06-09T11:12:13.001 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:13.002 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:13.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6bc0662f0 msgr2=0x7fd6bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6bc0662f0 0x7fd6bc0687a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0011e0 tx=0x7fd6cc009040 comp rx=0 tx=0).stop 2023-06-09T11:12:13.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc160e90 msgr2=0x7fd6dc0ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc160e90 0x7fd6dc0ad560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400efc0 tx=0x7fd6d400c3a0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 shutdown_connections 2023-06-09T11:12:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6bc0662f0 0x7fd6bc0687a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc160e90 0x7fd6dc0ad560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6dc0adfd0 0x7fd6dc0ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 --2- 172.21.15.78:0/316353550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6dc06d8d0 0x7fd6dc14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 >> 172.21.15.78:0/316353550 conn(0x7fd6dc0b1480 msgr2=0x7fd6dc0ac030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:13.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 shutdown_connections 2023-06-09T11:12:13.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:12.996+0000 7fd6e297f700 1 -- 172.21.15.78:0/316353550 wait complete. 2023-06-09T11:12:13.026 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T11:12:13.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:12:13.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.188+0000 7fd9e4f41700 1 Processor -- start 2023-06-09T11:12:13.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.188+0000 7fd9e4f41700 1 -- start start 2023-06-09T11:12:13.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd9e015c880 0x7fd9e006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e00c87a0 con 0x7fd9e006fc80 2023-06-09T11:12:13.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e00c81e0 con 0x7fd9e00c7cb0 2023-06-09T11:12:13.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e00c84c0 con 0x7fd9e015c880 2023-06-09T11:12:13.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9df7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd9e006fc80 0x7fd9e0070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43382/0 (socket says 172.21.15.78:43382) 2023-06-09T11:12:13.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9df7fe700 1 -- 172.21.15.78:0/227347995 learned_addr learned my addr 172.21.15.78:0/227347995 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:13.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9deffd700 1 --2- 172.21.15.78:0/227347995 >> v2:172.21.15.78:3300/0 conn(0x7fd9e015c880 0x7fd9e006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9de7fc700 1 -- 172.21.15.78:0/227347995 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247362306 0 0) 0x7fd9e00c87a0 con 0x7fd9e006fc80 2023-06-09T11:12:13.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9de7fc700 1 -- 172.21.15.78:0/227347995 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c80035d0 con 0x7fd9e006fc80 2023-06-09T11:12:13.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9deffd700 1 -- 172.21.15.78:0/227347995 >> v1:172.21.15.187:6789/0 conn(0x7fd9e00c7cb0 legacy=0x7fd9e006a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9deffd700 1 -- 172.21.15.78:0/227347995 >> v1:172.21.15.78:6789/0 conn(0x7fd9e006fc80 legacy=0x7fd9e0070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9deffd700 1 -- 172.21.15.78:0/227347995 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e006a070 con 0x7fd9e015c880 2023-06-09T11:12:13.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9deffd700 1 --2- 172.21.15.78:0/227347995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e006df50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009880 tx=0x7fd9d4009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d7c6ec992df4c7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:13.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9de7fc700 1 -- 172.21.15.78:0/227347995 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4011830 con 0x7fd9e015c880 2023-06-09T11:12:13.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9de7fc700 1 -- 172.21.15.78:0/227347995 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4011990 con 0x7fd9e015c880 2023-06-09T11:12:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9de7fc700 1 -- 172.21.15.78:0/227347995 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4011d20 con 0x7fd9e015c880 2023-06-09T11:12:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- 172.21.15.78:0/227347995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 msgr2=0x7fd9e006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/227347995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e006df50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009880 tx=0x7fd9d4009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- 172.21.15.78:0/227347995 shutdown_connections 2023-06-09T11:12:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/227347995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e006df50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- 172.21.15.78:0/227347995 >> 172.21.15.78:0/227347995 conn(0x7fd9e00cf870 msgr2=0x7fd9e00cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:13.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- 172.21.15.78:0/227347995 shutdown_connections 2023-06-09T11:12:13.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.192+0000 7fd9e4f41700 1 -- 172.21.15.78:0/227347995 wait complete. 2023-06-09T11:12:13.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.196+0000 7fd9e4f41700 1 Processor -- start 2023-06-09T11:12:13.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.196+0000 7fd9e4f41700 1 -- start start 2023-06-09T11:12:13.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9e006fc80 0x7fd9e0154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9e00c7cb0 0x7fd9e015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e00d1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e015dd70 con 0x7fd9e015c880 2023-06-09T11:12:13.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00b5d40 con 0x7fd9e00c7cb0 2023-06-09T11:12:13.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e015dad0 con 0x7fd9e006fc80 2023-06-09T11:12:13.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e00d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e00d1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42278/0 (socket says 172.21.15.78:42278) 2023-06-09T11:12:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 -- 172.21.15.78:0/928658960 learned_addr learned my addr 172.21.15.78:0/928658960 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9df7fe700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9e006fc80 0x7fd9e0154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9deffd700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9e00c7cb0 0x7fd9e015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 -- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9e006fc80 msgr2=0x7fd9e0154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9e006fc80 0x7fd9e0154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 -- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9e00c7cb0 msgr2=0x7fd9e015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9e00c7cb0 0x7fd9e015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 -- 172.21.15.78:0/928658960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40094b0 con 0x7fd9e015c880 2023-06-09T11:12:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9deffd700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9e00c7cb0 0x7fd9e015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9df7fe700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9e006fc80 0x7fd9e0154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9dffff700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e00d1240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800cc50 tx=0x7fd9d800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9c7fff700 1 -- 172.21.15.78:0/928658960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800ad80 con 0x7fd9e015c880 2023-06-09T11:12:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9c7fff700 1 -- 172.21.15.78:0/928658960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d800ce50 con 0x7fd9e015c880 2023-06-09T11:12:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9c7fff700 1 -- 172.21.15.78:0/928658960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8003c60 con 0x7fd9e015c880 2023-06-09T11:12:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e006e490 con 0x7fd9e015c880 2023-06-09T11:12:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e006a350 con 0x7fd9e015c880 2023-06-09T11:12:13.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.200+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e00b5eb0 con 0x7fd9e015c880 2023-06-09T11:12:13.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.204+0000 7fd9c7fff700 1 -- 172.21.15.78:0/928658960 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9d80050d0 con 0x7fd9e015c880 2023-06-09T11:12:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.204+0000 7fd9c7fff700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9cc0662f0 0x7fd9cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.204+0000 7fd9c7fff700 1 -- 172.21.15.78:0/928658960 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9d8083e80 con 0x7fd9e015c880 2023-06-09T11:12:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.204+0000 7fd9df7fe700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9cc0662f0 0x7fd9cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.204+0000 7fd9df7fe700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9cc0662f0 0x7fd9cc0687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00011e0 tx=0x7fd9d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:13.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.212+0000 7fd9c7fff700 1 -- 172.21.15.78:0/928658960 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd9d8051260 con 0x7fd9e015c880 2023-06-09T11:12:13.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.392+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9e00741c0 con 0x7fd9cc0662f0 2023-06-09T11:12:13.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.412+0000 7fd9c7fff700 1 -- 172.21.15.78:0/928658960 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286592 (secure 0 0 0) 0x7fd9e00741c0 con 0x7fd9cc0662f0 2023-06-09T11:12:13.427 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:13.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9cc0662f0 msgr2=0x7fd9cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9cc0662f0 0x7fd9cc0687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00011e0 tx=0x7fd9d0009040 comp rx=0 tx=0).stop 2023-06-09T11:12:13.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 msgr2=0x7fd9e00d1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e00d1240 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800cc50 tx=0x7fd9d800a340 comp rx=0 tx=0).stop 2023-06-09T11:12:13.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 shutdown_connections 2023-06-09T11:12:13.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9cc0662f0 0x7fd9cc0687a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9e015c880 0x7fd9e00d1240 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9e00c7cb0 0x7fd9e015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 --2- 172.21.15.78:0/928658960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9e006fc80 0x7fd9e0154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 >> 172.21.15.78:0/928658960 conn(0x7fd9e00cf870 msgr2=0x7fd9e00cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:13.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 shutdown_connections 2023-06-09T11:12:13.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.420+0000 7fd9e4f41700 1 -- 172.21.15.78:0/928658960 wait complete. 2023-06-09T11:12:13.433 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:12:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-06-09T11:12:11.604745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66264,"kb_used_data":3096,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908456,"statfs":{"total":773094113280,"available":773026258944,"internally_reserved":0,"allocated":3170304,"data_stored":1894580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.366355"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838710+0000","last_change":"2023-06-09T11:12:08.821394+0000","last_active":"2023-06-09T11:12:09.838710+0000","last_peered":"2023-06-09T11:12:09.838710+0000","last_clean":"2023-06-09T11:12:09.838710+0000","last_became_active":"2023-06-09T11:12:08.821006+0000","last_became_peered":"2023-06-09T11:12:08.821006+0000","last_unstale":"2023-06-09T11:12:09.838710+0000","last_undegraded":"2023-06-09T11:12:09.838710+0000","last_fullsized":"2023-06-09T11:12:09.838710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823540+0000","last_change":"2023-06-09T11:12:08.838303+0000","last_active":"2023-06-09T11:12:09.823540+0000","last_peered":"2023-06-09T11:12:09.823540+0000","last_clean":"2023-06-09T11:12:09.823540+0000","last_became_active":"2023-06-09T11:12:08.837991+0000","last_became_peered":"2023-06-09T11:12:08.837991+0000","last_unstale":"2023-06-09T11:12:09.823540+0000","last_undegraded":"2023-06-09T11:12:09.823540+0000","last_fullsized":"2023-06-09T11:12:09.823540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824004+0000","last_change":"2023-06-09T11:12:08.839761+0000","last_active":"2023-06-09T11:12:09.824004+0000","last_peered":"2023-06-09T11:12:09.824004+0000","last_clean":"2023-06-09T11:12:09.824004+0000","last_became_active":"2023-06-09T11:12:08.839497+0000","last_became_peered":"2023-06-09T11:12:08.839497+0000","last_unstale":"2023-06-09T11:12:09.824004+0000","last_undegraded":"2023-06-09T11:12:09.824004+0000","last_fullsized":"2023-06-09T11:12:09.824004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.834239+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.833880+0000","last_became_peered":"2023-06-09T11:12:08.833880+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:26:19.609527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140805+0000","last_change":"2023-06-09T11:12:08.820882+0000","last_active":"2023-06-09T11:12:10.140805+0000","last_peered":"2023-06-09T11:12:10.140805+0000","last_clean":"2023-06-09T11:12:10.140805+0000","last_became_active":"2023-06-09T11:12:08.820612+0000","last_became_peered":"2023-06-09T11:12:08.820612+0000","last_unstale":"2023-06-09T11:12:10.140805+0000","last_undegraded":"2023-06-09T11:12:10.140805+0000","last_fullsized":"2023-06-09T11:12:10.140805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822230+0000","last_change":"2023-06-09T11:12:08.827114+0000","last_active":"2023-06-09T11:12:09.822230+0000","last_peered":"2023-06-09T11:12:09.822230+0000","last_clean":"2023-06-09T11:12:09.822230+0000","last_became_active":"2023-06-09T11:12:08.826824+0000","last_became_peered":"2023-06-09T11:12:08.826824+0000","last_unstale":"2023-06-09T11:12:09.822230+0000","last_undegraded":"2023-06-09T11:12:09.822230+0000","last_fullsized":"2023-06-09T11:12:09.822230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845630+0000","last_change":"2023-06-09T11:12:08.843112+0000","last_active":"2023-06-09T11:12:09.845630+0000","last_peered":"2023-06-09T11:12:09.845630+0000","last_clean":"2023-06-09T11:12:09.845630+0000","last_became_active":"2023-06-09T11:12:08.842858+0000","last_became_peered":"2023-06-09T11:12:08.842858+0000","last_unstale":"2023-06-09T11:12:09.845630+0000","last_undegraded":"2023-06-09T11:12:09.845630+0000","last_fullsized":"2023-06-09T11:12:09.845630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822656+0000","last_change":"2023-06-09T11:12:08.830501+0000","last_active":"2023-06-09T11:12:09.822656+0000","last_peered":"2023-06-09T11:12:09.822656+0000","last_clean":"2023-06-09T11:12:09.822656+0000","last_became_active":"2023-06-09T11:12:08.830202+0000","last_became_peered":"2023-06-09T11:12:08.830202+0000","last_unstale":"2023-06-09T11:12:09.822656+0000","last_undegraded":"2023-06-09T11:12:09.822656+0000","last_fullsized":"2023-06-09T11:12:09.822656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140886+0000","last_change":"2023-06-09T11:12:08.828605+0000","last_active":"2023-06-09T11:12:10.140886+0000","last_peered":"2023-06-09T11:12:10.140886+0000","last_clean":"2023-06-09T11:12:10.140886+0000","last_became_active":"2023-06-09T11:12:08.828346+0000","last_became_peered":"2023-06-09T11:12:08.828346+0000","last_unstale":"2023-06-09T11:12:10.140886+0000","last_undegraded":"2023-06-09T11:12:10.140886+0000","last_fullsized":"2023-06-09T11:12:10.140886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823788+0000","last_change":"2023-06-09T11:12:08.838779+0000","last_active":"2023-06-09T11:12:09.823788+0000","last_peered":"2023-06-09T11:12:09.823788+0000","last_clean":"2023-06-09T11:12:09.823788+0000","last_became_active":"2023-06-09T11:12:08.838506+0000","last_became_peered":"2023-06-09T11:12:08.838506+0000","last_unstale":"2023-06-09T11:12:09.823788+0000","last_undegraded":"2023-06-09T11:12:09.823788+0000","last_fullsized":"2023-06-09T11:12:09.823788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824155+0000","last_change":"2023-06-09T11:12:08.827743+0000","last_active":"2023-06-09T11:12:09.824155+0000","last_peered":"2023-06-09T11:12:09.824155+0000","last_clean":"2023-06-09T11:12:09.824155+0000","last_became_active":"2023-06-09T11:12:08.827468+0000","last_became_peered":"2023-06-09T11:12:08.827468+0000","last_unstale":"2023-06-09T11:12:09.824155+0000","last_undegraded":"2023-06-09T11:12:09.824155+0000","last_fullsized":"2023-06-09T11:12:09.824155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:55.115525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.829351+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.829053+0000","last_became_peered":"2023-06-09T11:12:08.829053+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838528+0000","last_change":"2023-06-09T11:12:08.820511+0000","last_active":"2023-06-09T11:12:09.838528+0000","last_peered":"2023-06-09T11:12:09.838528+0000","last_clean":"2023-06-09T11:12:09.838528+0000","last_became_active":"2023-06-09T11:12:08.820231+0000","last_became_peered":"2023-06-09T11:12:08.820231+0000","last_unstale":"2023-06-09T11:12:09.838528+0000","last_undegraded":"2023-06-09T11:12:09.838528+0000","last_fullsized":"2023-06-09T11:12:09.838528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:54:22.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822794+0000","last_change":"2023-06-09T11:12:08.822849+0000","last_active":"2023-06-09T11:12:09.822794+0000","last_peered":"2023-06-09T11:12:09.822794+0000","last_clean":"2023-06-09T11:12:09.822794+0000","last_became_active":"2023-06-09T11:12:08.822563+0000","last_became_peered":"2023-06-09T11:12:08.822563+0000","last_unstale":"2023-06-09T11:12:09.822794+0000","last_undegraded":"2023-06-09T11:12:09.822794+0000","last_fullsized":"2023-06-09T11:12:09.822794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845781+0000","last_change":"2023-06-09T11:12:08.843310+0000","last_active":"2023-06-09T11:12:09.845781+0000","last_peered":"2023-06-09T11:12:09.845781+0000","last_clean":"2023-06-09T11:12:09.845781+0000","last_became_active":"2023-06-09T11:12:08.842999+0000","last_became_peered":"2023-06-09T11:12:08.842999+0000","last_unstale":"2023-06-09T11:12:09.845781+0000","last_undegraded":"2023-06-09T11:12:09.845781+0000","last_fullsized":"2023-06-09T11:12:09.845781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821865+0000","last_change":"2023-06-09T11:12:08.827890+0000","last_active":"2023-06-09T11:12:09.821865+0000","last_peered":"2023-06-09T11:12:09.821865+0000","last_clean":"2023-06-09T11:12:09.821865+0000","last_became_active":"2023-06-09T11:12:08.827592+0000","last_became_peered":"2023-06-09T11:12:08.827592+0000","last_unstale":"2023-06-09T11:12:09.821865+0000","last_undegraded":"2023-06-09T11:12:09.821865+0000","last_fullsized":"2023-06-09T11:12:09.821865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141045+0000","last_change":"2023-06-09T11:12:08.830805+0000","last_active":"2023-06-09T11:12:10.141045+0000","last_peered":"2023-06-09T11:12:10.141045+0000","last_clean":"2023-06-09T11:12:10.141045+0000","last_became_active":"2023-06-09T11:12:08.830542+0000","last_became_peered":"2023-06-09T11:12:08.830542+0000","last_unstale":"2023-06-09T11:12:10.141045+0000","last_undegraded":"2023-06-09T11:12:10.141045+0000","last_fullsized":"2023-06-09T11:12:10.141045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823971+0000","last_change":"2023-06-09T11:12:08.829977+0000","last_active":"2023-06-09T11:12:09.823971+0000","last_peered":"2023-06-09T11:12:09.823971+0000","last_clean":"2023-06-09T11:12:09.823971+0000","last_became_active":"2023-06-09T11:12:08.829646+0000","last_became_peered":"2023-06-09T11:12:08.829646+0000","last_unstale":"2023-06-09T11:12:09.823971+0000","last_undegraded":"2023-06-09T11:12:09.823971+0000","last_fullsized":"2023-06-09T11:12:09.823971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838592+0000","last_change":"2023-06-09T11:12:08.835400+0000","last_active":"2023-06-09T11:12:09.838592+0000","last_peered":"2023-06-09T11:12:09.838592+0000","last_clean":"2023-06-09T11:12:09.838592+0000","last_became_active":"2023-06-09T11:12:08.835057+0000","last_became_peered":"2023-06-09T11:12:08.835057+0000","last_unstale":"2023-06-09T11:12:09.838592+0000","last_undegraded":"2023-06-09T11:12:09.838592+0000","last_fullsized":"2023-06-09T11:12:09.838592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:31:06.835160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823882+0000","last_change":"2023-06-09T11:12:08.834281+0000","last_active":"2023-06-09T11:12:09.823882+0000","last_peered":"2023-06-09T11:12:09.823882+0000","last_clean":"2023-06-09T11:12:09.823882+0000","last_became_active":"2023-06-09T11:12:08.833982+0000","last_became_peered":"2023-06-09T11:12:08.833982+0000","last_unstale":"2023-06-09T11:12:09.823882+0000","last_undegraded":"2023-06-09T11:12:09.823882+0000","last_fullsized":"2023-06-09T11:12:09.823882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846062+0000","last_change":"2023-06-09T11:12:08.844527+0000","last_active":"2023-06-09T11:12:09.846062+0000","last_peered":"2023-06-09T11:12:09.846062+0000","last_clean":"2023-06-09T11:12:09.846062+0000","last_became_active":"2023-06-09T11:12:08.843678+0000","last_became_peered":"2023-06-09T11:12:08.843678+0000","last_unstale":"2023-06-09T11:12:09.846062+0000","last_undegraded":"2023-06-09T11:12:09.846062+0000","last_fullsized":"2023-06-09T11:12:09.846062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140195+0000","last_change":"2023-06-09T11:12:08.838192+0000","last_active":"2023-06-09T11:12:10.140195+0000","last_peered":"2023-06-09T11:12:10.140195+0000","last_clean":"2023-06-09T11:12:10.140195+0000","last_became_active":"2023-06-09T11:12:08.837602+0000","last_became_peered":"2023-06-09T11:12:08.837602+0000","last_unstale":"2023-06-09T11:12:10.140195+0000","last_undegraded":"2023-06-09T11:12:10.140195+0000","last_fullsized":"2023-06-09T11:12:10.140195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819267+0000","last_change":"2023-06-09T11:12:08.827140+0000","last_active":"2023-06-09T11:12:09.819267+0000","last_peered":"2023-06-09T11:12:09.819267+0000","last_clean":"2023-06-09T11:12:09.819267+0000","last_became_active":"2023-06-09T11:12:08.826856+0000","last_became_peered":"2023-06-09T11:12:08.826856+0000","last_unstale":"2023-06-09T11:12:09.819267+0000","last_undegraded":"2023-06-09T11:12:09.819267+0000","last_fullsized":"2023-06-09T11:12:09.819267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846005+0000","last_change":"2023-06-09T11:12:08.845240+0000","last_active":"2023-06-09T11:12:09.846005+0000","last_peered":"2023-06-09T11:12:09.846005+0000","last_clean":"2023-06-09T11:12:09.846005+0000","last_became_active":"2023-06-09T11:12:08.844410+0000","last_became_peered":"2023-06-09T11:12:08.844410+0000","last_unstale":"2023-06-09T11:12:09.846005+0000","last_undegraded":"2023-06-09T11:12:09.846005+0000","last_fullsized":"2023-06-09T11:12:09.846005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849751+0000","last_change":"2023-06-09T11:12:08.837911+0000","last_active":"2023-06-09T11:12:09.849751+0000","last_peered":"2023-06-09T11:12:09.849751+0000","last_clean":"2023-06-09T11:12:09.849751+0000","last_became_active":"2023-06-09T11:12:08.837627+0000","last_became_peered":"2023-06-09T11:12:08.837627+0000","last_unstale":"2023-06-09T11:12:09.849751+0000","last_undegraded":"2023-06-09T11:12:09.849751+0000","last_fullsized":"2023-06-09T11:12:09.849751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849808+0000","last_change":"2023-06-09T11:12:08.834539+0000","last_active":"2023-06-09T11:12:09.849808+0000","last_peered":"2023-06-09T11:12:09.849808+0000","last_clean":"2023-06-09T11:12:09.849808+0000","last_became_active":"2023-06-09T11:12:08.834197+0000","last_became_peered":"2023-06-09T11:12:08.834197+0000","last_unstale":"2023-06-09T11:12:09.849808+0000","last_undegraded":"2023-06-09T11:12:09.849808+0000","last_fullsized":"2023-06-09T11:12:09.849808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823239+0000","last_change":"2023-06-09T11:12:08.839682+0000","last_active":"2023-06-09T11:12:09.823239+0000","last_peered":"2023-06-09T11:12:09.823239+0000","last_clean":"2023-06-09T11:12:09.823239+0000","last_became_active":"2023-06-09T11:12:08.838961+0000","last_became_peered":"2023-06-09T11:12:08.838961+0000","last_unstale":"2023-06-09T11:12:09.823239+0000","last_undegraded":"2023-06-09T11:12:09.823239+0000","last_fullsized":"2023-06-09T11:12:09.823239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849236+0000","last_change":"2023-06-09T11:12:08.846811+0000","last_active":"2023-06-09T11:12:09.849236+0000","last_peered":"2023-06-09T11:12:09.849236+0000","last_clean":"2023-06-09T11:12:09.849236+0000","last_became_active":"2023-06-09T11:12:08.846391+0000","last_became_peered":"2023-06-09T11:12:08.846391+0000","last_unstale":"2023-06-09T11:12:09.849236+0000","last_undegraded":"2023-06-09T11:12:09.849236+0000","last_fullsized":"2023-06-09T11:12:09.849236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819649+0000","last_change":"2023-06-09T11:12:08.838865+0000","last_active":"2023-06-09T11:12:09.819649+0000","last_peered":"2023-06-09T11:12:09.819649+0000","last_clean":"2023-06-09T11:12:09.819649+0000","last_became_active":"2023-06-09T11:12:08.838587+0000","last_became_peered":"2023-06-09T11:12:08.838587+0000","last_unstale":"2023-06-09T11:12:09.819649+0000","last_undegraded":"2023-06-09T11:12:09.819649+0000","last_fullsized":"2023-06-09T11:12:09.819649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822571+0000","last_change":"2023-06-09T11:12:08.832860+0000","last_active":"2023-06-09T11:12:09.822571+0000","last_peered":"2023-06-09T11:12:09.822571+0000","last_clean":"2023-06-09T11:12:09.822571+0000","last_became_active":"2023-06-09T11:12:08.832580+0000","last_became_peered":"2023-06-09T11:12:08.832580+0000","last_unstale":"2023-06-09T11:12:09.822571+0000","last_undegraded":"2023-06-09T11:12:09.822571+0000","last_fullsized":"2023-06-09T11:12:09.822571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819165+0000","last_change":"2023-06-09T11:12:08.839816+0000","last_active":"2023-06-09T11:12:09.819165+0000","last_peered":"2023-06-09T11:12:09.819165+0000","last_clean":"2023-06-09T11:12:09.819165+0000","last_became_active":"2023-06-09T11:12:08.839381+0000","last_became_peered":"2023-06-09T11:12:08.839381+0000","last_unstale":"2023-06-09T11:12:09.819165+0000","last_undegraded":"2023-06-09T11:12:09.819165+0000","last_fullsized":"2023-06-09T11:12:09.819165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138744+0000","last_change":"2023-06-09T11:12:08.833196+0000","last_active":"2023-06-09T11:12:10.138744+0000","last_peered":"2023-06-09T11:12:10.138744+0000","last_clean":"2023-06-09T11:12:10.138744+0000","last_became_active":"2023-06-09T11:12:08.832913+0000","last_became_peered":"2023-06-09T11:12:08.832913+0000","last_unstale":"2023-06-09T11:12:10.138744+0000","last_undegraded":"2023-06-09T11:12:10.138744+0000","last_fullsized":"2023-06-09T11:12:10.138744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820004+0000","last_change":"2023-06-09T11:12:08.839962+0000","last_active":"2023-06-09T11:12:09.820004+0000","last_peered":"2023-06-09T11:12:09.820004+0000","last_clean":"2023-06-09T11:12:09.820004+0000","last_became_active":"2023-06-09T11:12:08.839675+0000","last_became_peered":"2023-06-09T11:12:08.839675+0000","last_unstale":"2023-06-09T11:12:09.820004+0000","last_undegraded":"2023-06-09T11:12:09.820004+0000","last_fullsized":"2023-06-09T11:12:09.820004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846303+0000","last_change":"2023-06-09T11:12:08.283296+0000","last_active":"2023-06-09T11:12:09.846303+0000","last_peered":"2023-06-09T11:12:09.846303+0000","last_clean":"2023-06-09T11:12:09.846303+0000","last_became_active":"2023-06-09T11:12:08.282947+0000","last_became_peered":"2023-06-09T11:12:08.282947+0000","last_unstale":"2023-06-09T11:12:09.846303+0000","last_undegraded":"2023-06-09T11:12:09.846303+0000","last_fullsized":"2023-06-09T11:12:09.846303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823280+0000","last_change":"2023-06-09T11:12:08.839863+0000","last_active":"2023-06-09T11:12:09.823280+0000","last_peered":"2023-06-09T11:12:09.823280+0000","last_clean":"2023-06-09T11:12:09.823280+0000","last_became_active":"2023-06-09T11:12:08.839412+0000","last_became_peered":"2023-06-09T11:12:08.839412+0000","last_unstale":"2023-06-09T11:12:09.823280+0000","last_undegraded":"2023-06-09T11:12:09.823280+0000","last_fullsized":"2023-06-09T11:12:09.823280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140262+0000","last_change":"2023-06-09T11:12:08.282887+0000","last_active":"2023-06-09T11:12:10.140262+0000","last_peered":"2023-06-09T11:12:10.140262+0000","last_clean":"2023-06-09T11:12:10.140262+0000","last_became_active":"2023-06-09T11:12:08.282019+0000","last_became_peered":"2023-06-09T11:12:08.282019+0000","last_unstale":"2023-06-09T11:12:10.140262+0000","last_undegraded":"2023-06-09T11:12:10.140262+0000","last_fullsized":"2023-06-09T11:12:10.140262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141115+0000","last_change":"2023-06-09T11:12:08.826851+0000","last_active":"2023-06-09T11:12:10.141115+0000","last_peered":"2023-06-09T11:12:10.141115+0000","last_clean":"2023-06-09T11:12:10.141115+0000","last_became_active":"2023-06-09T11:12:08.826485+0000","last_became_peered":"2023-06-09T11:12:08.826485+0000","last_unstale":"2023-06-09T11:12:10.141115+0000","last_undegraded":"2023-06-09T11:12:10.141115+0000","last_fullsized":"2023-06-09T11:12:10.141115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845892+0000","last_change":"2023-06-09T11:12:08.287775+0000","last_active":"2023-06-09T11:12:09.845892+0000","last_peered":"2023-06-09T11:12:09.845892+0000","last_clean":"2023-06-09T11:12:09.845892+0000","last_became_active":"2023-06-09T11:12:08.287415+0000","last_became_peered":"2023-06-09T11:12:08.287415+0000","last_unstale":"2023-06-09T11:12:09.845892+0000","last_undegraded":"2023-06-09T11:12:09.845892+0000","last_fullsized":"2023-06-09T11:12:09.845892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819886+0000","last_change":"2023-06-09T11:12:08.845899+0000","last_active":"2023-06-09T11:12:09.819886+0000","last_peered":"2023-06-09T11:12:09.819886+0000","last_clean":"2023-06-09T11:12:09.819886+0000","last_became_active":"2023-06-09T11:12:08.845497+0000","last_became_peered":"2023-06-09T11:12:08.845497+0000","last_unstale":"2023-06-09T11:12:09.819886+0000","last_undegraded":"2023-06-09T11:12:09.819886+0000","last_fullsized":"2023-06-09T11:12:09.819886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139028+0000","last_change":"2023-06-09T11:12:08.283802+0000","last_active":"2023-06-09T11:12:10.139028+0000","last_peered":"2023-06-09T11:12:10.139028+0000","last_clean":"2023-06-09T11:12:10.139028+0000","last_became_active":"2023-06-09T11:12:08.283417+0000","last_became_peered":"2023-06-09T11:12:08.283417+0000","last_unstale":"2023-06-09T11:12:10.139028+0000","last_undegraded":"2023-06-09T11:12:10.139028+0000","last_fullsized":"2023-06-09T11:12:10.139028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:56.322140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846310+0000","last_change":"2023-06-09T11:12:08.287954+0000","last_active":"2023-06-09T11:12:09.846310+0000","last_peered":"2023-06-09T11:12:09.846310+0000","last_clean":"2023-06-09T11:12:09.846310+0000","last_became_active":"2023-06-09T11:12:08.287641+0000","last_became_peered":"2023-06-09T11:12:08.287641+0000","last_unstale":"2023-06-09T11:12:09.846310+0000","last_undegraded":"2023-06-09T11:12:09.846310+0000","last_fullsized":"2023-06-09T11:12:09.846310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:52.398335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822883+0000","last_change":"2023-06-09T11:12:08.838149+0000","last_active":"2023-06-09T11:12:09.822883+0000","last_peered":"2023-06-09T11:12:09.822883+0000","last_clean":"2023-06-09T11:12:09.822883+0000","last_became_active":"2023-06-09T11:12:08.837839+0000","last_became_peered":"2023-06-09T11:12:08.837839+0000","last_unstale":"2023-06-09T11:12:09.822883+0000","last_undegraded":"2023-06-09T11:12:09.822883+0000","last_fullsized":"2023-06-09T11:12:09.822883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846359+0000","last_change":"2023-06-09T11:12:08.287833+0000","last_active":"2023-06-09T11:12:09.846359+0000","last_peered":"2023-06-09T11:12:09.846359+0000","last_clean":"2023-06-09T11:12:09.846359+0000","last_became_active":"2023-06-09T11:12:08.287474+0000","last_became_peered":"2023-06-09T11:12:08.287474+0000","last_unstale":"2023-06-09T11:12:09.846359+0000","last_undegraded":"2023-06-09T11:12:09.846359+0000","last_fullsized":"2023-06-09T11:12:09.846359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:54.101444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821934+0000","last_change":"2023-06-09T11:12:08.840471+0000","last_active":"2023-06-09T11:12:09.821934+0000","last_peered":"2023-06-09T11:12:09.821934+0000","last_clean":"2023-06-09T11:12:09.821934+0000","last_became_active":"2023-06-09T11:12:08.840152+0000","last_became_peered":"2023-06-09T11:12:08.840152+0000","last_unstale":"2023-06-09T11:12:09.821934+0000","last_undegraded":"2023-06-09T11:12:09.821934+0000","last_fullsized":"2023-06-09T11:12:09.821934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846498+0000","last_change":"2023-06-09T11:12:08.280882+0000","last_active":"2023-06-09T11:12:09.846498+0000","last_peered":"2023-06-09T11:12:09.846498+0000","last_clean":"2023-06-09T11:12:09.846498+0000","last_became_active":"2023-06-09T11:12:08.280608+0000","last_became_peered":"2023-06-09T11:12:08.280608+0000","last_unstale":"2023-06-09T11:12:09.846498+0000","last_undegraded":"2023-06-09T11:12:09.846498+0000","last_fullsized":"2023-06-09T11:12:09.846498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:45:50.994443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138982+0000","last_change":"2023-06-09T11:12:08.835473+0000","last_active":"2023-06-09T11:12:10.138982+0000","last_peered":"2023-06-09T11:12:10.138982+0000","last_clean":"2023-06-09T11:12:10.138982+0000","last_became_active":"2023-06-09T11:12:08.835014+0000","last_became_peered":"2023-06-09T11:12:08.835014+0000","last_unstale":"2023-06-09T11:12:10.138982+0000","last_undegraded":"2023-06-09T11:12:10.138982+0000","last_fullsized":"2023-06-09T11:12:10.138982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823071+0000","last_change":"2023-06-09T11:12:08.286293+0000","last_active":"2023-06-09T11:12:09.823071+0000","last_peered":"2023-06-09T11:12:09.823071+0000","last_clean":"2023-06-09T11:12:09.823071+0000","last_became_active":"2023-06-09T11:12:08.283192+0000","last_became_peered":"2023-06-09T11:12:08.283192+0000","last_unstale":"2023-06-09T11:12:09.823071+0000","last_undegraded":"2023-06-09T11:12:09.823071+0000","last_fullsized":"2023-06-09T11:12:09.823071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140609+0000","last_change":"2023-06-09T11:12:08.831394+0000","last_active":"2023-06-09T11:12:10.140609+0000","last_peered":"2023-06-09T11:12:10.140609+0000","last_clean":"2023-06-09T11:12:10.140609+0000","last_became_active":"2023-06-09T11:12:08.829941+0000","last_became_peered":"2023-06-09T11:12:08.829941+0000","last_unstale":"2023-06-09T11:12:10.140609+0000","last_undegraded":"2023-06-09T11:12:10.140609+0000","last_fullsized":"2023-06-09T11:12:10.140609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819914+0000","last_change":"2023-06-09T11:12:08.288840+0000","last_active":"2023-06-09T11:12:09.819914+0000","last_peered":"2023-06-09T11:12:09.819914+0000","last_clean":"2023-06-09T11:12:09.819914+0000","last_became_active":"2023-06-09T11:12:08.287719+0000","last_became_peered":"2023-06-09T11:12:08.287719+0000","last_unstale":"2023-06-09T11:12:09.819914+0000","last_undegraded":"2023-06-09T11:12:09.819914+0000","last_fullsized":"2023-06-09T11:12:09.819914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823893+0000","last_change":"2023-06-09T11:12:08.828760+0000","last_active":"2023-06-09T11:12:09.823893+0000","last_peered":"2023-06-09T11:12:09.823893+0000","last_clean":"2023-06-09T11:12:09.823893+0000","last_became_active":"2023-06-09T11:12:08.828324+0000","last_became_peered":"2023-06-09T11:12:08.828324+0000","last_unstale":"2023-06-09T11:12:09.823893+0000","last_undegraded":"2023-06-09T11:12:09.823893+0000","last_fullsized":"2023-06-09T11:12:09.823893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:05.017896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139097+0000","last_change":"2023-06-09T11:12:08.283200+0000","last_active":"2023-06-09T11:12:10.139097+0000","last_peered":"2023-06-09T11:12:10.139097+0000","last_clean":"2023-06-09T11:12:10.139097+0000","last_became_active":"2023-06-09T11:12:08.282863+0000","last_became_peered":"2023-06-09T11:12:08.282863+0000","last_unstale":"2023-06-09T11:12:10.139097+0000","last_undegraded":"2023-06-09T11:12:10.139097+0000","last_fullsized":"2023-06-09T11:12:10.139097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:41:59.540044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824104+0000","last_change":"2023-06-09T11:12:08.828410+0000","last_active":"2023-06-09T11:12:09.824104+0000","last_peered":"2023-06-09T11:12:09.824104+0000","last_clean":"2023-06-09T11:12:09.824104+0000","last_became_active":"2023-06-09T11:12:08.828040+0000","last_became_peered":"2023-06-09T11:12:08.828040+0000","last_unstale":"2023-06-09T11:12:09.824104+0000","last_undegraded":"2023-06-09T11:12:09.824104+0000","last_fullsized":"2023-06-09T11:12:09.824104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:53.412417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822247+0000","last_change":"2023-06-09T11:12:08.268559+0000","last_active":"2023-06-09T11:12:09.822247+0000","last_peered":"2023-06-09T11:12:09.822247+0000","last_clean":"2023-06-09T11:12:09.822247+0000","last_became_active":"2023-06-09T11:12:08.268123+0000","last_became_peered":"2023-06-09T11:12:08.268123+0000","last_unstale":"2023-06-09T11:12:09.822247+0000","last_undegraded":"2023-06-09T11:12:09.822247+0000","last_fullsized":"2023-06-09T11:12:09.822247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824133+0000","last_change":"2023-06-09T11:12:08.829627+0000","last_active":"2023-06-09T11:12:09.824133+0000","last_peered":"2023-06-09T11:12:09.824133+0000","last_clean":"2023-06-09T11:12:09.824133+0000","last_became_active":"2023-06-09T11:12:08.829295+0000","last_became_peered":"2023-06-09T11:12:08.829295+0000","last_unstale":"2023-06-09T11:12:09.824133+0000","last_undegraded":"2023-06-09T11:12:09.824133+0000","last_fullsized":"2023-06-09T11:12:09.824133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:59.109592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819581+0000","last_change":"2023-06-09T11:12:08.286883+0000","last_active":"2023-06-09T11:12:09.819581+0000","last_peered":"2023-06-09T11:12:09.819581+0000","last_clean":"2023-06-09T11:12:09.819581+0000","last_became_active":"2023-06-09T11:12:08.283053+0000","last_became_peered":"2023-06-09T11:12:08.283053+0000","last_unstale":"2023-06-09T11:12:09.819581+0000","last_undegraded":"2023-06-09T11:12:09.819581+0000","last_fullsized":"2023-06-09T11:12:09.819581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849756+0000","last_change":"2023-06-09T11:12:08.840789+0000","last_active":"2023-06-09T11:12:09.849756+0000","last_peered":"2023-06-09T11:12:09.849756+0000","last_clean":"2023-06-09T11:12:09.849756+0000","last_became_active":"2023-06-09T11:12:08.840180+0000","last_became_peered":"2023-06-09T11:12:08.840180+0000","last_unstale":"2023-06-09T11:12:09.849756+0000","last_undegraded":"2023-06-09T11:12:09.849756+0000","last_fullsized":"2023-06-09T11:12:09.849756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845858+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:12:09.845858+0000","last_peered":"2023-06-09T11:12:09.845858+0000","last_clean":"2023-06-09T11:12:09.845858+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:12:09.845858+0000","last_undegraded":"2023-06-09T11:12:09.845858+0000","last_fullsized":"2023-06-09T11:12:09.845858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:26.915763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823010+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:12:09.823010+0000","last_peered":"2023-06-09T11:12:09.823010+0000","last_clean":"2023-06-09T11:12:09.823010+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:12:09.823010+0000","last_undegraded":"2023-06-09T11:12:09.823010+0000","last_fullsized":"2023-06-09T11:12:09.823010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:07.747592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820178+0000","last_change":"2023-06-09T11:12:08.274664+0000","last_active":"2023-06-09T11:12:09.820178+0000","last_peered":"2023-06-09T11:12:09.820178+0000","last_clean":"2023-06-09T11:12:09.820178+0000","last_became_active":"2023-06-09T11:12:08.274254+0000","last_became_peered":"2023-06-09T11:12:08.274254+0000","last_unstale":"2023-06-09T11:12:09.820178+0000","last_undegraded":"2023-06-09T11:12:09.820178+0000","last_fullsized":"2023-06-09T11:12:09.820178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:38.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139313+0000","last_change":"2023-06-09T11:12:08.833072+0000","last_active":"2023-06-09T11:12:10.139313+0000","last_peered":"2023-06-09T11:12:10.139313+0000","last_clean":"2023-06-09T11:12:10.139313+0000","last_became_active":"2023-06-09T11:12:08.832494+0000","last_became_peered":"2023-06-09T11:12:08.832494+0000","last_unstale":"2023-06-09T11:12:10.139313+0000","last_undegraded":"2023-06-09T11:12:10.139313+0000","last_fullsized":"2023-06-09T11:12:10.139313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:49.564145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845511+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:12:09.845511+0000","last_peered":"2023-06-09T11:12:09.845511+0000","last_clean":"2023-06-09T11:12:09.845511+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:12:09.845511+0000","last_undegraded":"2023-06-09T11:12:09.845511+0000","last_fullsized":"2023-06-09T11:12:09.845511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:16.600288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140167+0000","last_change":"2023-06-09T11:12:08.288683+0000","last_active":"2023-06-09T11:12:10.140167+0000","last_peered":"2023-06-09T11:12:10.140167+0000","last_clean":"2023-06-09T11:12:10.140167+0000","last_became_active":"2023-06-09T11:12:08.288403+0000","last_became_peered":"2023-06-09T11:12:08.288403+0000","last_unstale":"2023-06-09T11:12:10.140167+0000","last_undegraded":"2023-06-09T11:12:10.140167+0000","last_fullsized":"2023-06-09T11:12:10.140167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:48.550064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140943+0000","last_change":"2023-06-09T11:12:08.835534+0000","last_active":"2023-06-09T11:12:10.140943+0000","last_peered":"2023-06-09T11:12:10.140943+0000","last_clean":"2023-06-09T11:12:10.140943+0000","last_became_active":"2023-06-09T11:12:08.835265+0000","last_became_peered":"2023-06-09T11:12:08.835265+0000","last_unstale":"2023-06-09T11:12:10.140943+0000","last_undegraded":"2023-06-09T11:12:10.140943+0000","last_fullsized":"2023-06-09T11:12:10.140943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838427+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:12:09.838427+0000","last_peered":"2023-06-09T11:12:09.838427+0000","last_clean":"2023-06-09T11:12:09.838427+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:12:09.838427+0000","last_undegraded":"2023-06-09T11:12:09.838427+0000","last_fullsized":"2023-06-09T11:12:09.838427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:17:15.668229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848689+0000","last_change":"2023-06-09T11:12:08.284371+0000","last_active":"2023-06-09T11:12:09.848689+0000","last_peered":"2023-06-09T11:12:09.848689+0000","last_clean":"2023-06-09T11:12:09.848689+0000","last_became_active":"2023-06-09T11:12:08.284025+0000","last_became_peered":"2023-06-09T11:12:08.284025+0000","last_unstale":"2023-06-09T11:12:09.848689+0000","last_undegraded":"2023-06-09T11:12:09.848689+0000","last_fullsized":"2023-06-09T11:12:09.848689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:17.551253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849884+0000","last_change":"2023-06-09T11:12:08.843683+0000","last_active":"2023-06-09T11:12:09.849884+0000","last_peered":"2023-06-09T11:12:09.849884+0000","last_clean":"2023-06-09T11:12:09.849884+0000","last_became_active":"2023-06-09T11:12:08.843390+0000","last_became_peered":"2023-06-09T11:12:08.843390+0000","last_unstale":"2023-06-09T11:12:09.849884+0000","last_undegraded":"2023-06-09T11:12:09.849884+0000","last_fullsized":"2023-06-09T11:12:09.849884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822778+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:12:09.822778+0000","last_peered":"2023-06-09T11:12:09.822778+0000","last_clean":"2023-06-09T11:12:09.822778+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:12:09.822778+0000","last_undegraded":"2023-06-09T11:12:09.822778+0000","last_fullsized":"2023-06-09T11:12:09.822778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:21.222898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823463+0000","last_change":"2023-06-09T11:12:08.285595+0000","last_active":"2023-06-09T11:12:09.823463+0000","last_peered":"2023-06-09T11:12:09.823463+0000","last_clean":"2023-06-09T11:12:09.823463+0000","last_became_active":"2023-06-09T11:12:08.285164+0000","last_became_peered":"2023-06-09T11:12:08.285164+0000","last_unstale":"2023-06-09T11:12:09.823463+0000","last_undegraded":"2023-06-09T11:12:09.823463+0000","last_fullsized":"2023-06-09T11:12:09.823463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849103+0000","last_change":"2023-06-09T11:12:08.834527+0000","last_active":"2023-06-09T11:12:09.849103+0000","last_peered":"2023-06-09T11:12:09.849103+0000","last_clean":"2023-06-09T11:12:09.849103+0000","last_became_active":"2023-06-09T11:12:08.834243+0000","last_became_peered":"2023-06-09T11:12:08.834243+0000","last_unstale":"2023-06-09T11:12:09.849103+0000","last_undegraded":"2023-06-09T11:12:09.849103+0000","last_fullsized":"2023-06-09T11:12:09.849103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823400+0000","last_change":"2023-06-09T11:12:08.286284+0000","last_active":"2023-06-09T11:12:09.823400+0000","last_peered":"2023-06-09T11:12:09.823400+0000","last_clean":"2023-06-09T11:12:09.823400+0000","last_became_active":"2023-06-09T11:12:08.282889+0000","last_became_peered":"2023-06-09T11:12:08.282889+0000","last_unstale":"2023-06-09T11:12:09.823400+0000","last_undegraded":"2023-06-09T11:12:09.823400+0000","last_fullsized":"2023-06-09T11:12:09.823400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849294+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:12:09.849294+0000","last_peered":"2023-06-09T11:12:09.849294+0000","last_clean":"2023-06-09T11:12:09.849294+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:12:09.849294+0000","last_undegraded":"2023-06-09T11:12:09.849294+0000","last_fullsized":"2023-06-09T11:12:09.849294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:38.034603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848923+0000","last_change":"2023-06-09T11:12:08.843701+0000","last_active":"2023-06-09T11:12:09.848923+0000","last_peered":"2023-06-09T11:12:09.848923+0000","last_clean":"2023-06-09T11:12:09.848923+0000","last_became_active":"2023-06-09T11:12:08.843450+0000","last_became_peered":"2023-06-09T11:12:08.843450+0000","last_unstale":"2023-06-09T11:12:09.848923+0000","last_undegraded":"2023-06-09T11:12:09.848923+0000","last_fullsized":"2023-06-09T11:12:09.848923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849032+0000","last_change":"2023-06-09T11:12:08.284028+0000","last_active":"2023-06-09T11:12:09.849032+0000","last_peered":"2023-06-09T11:12:09.849032+0000","last_clean":"2023-06-09T11:12:09.849032+0000","last_became_active":"2023-06-09T11:12:08.283697+0000","last_became_peered":"2023-06-09T11:12:08.283697+0000","last_unstale":"2023-06-09T11:12:09.849032+0000","last_undegraded":"2023-06-09T11:12:09.849032+0000","last_fullsized":"2023-06-09T11:12:09.849032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846609+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:12:09.846609+0000","last_peered":"2023-06-09T11:12:09.846609+0000","last_clean":"2023-06-09T11:12:09.846609+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:12:09.846609+0000","last_undegraded":"2023-06-09T11:12:09.846609+0000","last_fullsized":"2023-06-09T11:12:09.846609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:02.343312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140533+0000","last_change":"2023-06-09T11:12:08.840903+0000","last_active":"2023-06-09T11:12:10.140533+0000","last_peered":"2023-06-09T11:12:10.140533+0000","last_clean":"2023-06-09T11:12:10.140533+0000","last_became_active":"2023-06-09T11:12:08.840625+0000","last_became_peered":"2023-06-09T11:12:08.840625+0000","last_unstale":"2023-06-09T11:12:10.140533+0000","last_undegraded":"2023-06-09T11:12:10.140533+0000","last_fullsized":"2023-06-09T11:12:10.140533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820155+0000","last_change":"2023-06-09T11:12:08.282096+0000","last_active":"2023-06-09T11:12:09.820155+0000","last_peered":"2023-06-09T11:12:09.820155+0000","last_clean":"2023-06-09T11:12:09.820155+0000","last_became_active":"2023-06-09T11:12:08.281746+0000","last_became_peered":"2023-06-09T11:12:08.281746+0000","last_unstale":"2023-06-09T11:12:09.820155+0000","last_undegraded":"2023-06-09T11:12:09.820155+0000","last_fullsized":"2023-06-09T11:12:09.820155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849748+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:12:09.849748+0000","last_peered":"2023-06-09T11:12:09.849748+0000","last_clean":"2023-06-09T11:12:09.849748+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:12:09.849748+0000","last_undegraded":"2023-06-09T11:12:09.849748+0000","last_fullsized":"2023-06-09T11:12:09.849748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:50:58.945136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819086+0000","last_change":"2023-06-09T11:12:08.838416+0000","last_active":"2023-06-09T11:12:09.819086+0000","last_peered":"2023-06-09T11:12:09.819086+0000","last_clean":"2023-06-09T11:12:09.819086+0000","last_became_active":"2023-06-09T11:12:08.838099+0000","last_became_peered":"2023-06-09T11:12:08.838099+0000","last_unstale":"2023-06-09T11:12:09.819086+0000","last_undegraded":"2023-06-09T11:12:09.819086+0000","last_fullsized":"2023-06-09T11:12:09.819086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:18.012644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141256+0000","last_change":"2023-06-09T11:12:08.284961+0000","last_active":"2023-06-09T11:12:10.141256+0000","last_peered":"2023-06-09T11:12:10.141256+0000","last_clean":"2023-06-09T11:12:10.141256+0000","last_became_active":"2023-06-09T11:12:08.281299+0000","last_became_peered":"2023-06-09T11:12:08.281299+0000","last_unstale":"2023-06-09T11:12:10.141256+0000","last_undegraded":"2023-06-09T11:12:10.141256+0000","last_fullsized":"2023-06-09T11:12:10.141256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:21.658968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139133+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:12:10.139133+0000","last_peered":"2023-06-09T11:12:10.139133+0000","last_clean":"2023-06-09T11:12:10.139133+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:12:10.139133+0000","last_undegraded":"2023-06-09T11:12:10.139133+0000","last_fullsized":"2023-06-09T11:12:10.139133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:39:06.854929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822149+0000","last_change":"2023-06-09T11:12:08.839244+0000","last_active":"2023-06-09T11:12:09.822149+0000","last_peered":"2023-06-09T11:12:09.822149+0000","last_clean":"2023-06-09T11:12:09.822149+0000","last_became_active":"2023-06-09T11:12:08.838923+0000","last_became_peered":"2023-06-09T11:12:08.838923+0000","last_unstale":"2023-06-09T11:12:09.822149+0000","last_undegraded":"2023-06-09T11:12:09.822149+0000","last_fullsized":"2023-06-09T11:12:09.822149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823299+0000","last_change":"2023-06-09T11:12:08.833132+0000","last_active":"2023-06-09T11:12:09.823299+0000","last_peered":"2023-06-09T11:12:09.823299+0000","last_clean":"2023-06-09T11:12:09.823299+0000","last_became_active":"2023-06-09T11:12:08.832882+0000","last_became_peered":"2023-06-09T11:12:08.832882+0000","last_unstale":"2023-06-09T11:12:09.823299+0000","last_undegraded":"2023-06-09T11:12:09.823299+0000","last_fullsized":"2023-06-09T11:12:09.823299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824098+0000","last_change":"2023-06-09T11:12:08.275292+0000","last_active":"2023-06-09T11:12:09.824098+0000","last_peered":"2023-06-09T11:12:09.824098+0000","last_clean":"2023-06-09T11:12:09.824098+0000","last_became_active":"2023-06-09T11:12:08.274936+0000","last_became_peered":"2023-06-09T11:12:08.274936+0000","last_unstale":"2023-06-09T11:12:09.824098+0000","last_undegraded":"2023-06-09T11:12:09.824098+0000","last_fullsized":"2023-06-09T11:12:09.824098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848668+0000","last_change":"2023-06-09T11:12:08.835600+0000","last_active":"2023-06-09T11:12:09.848668+0000","last_peered":"2023-06-09T11:12:09.848668+0000","last_clean":"2023-06-09T11:12:09.848668+0000","last_became_active":"2023-06-09T11:12:08.835304+0000","last_became_peered":"2023-06-09T11:12:08.835304+0000","last_unstale":"2023-06-09T11:12:09.848668+0000","last_undegraded":"2023-06-09T11:12:09.848668+0000","last_fullsized":"2023-06-09T11:12:09.848668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846324+0000","last_change":"2023-06-09T11:12:08.288784+0000","last_active":"2023-06-09T11:12:09.846324+0000","last_peered":"2023-06-09T11:12:09.846324+0000","last_clean":"2023-06-09T11:12:09.846324+0000","last_became_active":"2023-06-09T11:12:08.288524+0000","last_became_peered":"2023-06-09T11:12:08.288524+0000","last_unstale":"2023-06-09T11:12:09.846324+0000","last_undegraded":"2023-06-09T11:12:09.846324+0000","last_fullsized":"2023-06-09T11:12:09.846324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:58.095511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823908+0000","last_change":"2023-06-09T11:12:08.279785+0000","last_active":"2023-06-09T11:12:09.823908+0000","last_peered":"2023-06-09T11:12:09.823908+0000","last_clean":"2023-06-09T11:12:09.823908+0000","last_became_active":"2023-06-09T11:12:08.279392+0000","last_became_peered":"2023-06-09T11:12:08.279392+0000","last_unstale":"2023-06-09T11:12:09.823908+0000","last_undegraded":"2023-06-09T11:12:09.823908+0000","last_fullsized":"2023-06-09T11:12:09.823908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:44.593553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819358+0000","last_change":"2023-06-09T11:12:08.845707+0000","last_active":"2023-06-09T11:12:09.819358+0000","last_peered":"2023-06-09T11:12:09.819358+0000","last_clean":"2023-06-09T11:12:09.819358+0000","last_became_active":"2023-06-09T11:12:08.845389+0000","last_became_peered":"2023-06-09T11:12:08.845389+0000","last_unstale":"2023-06-09T11:12:09.819358+0000","last_undegraded":"2023-06-09T11:12:09.819358+0000","last_fullsized":"2023-06-09T11:12:09.819358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141311+0000","last_change":"2023-06-09T11:12:08.281454+0000","last_active":"2023-06-09T11:12:10.141311+0000","last_peered":"2023-06-09T11:12:10.141311+0000","last_clean":"2023-06-09T11:12:10.141311+0000","last_became_active":"2023-06-09T11:12:08.280712+0000","last_became_peered":"2023-06-09T11:12:08.280712+0000","last_unstale":"2023-06-09T11:12:10.141311+0000","last_undegraded":"2023-06-09T11:12:10.141311+0000","last_fullsized":"2023-06-09T11:12:10.141311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819053+0000","last_change":"2023-06-09T11:12:08.840190+0000","last_active":"2023-06-09T11:12:09.819053+0000","last_peered":"2023-06-09T11:12:09.819053+0000","last_clean":"2023-06-09T11:12:09.819053+0000","last_became_active":"2023-06-09T11:12:08.839207+0000","last_became_peered":"2023-06-09T11:12:08.839207+0000","last_unstale":"2023-06-09T11:12:09.819053+0000","last_undegraded":"2023-06-09T11:12:09.819053+0000","last_fullsized":"2023-06-09T11:12:09.819053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.842234+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.841945+0000","last_became_peered":"2023-06-09T11:12:08.841945+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:45.639089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819318+0000","last_change":"2023-06-09T11:12:08.287948+0000","last_active":"2023-06-09T11:12:09.819318+0000","last_peered":"2023-06-09T11:12:09.819318+0000","last_clean":"2023-06-09T11:12:09.819318+0000","last_became_active":"2023-06-09T11:12:08.287279+0000","last_became_peered":"2023-06-09T11:12:08.287279+0000","last_unstale":"2023-06-09T11:12:09.819318+0000","last_undegraded":"2023-06-09T11:12:09.819318+0000","last_fullsized":"2023-06-09T11:12:09.819318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:52.750567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140755+0000","last_change":"2023-06-09T11:12:08.846000+0000","last_active":"2023-06-09T11:12:10.140755+0000","last_peered":"2023-06-09T11:12:10.140755+0000","last_clean":"2023-06-09T11:12:10.140755+0000","last_became_active":"2023-06-09T11:12:08.845741+0000","last_became_peered":"2023-06-09T11:12:08.845741+0000","last_unstale":"2023-06-09T11:12:10.140755+0000","last_undegraded":"2023-06-09T11:12:10.140755+0000","last_fullsized":"2023-06-09T11:12:10.140755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848766+0000","last_change":"2023-06-09T11:12:08.283831+0000","last_active":"2023-06-09T11:12:09.848766+0000","last_peered":"2023-06-09T11:12:09.848766+0000","last_clean":"2023-06-09T11:12:09.848766+0000","last_became_active":"2023-06-09T11:12:08.283264+0000","last_became_peered":"2023-06-09T11:12:08.283264+0000","last_unstale":"2023-06-09T11:12:09.848766+0000","last_undegraded":"2023-06-09T11:12:09.848766+0000","last_fullsized":"2023-06-09T11:12:09.848766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819930+0000","last_change":"2023-06-09T11:12:08.834819+0000","last_active":"2023-06-09T11:12:09.819930+0000","last_peered":"2023-06-09T11:12:09.819930+0000","last_clean":"2023-06-09T11:12:09.819930+0000","last_became_active":"2023-06-09T11:12:08.834508+0000","last_became_peered":"2023-06-09T11:12:08.834508+0000","last_unstale":"2023-06-09T11:12:09.819930+0000","last_undegraded":"2023-06-09T11:12:09.819930+0000","last_fullsized":"2023-06-09T11:12:09.819930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822732+0000","last_change":"2023-06-09T11:12:08.280846+0000","last_active":"2023-06-09T11:12:09.822732+0000","last_peered":"2023-06-09T11:12:09.822732+0000","last_clean":"2023-06-09T11:12:09.822732+0000","last_became_active":"2023-06-09T11:12:08.280236+0000","last_became_peered":"2023-06-09T11:12:08.280236+0000","last_unstale":"2023-06-09T11:12:09.822732+0000","last_undegraded":"2023-06-09T11:12:09.822732+0000","last_fullsized":"2023-06-09T11:12:09.822732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.835695+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.835460+0000","last_became_peered":"2023-06-09T11:12:08.835460+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:57.336221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140920+0000","last_change":"2023-06-09T11:12:08.285330+0000","last_active":"2023-06-09T11:12:10.140920+0000","last_peered":"2023-06-09T11:12:10.140920+0000","last_clean":"2023-06-09T11:12:10.140920+0000","last_became_active":"2023-06-09T11:12:08.285034+0000","last_became_peered":"2023-06-09T11:12:08.285034+0000","last_unstale":"2023-06-09T11:12:10.140920+0000","last_undegraded":"2023-06-09T11:12:10.140920+0000","last_fullsized":"2023-06-09T11:12:10.140920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823127+0000","last_change":"2023-06-09T11:12:08.827779+0000","last_active":"2023-06-09T11:12:09.823127+0000","last_peered":"2023-06-09T11:12:09.823127+0000","last_clean":"2023-06-09T11:12:09.823127+0000","last_became_active":"2023-06-09T11:12:08.827529+0000","last_became_peered":"2023-06-09T11:12:08.827529+0000","last_unstale":"2023-06-09T11:12:09.823127+0000","last_undegraded":"2023-06-09T11:12:09.823127+0000","last_fullsized":"2023-06-09T11:12:09.823127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822947+0000","last_change":"2023-06-09T11:12:08.278445+0000","last_active":"2023-06-09T11:12:09.822947+0000","last_peered":"2023-06-09T11:12:09.822947+0000","last_clean":"2023-06-09T11:12:09.822947+0000","last_became_active":"2023-06-09T11:12:08.276493+0000","last_became_peered":"2023-06-09T11:12:08.276493+0000","last_unstale":"2023-06-09T11:12:09.822947+0000","last_undegraded":"2023-06-09T11:12:09.822947+0000","last_fullsized":"2023-06-09T11:12:09.822947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822406+0000","last_change":"2023-06-09T11:12:08.825777+0000","last_active":"2023-06-09T11:12:09.822406+0000","last_peered":"2023-06-09T11:12:09.822406+0000","last_clean":"2023-06-09T11:12:09.822406+0000","last_became_active":"2023-06-09T11:12:08.825486+0000","last_became_peered":"2023-06-09T11:12:08.825486+0000","last_unstale":"2023-06-09T11:12:09.822406+0000","last_undegraded":"2023-06-09T11:12:09.822406+0000","last_fullsized":"2023-06-09T11:12:09.822406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823362+0000","last_change":"2023-06-09T11:12:08.279306+0000","last_active":"2023-06-09T11:12:09.823362+0000","last_peered":"2023-06-09T11:12:09.823362+0000","last_clean":"2023-06-09T11:12:09.823362+0000","last_became_active":"2023-06-09T11:12:08.278839+0000","last_became_peered":"2023-06-09T11:12:08.278839+0000","last_unstale":"2023-06-09T11:12:09.823362+0000","last_undegraded":"2023-06-09T11:12:09.823362+0000","last_fullsized":"2023-06-09T11:12:09.823362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819796+0000","last_change":"2023-06-09T11:12:08.826596+0000","last_active":"2023-06-09T11:12:09.819796+0000","last_peered":"2023-06-09T11:12:09.819796+0000","last_clean":"2023-06-09T11:12:09.819796+0000","last_became_active":"2023-06-09T11:12:08.826297+0000","last_became_peered":"2023-06-09T11:12:08.826297+0000","last_unstale":"2023-06-09T11:12:09.819796+0000","last_undegraded":"2023-06-09T11:12:09.819796+0000","last_fullsized":"2023-06-09T11:12:09.819796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819593+0000","last_change":"2023-06-09T11:12:08.275890+0000","last_active":"2023-06-09T11:12:09.819593+0000","last_peered":"2023-06-09T11:12:09.819593+0000","last_clean":"2023-06-09T11:12:09.819593+0000","last_became_active":"2023-06-09T11:12:08.275473+0000","last_became_peered":"2023-06-09T11:12:08.275473+0000","last_unstale":"2023-06-09T11:12:09.819593+0000","last_undegraded":"2023-06-09T11:12:09.819593+0000","last_fullsized":"2023-06-09T11:12:09.819593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821857+0000","last_change":"2023-06-09T11:12:08.838762+0000","last_active":"2023-06-09T11:12:09.821857+0000","last_peered":"2023-06-09T11:12:09.821857+0000","last_clean":"2023-06-09T11:12:09.821857+0000","last_became_active":"2023-06-09T11:12:08.834883+0000","last_became_peered":"2023-06-09T11:12:08.834883+0000","last_unstale":"2023-06-09T11:12:09.821857+0000","last_undegraded":"2023-06-09T11:12:09.821857+0000","last_fullsized":"2023-06-09T11:12:09.821857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141101+0000","last_change":"2023-06-09T11:12:08.282540+0000","last_active":"2023-06-09T11:12:10.141101+0000","last_peered":"2023-06-09T11:12:10.141101+0000","last_clean":"2023-06-09T11:12:10.141101+0000","last_became_active":"2023-06-09T11:12:08.281150+0000","last_became_peered":"2023-06-09T11:12:08.281150+0000","last_unstale":"2023-06-09T11:12:10.141101+0000","last_undegraded":"2023-06-09T11:12:10.141101+0000","last_fullsized":"2023-06-09T11:12:10.141101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7976,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363864,"statfs":{"total":96636764160,"available":96628596736,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8629999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9080,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362760,"statfs":{"total":96636764160,"available":96627466240,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:12:13.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:12:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.660+0000 7f1bc5569700 1 Processor -- start 2023-06-09T11:12:13.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.660+0000 7f1bc5569700 1 -- start start 2023-06-09T11:12:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bc5569700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc015a3e0 0x7f1bc006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bc5569700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1bc00ce470 0x7f1bc006f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bc5569700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc00cc8e0 con 0x7f1bc015df60 2023-06-09T11:12:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bc5569700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc015a7b0 con 0x7f1bc00ce470 2023-06-09T11:12:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bc5569700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00ccb80 con 0x7f1bc015a3e0 2023-06-09T11:12:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bbeffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc015a3e0 0x7f1bc006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bbeffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc015a3e0 0x7f1bc006e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:33448/0 (socket says 172.21.15.78:33448) 2023-06-09T11:12:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bbeffd700 1 -- 172.21.15.78:0/4118650220 learned_addr learned my addr 172.21.15.78:0/4118650220 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bb7fff700 1 --2- 172.21.15.78:0/4118650220 >> v2:172.21.15.187:3300/0 conn(0x7f1bc00ce470 0x7f1bc006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bbeffd700 1 -- 172.21.15.78:0/4118650220 >> v2:172.21.15.187:3300/0 conn(0x7f1bc00ce470 msgr2=0x7f1bc006f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bbeffd700 1 --2- 172.21.15.78:0/4118650220 >> v2:172.21.15.187:3300/0 conn(0x7f1bc00ce470 0x7f1bc006f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bbeffd700 1 -- 172.21.15.78:0/4118650220 >> v1:172.21.15.187:6789/0 conn(0x7f1bc015df60 legacy=0x7f1bc0070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.664+0000 7f1bbeffd700 1 -- 172.21.15.78:0/4118650220 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc006b470 con 0x7f1bc015a3e0 2023-06-09T11:12:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bbeffd700 1 --2- 172.21.15.78:0/4118650220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc015a3e0 0x7f1bc006e960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009910 tx=0x7f1bb0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dd11f36816e4644 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bbe7fc700 1 -- 172.21.15.78:0/4118650220 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0011830 con 0x7f1bc015a3e0 2023-06-09T11:12:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bbe7fc700 1 -- 172.21.15.78:0/4118650220 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb0011990 con 0x7f1bc015a3e0 2023-06-09T11:12:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bbe7fc700 1 -- 172.21.15.78:0/4118650220 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0011d40 con 0x7f1bc015a3e0 2023-06-09T11:12:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 -- 172.21.15.78:0/4118650220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc015a3e0 msgr2=0x7f1bc006e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 --2- 172.21.15.78:0/4118650220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc015a3e0 0x7f1bc006e960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009910 tx=0x7f1bb0009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 -- 172.21.15.78:0/4118650220 shutdown_connections 2023-06-09T11:12:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 --2- 172.21.15.78:0/4118650220 >> v2:172.21.15.187:3300/0 conn(0x7f1bc00ce470 0x7f1bc006f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 --2- 172.21.15.78:0/4118650220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc015a3e0 0x7f1bc006e960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 -- 172.21.15.78:0/4118650220 >> 172.21.15.78:0/4118650220 conn(0x7f1bc00cf670 msgr2=0x7f1bc00cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 -- 172.21.15.78:0/4118650220 shutdown_connections 2023-06-09T11:12:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.668+0000 7f1bc5569700 1 -- 172.21.15.78:0/4118650220 wait complete. 2023-06-09T11:12:13.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 Processor -- start 2023-06-09T11:12:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 -- start start 2023-06-09T11:12:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc00ce470 0x7f1bc0155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc015a3e0 0x7f1bc0157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc015df60 0x7f1bc015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc01566b0 con 0x7f1bc015df60 2023-06-09T11:12:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc01583e0 con 0x7f1bc015a3e0 2023-06-09T11:12:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bc5569700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc01586c0 con 0x7f1bc00ce470 2023-06-09T11:12:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc015df60 0x7f1bc015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc015df60 0x7f1bc015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42292/0 (socket says 172.21.15.78:42292) 2023-06-09T11:12:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 -- 172.21.15.78:0/1007863893 learned_addr learned my addr 172.21.15.78:0/1007863893 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bb7fff700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc015a3e0 0x7f1bc0157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbeffd700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc00ce470 0x7f1bc0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 -- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc00ce470 msgr2=0x7f1bc0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc00ce470 0x7f1bc0155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 -- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc015a3e0 msgr2=0x7f1bc0157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc015a3e0 0x7f1bc0157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 -- 172.21.15.78:0/1007863893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb0009570 con 0x7f1bc015df60 2023-06-09T11:12:13.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.672+0000 7f1bbf7fe700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc015df60 0x7f1bc015aff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800cb50 tx=0x7f1bb800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:13.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.676+0000 7f1bb77fe700 1 -- 172.21.15.78:0/1007863893 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8003c20 con 0x7f1bc015df60 2023-06-09T11:12:13.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.676+0000 7f1bb77fe700 1 -- 172.21.15.78:0/1007863893 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb8003d80 con 0x7f1bc015df60 2023-06-09T11:12:13.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.676+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc015e3e0 con 0x7f1bc015df60 2023-06-09T11:12:13.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.676+0000 7f1bb77fe700 1 -- 172.21.15.78:0/1007863893 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800aa20 con 0x7f1bc015df60 2023-06-09T11:12:13.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.676+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc006b750 con 0x7f1bc015df60 2023-06-09T11:12:13.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.676+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc015e570 con 0x7f1bc015df60 2023-06-09T11:12:13.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.680+0000 7f1bb77fe700 1 -- 172.21.15.78:0/1007863893 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bb800ab80 con 0x7f1bc015df60 2023-06-09T11:12:13.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.680+0000 7f1bb77fe700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1ba00662f0 0x7f1ba00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:13.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.680+0000 7f1bb77fe700 1 -- 172.21.15.78:0/1007863893 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bb8083ca0 con 0x7f1bc015df60 2023-06-09T11:12:13.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.680+0000 7f1bbeffd700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1ba00662f0 0x7f1ba00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:13.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.684+0000 7f1bbeffd700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1ba00662f0 0x7f1ba00687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0000c00 tx=0x7f1bb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:13.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.688+0000 7f1bb77fe700 1 -- 172.21.15.78:0/1007863893 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1bb8051120 con 0x7f1bc015df60 2023-06-09T11:12:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.856+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bc00741c0 con 0x7f1ba00662f0 2023-06-09T11:12:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.872+0000 7f1bb77fe700 1 -- 172.21.15.78:0/1007863893 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286592 (secure 0 0 0) 0x7f1bc00741c0 con 0x7f1ba00662f0 2023-06-09T11:12:13.882 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:13.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1ba00662f0 msgr2=0x7f1ba00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1ba00662f0 0x7f1ba00687a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0000c00 tx=0x7f1bb0008030 comp rx=0 tx=0).stop 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc015df60 msgr2=0x7f1bc015aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc015df60 0x7f1bc015aff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800cb50 tx=0x7f1bb800ce60 comp rx=0 tx=0).stop 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 shutdown_connections 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1ba00662f0 0x7f1ba00687a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc015df60 0x7f1bc015aff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc015a3e0 0x7f1bc0157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 --2- 172.21.15.78:0/1007863893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc00ce470 0x7f1bc0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:13.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 >> 172.21.15.78:0/1007863893 conn(0x7f1bc00cf670 msgr2=0x7f1bc00b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 shutdown_connections 2023-06-09T11:12:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:13.880+0000 7f1bc5569700 1 -- 172.21.15.78:0/1007863893 wait complete. 2023-06-09T11:12:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:12:13.910 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-06-09T11:12:13.605831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66264,"kb_used_data":3096,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908456,"statfs":{"total":773094113280,"available":773026258944,"internally_reserved":0,"allocated":3170304,"data_stored":1894580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002330"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838710+0000","last_change":"2023-06-09T11:12:08.821394+0000","last_active":"2023-06-09T11:12:09.838710+0000","last_peered":"2023-06-09T11:12:09.838710+0000","last_clean":"2023-06-09T11:12:09.838710+0000","last_became_active":"2023-06-09T11:12:08.821006+0000","last_became_peered":"2023-06-09T11:12:08.821006+0000","last_unstale":"2023-06-09T11:12:09.838710+0000","last_undegraded":"2023-06-09T11:12:09.838710+0000","last_fullsized":"2023-06-09T11:12:09.838710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823540+0000","last_change":"2023-06-09T11:12:08.838303+0000","last_active":"2023-06-09T11:12:09.823540+0000","last_peered":"2023-06-09T11:12:09.823540+0000","last_clean":"2023-06-09T11:12:09.823540+0000","last_became_active":"2023-06-09T11:12:08.837991+0000","last_became_peered":"2023-06-09T11:12:08.837991+0000","last_unstale":"2023-06-09T11:12:09.823540+0000","last_undegraded":"2023-06-09T11:12:09.823540+0000","last_fullsized":"2023-06-09T11:12:09.823540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824004+0000","last_change":"2023-06-09T11:12:08.839761+0000","last_active":"2023-06-09T11:12:09.824004+0000","last_peered":"2023-06-09T11:12:09.824004+0000","last_clean":"2023-06-09T11:12:09.824004+0000","last_became_active":"2023-06-09T11:12:08.839497+0000","last_became_peered":"2023-06-09T11:12:08.839497+0000","last_unstale":"2023-06-09T11:12:09.824004+0000","last_undegraded":"2023-06-09T11:12:09.824004+0000","last_fullsized":"2023-06-09T11:12:09.824004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.834239+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.833880+0000","last_became_peered":"2023-06-09T11:12:08.833880+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:26:19.609527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140805+0000","last_change":"2023-06-09T11:12:08.820882+0000","last_active":"2023-06-09T11:12:10.140805+0000","last_peered":"2023-06-09T11:12:10.140805+0000","last_clean":"2023-06-09T11:12:10.140805+0000","last_became_active":"2023-06-09T11:12:08.820612+0000","last_became_peered":"2023-06-09T11:12:08.820612+0000","last_unstale":"2023-06-09T11:12:10.140805+0000","last_undegraded":"2023-06-09T11:12:10.140805+0000","last_fullsized":"2023-06-09T11:12:10.140805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822230+0000","last_change":"2023-06-09T11:12:08.827114+0000","last_active":"2023-06-09T11:12:09.822230+0000","last_peered":"2023-06-09T11:12:09.822230+0000","last_clean":"2023-06-09T11:12:09.822230+0000","last_became_active":"2023-06-09T11:12:08.826824+0000","last_became_peered":"2023-06-09T11:12:08.826824+0000","last_unstale":"2023-06-09T11:12:09.822230+0000","last_undegraded":"2023-06-09T11:12:09.822230+0000","last_fullsized":"2023-06-09T11:12:09.822230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845630+0000","last_change":"2023-06-09T11:12:08.843112+0000","last_active":"2023-06-09T11:12:09.845630+0000","last_peered":"2023-06-09T11:12:09.845630+0000","last_clean":"2023-06-09T11:12:09.845630+0000","last_became_active":"2023-06-09T11:12:08.842858+0000","last_became_peered":"2023-06-09T11:12:08.842858+0000","last_unstale":"2023-06-09T11:12:09.845630+0000","last_undegraded":"2023-06-09T11:12:09.845630+0000","last_fullsized":"2023-06-09T11:12:09.845630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822656+0000","last_change":"2023-06-09T11:12:08.830501+0000","last_active":"2023-06-09T11:12:09.822656+0000","last_peered":"2023-06-09T11:12:09.822656+0000","last_clean":"2023-06-09T11:12:09.822656+0000","last_became_active":"2023-06-09T11:12:08.830202+0000","last_became_peered":"2023-06-09T11:12:08.830202+0000","last_unstale":"2023-06-09T11:12:09.822656+0000","last_undegraded":"2023-06-09T11:12:09.822656+0000","last_fullsized":"2023-06-09T11:12:09.822656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140886+0000","last_change":"2023-06-09T11:12:08.828605+0000","last_active":"2023-06-09T11:12:10.140886+0000","last_peered":"2023-06-09T11:12:10.140886+0000","last_clean":"2023-06-09T11:12:10.140886+0000","last_became_active":"2023-06-09T11:12:08.828346+0000","last_became_peered":"2023-06-09T11:12:08.828346+0000","last_unstale":"2023-06-09T11:12:10.140886+0000","last_undegraded":"2023-06-09T11:12:10.140886+0000","last_fullsized":"2023-06-09T11:12:10.140886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823788+0000","last_change":"2023-06-09T11:12:08.838779+0000","last_active":"2023-06-09T11:12:09.823788+0000","last_peered":"2023-06-09T11:12:09.823788+0000","last_clean":"2023-06-09T11:12:09.823788+0000","last_became_active":"2023-06-09T11:12:08.838506+0000","last_became_peered":"2023-06-09T11:12:08.838506+0000","last_unstale":"2023-06-09T11:12:09.823788+0000","last_undegraded":"2023-06-09T11:12:09.823788+0000","last_fullsized":"2023-06-09T11:12:09.823788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824155+0000","last_change":"2023-06-09T11:12:08.827743+0000","last_active":"2023-06-09T11:12:09.824155+0000","last_peered":"2023-06-09T11:12:09.824155+0000","last_clean":"2023-06-09T11:12:09.824155+0000","last_became_active":"2023-06-09T11:12:08.827468+0000","last_became_peered":"2023-06-09T11:12:08.827468+0000","last_unstale":"2023-06-09T11:12:09.824155+0000","last_undegraded":"2023-06-09T11:12:09.824155+0000","last_fullsized":"2023-06-09T11:12:09.824155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:55.115525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.829351+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.829053+0000","last_became_peered":"2023-06-09T11:12:08.829053+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838528+0000","last_change":"2023-06-09T11:12:08.820511+0000","last_active":"2023-06-09T11:12:09.838528+0000","last_peered":"2023-06-09T11:12:09.838528+0000","last_clean":"2023-06-09T11:12:09.838528+0000","last_became_active":"2023-06-09T11:12:08.820231+0000","last_became_peered":"2023-06-09T11:12:08.820231+0000","last_unstale":"2023-06-09T11:12:09.838528+0000","last_undegraded":"2023-06-09T11:12:09.838528+0000","last_fullsized":"2023-06-09T11:12:09.838528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:54:22.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822794+0000","last_change":"2023-06-09T11:12:08.822849+0000","last_active":"2023-06-09T11:12:09.822794+0000","last_peered":"2023-06-09T11:12:09.822794+0000","last_clean":"2023-06-09T11:12:09.822794+0000","last_became_active":"2023-06-09T11:12:08.822563+0000","last_became_peered":"2023-06-09T11:12:08.822563+0000","last_unstale":"2023-06-09T11:12:09.822794+0000","last_undegraded":"2023-06-09T11:12:09.822794+0000","last_fullsized":"2023-06-09T11:12:09.822794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845781+0000","last_change":"2023-06-09T11:12:08.843310+0000","last_active":"2023-06-09T11:12:09.845781+0000","last_peered":"2023-06-09T11:12:09.845781+0000","last_clean":"2023-06-09T11:12:09.845781+0000","last_became_active":"2023-06-09T11:12:08.842999+0000","last_became_peered":"2023-06-09T11:12:08.842999+0000","last_unstale":"2023-06-09T11:12:09.845781+0000","last_undegraded":"2023-06-09T11:12:09.845781+0000","last_fullsized":"2023-06-09T11:12:09.845781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821865+0000","last_change":"2023-06-09T11:12:08.827890+0000","last_active":"2023-06-09T11:12:09.821865+0000","last_peered":"2023-06-09T11:12:09.821865+0000","last_clean":"2023-06-09T11:12:09.821865+0000","last_became_active":"2023-06-09T11:12:08.827592+0000","last_became_peered":"2023-06-09T11:12:08.827592+0000","last_unstale":"2023-06-09T11:12:09.821865+0000","last_undegraded":"2023-06-09T11:12:09.821865+0000","last_fullsized":"2023-06-09T11:12:09.821865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141045+0000","last_change":"2023-06-09T11:12:08.830805+0000","last_active":"2023-06-09T11:12:10.141045+0000","last_peered":"2023-06-09T11:12:10.141045+0000","last_clean":"2023-06-09T11:12:10.141045+0000","last_became_active":"2023-06-09T11:12:08.830542+0000","last_became_peered":"2023-06-09T11:12:08.830542+0000","last_unstale":"2023-06-09T11:12:10.141045+0000","last_undegraded":"2023-06-09T11:12:10.141045+0000","last_fullsized":"2023-06-09T11:12:10.141045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823971+0000","last_change":"2023-06-09T11:12:08.829977+0000","last_active":"2023-06-09T11:12:09.823971+0000","last_peered":"2023-06-09T11:12:09.823971+0000","last_clean":"2023-06-09T11:12:09.823971+0000","last_became_active":"2023-06-09T11:12:08.829646+0000","last_became_peered":"2023-06-09T11:12:08.829646+0000","last_unstale":"2023-06-09T11:12:09.823971+0000","last_undegraded":"2023-06-09T11:12:09.823971+0000","last_fullsized":"2023-06-09T11:12:09.823971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838592+0000","last_change":"2023-06-09T11:12:08.835400+0000","last_active":"2023-06-09T11:12:09.838592+0000","last_peered":"2023-06-09T11:12:09.838592+0000","last_clean":"2023-06-09T11:12:09.838592+0000","last_became_active":"2023-06-09T11:12:08.835057+0000","last_became_peered":"2023-06-09T11:12:08.835057+0000","last_unstale":"2023-06-09T11:12:09.838592+0000","last_undegraded":"2023-06-09T11:12:09.838592+0000","last_fullsized":"2023-06-09T11:12:09.838592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:31:06.835160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823882+0000","last_change":"2023-06-09T11:12:08.834281+0000","last_active":"2023-06-09T11:12:09.823882+0000","last_peered":"2023-06-09T11:12:09.823882+0000","last_clean":"2023-06-09T11:12:09.823882+0000","last_became_active":"2023-06-09T11:12:08.833982+0000","last_became_peered":"2023-06-09T11:12:08.833982+0000","last_unstale":"2023-06-09T11:12:09.823882+0000","last_undegraded":"2023-06-09T11:12:09.823882+0000","last_fullsized":"2023-06-09T11:12:09.823882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846062+0000","last_change":"2023-06-09T11:12:08.844527+0000","last_active":"2023-06-09T11:12:09.846062+0000","last_peered":"2023-06-09T11:12:09.846062+0000","last_clean":"2023-06-09T11:12:09.846062+0000","last_became_active":"2023-06-09T11:12:08.843678+0000","last_became_peered":"2023-06-09T11:12:08.843678+0000","last_unstale":"2023-06-09T11:12:09.846062+0000","last_undegraded":"2023-06-09T11:12:09.846062+0000","last_fullsized":"2023-06-09T11:12:09.846062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140195+0000","last_change":"2023-06-09T11:12:08.838192+0000","last_active":"2023-06-09T11:12:10.140195+0000","last_peered":"2023-06-09T11:12:10.140195+0000","last_clean":"2023-06-09T11:12:10.140195+0000","last_became_active":"2023-06-09T11:12:08.837602+0000","last_became_peered":"2023-06-09T11:12:08.837602+0000","last_unstale":"2023-06-09T11:12:10.140195+0000","last_undegraded":"2023-06-09T11:12:10.140195+0000","last_fullsized":"2023-06-09T11:12:10.140195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819267+0000","last_change":"2023-06-09T11:12:08.827140+0000","last_active":"2023-06-09T11:12:09.819267+0000","last_peered":"2023-06-09T11:12:09.819267+0000","last_clean":"2023-06-09T11:12:09.819267+0000","last_became_active":"2023-06-09T11:12:08.826856+0000","last_became_peered":"2023-06-09T11:12:08.826856+0000","last_unstale":"2023-06-09T11:12:09.819267+0000","last_undegraded":"2023-06-09T11:12:09.819267+0000","last_fullsized":"2023-06-09T11:12:09.819267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846005+0000","last_change":"2023-06-09T11:12:08.845240+0000","last_active":"2023-06-09T11:12:09.846005+0000","last_peered":"2023-06-09T11:12:09.846005+0000","last_clean":"2023-06-09T11:12:09.846005+0000","last_became_active":"2023-06-09T11:12:08.844410+0000","last_became_peered":"2023-06-09T11:12:08.844410+0000","last_unstale":"2023-06-09T11:12:09.846005+0000","last_undegraded":"2023-06-09T11:12:09.846005+0000","last_fullsized":"2023-06-09T11:12:09.846005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849751+0000","last_change":"2023-06-09T11:12:08.837911+0000","last_active":"2023-06-09T11:12:09.849751+0000","last_peered":"2023-06-09T11:12:09.849751+0000","last_clean":"2023-06-09T11:12:09.849751+0000","last_became_active":"2023-06-09T11:12:08.837627+0000","last_became_peered":"2023-06-09T11:12:08.837627+0000","last_unstale":"2023-06-09T11:12:09.849751+0000","last_undegraded":"2023-06-09T11:12:09.849751+0000","last_fullsized":"2023-06-09T11:12:09.849751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849808+0000","last_change":"2023-06-09T11:12:08.834539+0000","last_active":"2023-06-09T11:12:09.849808+0000","last_peered":"2023-06-09T11:12:09.849808+0000","last_clean":"2023-06-09T11:12:09.849808+0000","last_became_active":"2023-06-09T11:12:08.834197+0000","last_became_peered":"2023-06-09T11:12:08.834197+0000","last_unstale":"2023-06-09T11:12:09.849808+0000","last_undegraded":"2023-06-09T11:12:09.849808+0000","last_fullsized":"2023-06-09T11:12:09.849808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823239+0000","last_change":"2023-06-09T11:12:08.839682+0000","last_active":"2023-06-09T11:12:09.823239+0000","last_peered":"2023-06-09T11:12:09.823239+0000","last_clean":"2023-06-09T11:12:09.823239+0000","last_became_active":"2023-06-09T11:12:08.838961+0000","last_became_peered":"2023-06-09T11:12:08.838961+0000","last_unstale":"2023-06-09T11:12:09.823239+0000","last_undegraded":"2023-06-09T11:12:09.823239+0000","last_fullsized":"2023-06-09T11:12:09.823239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849236+0000","last_change":"2023-06-09T11:12:08.846811+0000","last_active":"2023-06-09T11:12:09.849236+0000","last_peered":"2023-06-09T11:12:09.849236+0000","last_clean":"2023-06-09T11:12:09.849236+0000","last_became_active":"2023-06-09T11:12:08.846391+0000","last_became_peered":"2023-06-09T11:12:08.846391+0000","last_unstale":"2023-06-09T11:12:09.849236+0000","last_undegraded":"2023-06-09T11:12:09.849236+0000","last_fullsized":"2023-06-09T11:12:09.849236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819649+0000","last_change":"2023-06-09T11:12:08.838865+0000","last_active":"2023-06-09T11:12:09.819649+0000","last_peered":"2023-06-09T11:12:09.819649+0000","last_clean":"2023-06-09T11:12:09.819649+0000","last_became_active":"2023-06-09T11:12:08.838587+0000","last_became_peered":"2023-06-09T11:12:08.838587+0000","last_unstale":"2023-06-09T11:12:09.819649+0000","last_undegraded":"2023-06-09T11:12:09.819649+0000","last_fullsized":"2023-06-09T11:12:09.819649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822571+0000","last_change":"2023-06-09T11:12:08.832860+0000","last_active":"2023-06-09T11:12:09.822571+0000","last_peered":"2023-06-09T11:12:09.822571+0000","last_clean":"2023-06-09T11:12:09.822571+0000","last_became_active":"2023-06-09T11:12:08.832580+0000","last_became_peered":"2023-06-09T11:12:08.832580+0000","last_unstale":"2023-06-09T11:12:09.822571+0000","last_undegraded":"2023-06-09T11:12:09.822571+0000","last_fullsized":"2023-06-09T11:12:09.822571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819165+0000","last_change":"2023-06-09T11:12:08.839816+0000","last_active":"2023-06-09T11:12:09.819165+0000","last_peered":"2023-06-09T11:12:09.819165+0000","last_clean":"2023-06-09T11:12:09.819165+0000","last_became_active":"2023-06-09T11:12:08.839381+0000","last_became_peered":"2023-06-09T11:12:08.839381+0000","last_unstale":"2023-06-09T11:12:09.819165+0000","last_undegraded":"2023-06-09T11:12:09.819165+0000","last_fullsized":"2023-06-09T11:12:09.819165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138744+0000","last_change":"2023-06-09T11:12:08.833196+0000","last_active":"2023-06-09T11:12:10.138744+0000","last_peered":"2023-06-09T11:12:10.138744+0000","last_clean":"2023-06-09T11:12:10.138744+0000","last_became_active":"2023-06-09T11:12:08.832913+0000","last_became_peered":"2023-06-09T11:12:08.832913+0000","last_unstale":"2023-06-09T11:12:10.138744+0000","last_undegraded":"2023-06-09T11:12:10.138744+0000","last_fullsized":"2023-06-09T11:12:10.138744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820004+0000","last_change":"2023-06-09T11:12:08.839962+0000","last_active":"2023-06-09T11:12:09.820004+0000","last_peered":"2023-06-09T11:12:09.820004+0000","last_clean":"2023-06-09T11:12:09.820004+0000","last_became_active":"2023-06-09T11:12:08.839675+0000","last_became_peered":"2023-06-09T11:12:08.839675+0000","last_unstale":"2023-06-09T11:12:09.820004+0000","last_undegraded":"2023-06-09T11:12:09.820004+0000","last_fullsized":"2023-06-09T11:12:09.820004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846303+0000","last_change":"2023-06-09T11:12:08.283296+0000","last_active":"2023-06-09T11:12:09.846303+0000","last_peered":"2023-06-09T11:12:09.846303+0000","last_clean":"2023-06-09T11:12:09.846303+0000","last_became_active":"2023-06-09T11:12:08.282947+0000","last_became_peered":"2023-06-09T11:12:08.282947+0000","last_unstale":"2023-06-09T11:12:09.846303+0000","last_undegraded":"2023-06-09T11:12:09.846303+0000","last_fullsized":"2023-06-09T11:12:09.846303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823280+0000","last_change":"2023-06-09T11:12:08.839863+0000","last_active":"2023-06-09T11:12:09.823280+0000","last_peered":"2023-06-09T11:12:09.823280+0000","last_clean":"2023-06-09T11:12:09.823280+0000","last_became_active":"2023-06-09T11:12:08.839412+0000","last_became_peered":"2023-06-09T11:12:08.839412+0000","last_unstale":"2023-06-09T11:12:09.823280+0000","last_undegraded":"2023-06-09T11:12:09.823280+0000","last_fullsized":"2023-06-09T11:12:09.823280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140262+0000","last_change":"2023-06-09T11:12:08.282887+0000","last_active":"2023-06-09T11:12:10.140262+0000","last_peered":"2023-06-09T11:12:10.140262+0000","last_clean":"2023-06-09T11:12:10.140262+0000","last_became_active":"2023-06-09T11:12:08.282019+0000","last_became_peered":"2023-06-09T11:12:08.282019+0000","last_unstale":"2023-06-09T11:12:10.140262+0000","last_undegraded":"2023-06-09T11:12:10.140262+0000","last_fullsized":"2023-06-09T11:12:10.140262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141115+0000","last_change":"2023-06-09T11:12:08.826851+0000","last_active":"2023-06-09T11:12:10.141115+0000","last_peered":"2023-06-09T11:12:10.141115+0000","last_clean":"2023-06-09T11:12:10.141115+0000","last_became_active":"2023-06-09T11:12:08.826485+0000","last_became_peered":"2023-06-09T11:12:08.826485+0000","last_unstale":"2023-06-09T11:12:10.141115+0000","last_undegraded":"2023-06-09T11:12:10.141115+0000","last_fullsized":"2023-06-09T11:12:10.141115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845892+0000","last_change":"2023-06-09T11:12:08.287775+0000","last_active":"2023-06-09T11:12:09.845892+0000","last_peered":"2023-06-09T11:12:09.845892+0000","last_clean":"2023-06-09T11:12:09.845892+0000","last_became_active":"2023-06-09T11:12:08.287415+0000","last_became_peered":"2023-06-09T11:12:08.287415+0000","last_unstale":"2023-06-09T11:12:09.845892+0000","last_undegraded":"2023-06-09T11:12:09.845892+0000","last_fullsized":"2023-06-09T11:12:09.845892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819886+0000","last_change":"2023-06-09T11:12:08.845899+0000","last_active":"2023-06-09T11:12:09.819886+0000","last_peered":"2023-06-09T11:12:09.819886+0000","last_clean":"2023-06-09T11:12:09.819886+0000","last_became_active":"2023-06-09T11:12:08.845497+0000","last_became_peered":"2023-06-09T11:12:08.845497+0000","last_unstale":"2023-06-09T11:12:09.819886+0000","last_undegraded":"2023-06-09T11:12:09.819886+0000","last_fullsized":"2023-06-09T11:12:09.819886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139028+0000","last_change":"2023-06-09T11:12:08.283802+0000","last_active":"2023-06-09T11:12:10.139028+0000","last_peered":"2023-06-09T11:12:10.139028+0000","last_clean":"2023-06-09T11:12:10.139028+0000","last_became_active":"2023-06-09T11:12:08.283417+0000","last_became_peered":"2023-06-09T11:12:08.283417+0000","last_unstale":"2023-06-09T11:12:10.139028+0000","last_undegraded":"2023-06-09T11:12:10.139028+0000","last_fullsized":"2023-06-09T11:12:10.139028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:56.322140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846310+0000","last_change":"2023-06-09T11:12:08.287954+0000","last_active":"2023-06-09T11:12:09.846310+0000","last_peered":"2023-06-09T11:12:09.846310+0000","last_clean":"2023-06-09T11:12:09.846310+0000","last_became_active":"2023-06-09T11:12:08.287641+0000","last_became_peered":"2023-06-09T11:12:08.287641+0000","last_unstale":"2023-06-09T11:12:09.846310+0000","last_undegraded":"2023-06-09T11:12:09.846310+0000","last_fullsized":"2023-06-09T11:12:09.846310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:52.398335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822883+0000","last_change":"2023-06-09T11:12:08.838149+0000","last_active":"2023-06-09T11:12:09.822883+0000","last_peered":"2023-06-09T11:12:09.822883+0000","last_clean":"2023-06-09T11:12:09.822883+0000","last_became_active":"2023-06-09T11:12:08.837839+0000","last_became_peered":"2023-06-09T11:12:08.837839+0000","last_unstale":"2023-06-09T11:12:09.822883+0000","last_undegraded":"2023-06-09T11:12:09.822883+0000","last_fullsized":"2023-06-09T11:12:09.822883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846359+0000","last_change":"2023-06-09T11:12:08.287833+0000","last_active":"2023-06-09T11:12:09.846359+0000","last_peered":"2023-06-09T11:12:09.846359+0000","last_clean":"2023-06-09T11:12:09.846359+0000","last_became_active":"2023-06-09T11:12:08.287474+0000","last_became_peered":"2023-06-09T11:12:08.287474+0000","last_unstale":"2023-06-09T11:12:09.846359+0000","last_undegraded":"2023-06-09T11:12:09.846359+0000","last_fullsized":"2023-06-09T11:12:09.846359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:54.101444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821934+0000","last_change":"2023-06-09T11:12:08.840471+0000","last_active":"2023-06-09T11:12:09.821934+0000","last_peered":"2023-06-09T11:12:09.821934+0000","last_clean":"2023-06-09T11:12:09.821934+0000","last_became_active":"2023-06-09T11:12:08.840152+0000","last_became_peered":"2023-06-09T11:12:08.840152+0000","last_unstale":"2023-06-09T11:12:09.821934+0000","last_undegraded":"2023-06-09T11:12:09.821934+0000","last_fullsized":"2023-06-09T11:12:09.821934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846498+0000","last_change":"2023-06-09T11:12:08.280882+0000","last_active":"2023-06-09T11:12:09.846498+0000","last_peered":"2023-06-09T11:12:09.846498+0000","last_clean":"2023-06-09T11:12:09.846498+0000","last_became_active":"2023-06-09T11:12:08.280608+0000","last_became_peered":"2023-06-09T11:12:08.280608+0000","last_unstale":"2023-06-09T11:12:09.846498+0000","last_undegraded":"2023-06-09T11:12:09.846498+0000","last_fullsized":"2023-06-09T11:12:09.846498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:45:50.994443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138982+0000","last_change":"2023-06-09T11:12:08.835473+0000","last_active":"2023-06-09T11:12:10.138982+0000","last_peered":"2023-06-09T11:12:10.138982+0000","last_clean":"2023-06-09T11:12:10.138982+0000","last_became_active":"2023-06-09T11:12:08.835014+0000","last_became_peered":"2023-06-09T11:12:08.835014+0000","last_unstale":"2023-06-09T11:12:10.138982+0000","last_undegraded":"2023-06-09T11:12:10.138982+0000","last_fullsized":"2023-06-09T11:12:10.138982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823071+0000","last_change":"2023-06-09T11:12:08.286293+0000","last_active":"2023-06-09T11:12:09.823071+0000","last_peered":"2023-06-09T11:12:09.823071+0000","last_clean":"2023-06-09T11:12:09.823071+0000","last_became_active":"2023-06-09T11:12:08.283192+0000","last_became_peered":"2023-06-09T11:12:08.283192+0000","last_unstale":"2023-06-09T11:12:09.823071+0000","last_undegraded":"2023-06-09T11:12:09.823071+0000","last_fullsized":"2023-06-09T11:12:09.823071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140609+0000","last_change":"2023-06-09T11:12:08.831394+0000","last_active":"2023-06-09T11:12:10.140609+0000","last_peered":"2023-06-09T11:12:10.140609+0000","last_clean":"2023-06-09T11:12:10.140609+0000","last_became_active":"2023-06-09T11:12:08.829941+0000","last_became_peered":"2023-06-09T11:12:08.829941+0000","last_unstale":"2023-06-09T11:12:10.140609+0000","last_undegraded":"2023-06-09T11:12:10.140609+0000","last_fullsized":"2023-06-09T11:12:10.140609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819914+0000","last_change":"2023-06-09T11:12:08.288840+0000","last_active":"2023-06-09T11:12:09.819914+0000","last_peered":"2023-06-09T11:12:09.819914+0000","last_clean":"2023-06-09T11:12:09.819914+0000","last_became_active":"2023-06-09T11:12:08.287719+0000","last_became_peered":"2023-06-09T11:12:08.287719+0000","last_unstale":"2023-06-09T11:12:09.819914+0000","last_undegraded":"2023-06-09T11:12:09.819914+0000","last_fullsized":"2023-06-09T11:12:09.819914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823893+0000","last_change":"2023-06-09T11:12:08.828760+0000","last_active":"2023-06-09T11:12:09.823893+0000","last_peered":"2023-06-09T11:12:09.823893+0000","last_clean":"2023-06-09T11:12:09.823893+0000","last_became_active":"2023-06-09T11:12:08.828324+0000","last_became_peered":"2023-06-09T11:12:08.828324+0000","last_unstale":"2023-06-09T11:12:09.823893+0000","last_undegraded":"2023-06-09T11:12:09.823893+0000","last_fullsized":"2023-06-09T11:12:09.823893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:05.017896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139097+0000","last_change":"2023-06-09T11:12:08.283200+0000","last_active":"2023-06-09T11:12:10.139097+0000","last_peered":"2023-06-09T11:12:10.139097+0000","last_clean":"2023-06-09T11:12:10.139097+0000","last_became_active":"2023-06-09T11:12:08.282863+0000","last_became_peered":"2023-06-09T11:12:08.282863+0000","last_unstale":"2023-06-09T11:12:10.139097+0000","last_undegraded":"2023-06-09T11:12:10.139097+0000","last_fullsized":"2023-06-09T11:12:10.139097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:41:59.540044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824104+0000","last_change":"2023-06-09T11:12:08.828410+0000","last_active":"2023-06-09T11:12:09.824104+0000","last_peered":"2023-06-09T11:12:09.824104+0000","last_clean":"2023-06-09T11:12:09.824104+0000","last_became_active":"2023-06-09T11:12:08.828040+0000","last_became_peered":"2023-06-09T11:12:08.828040+0000","last_unstale":"2023-06-09T11:12:09.824104+0000","last_undegraded":"2023-06-09T11:12:09.824104+0000","last_fullsized":"2023-06-09T11:12:09.824104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:53.412417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822247+0000","last_change":"2023-06-09T11:12:08.268559+0000","last_active":"2023-06-09T11:12:09.822247+0000","last_peered":"2023-06-09T11:12:09.822247+0000","last_clean":"2023-06-09T11:12:09.822247+0000","last_became_active":"2023-06-09T11:12:08.268123+0000","last_became_peered":"2023-06-09T11:12:08.268123+0000","last_unstale":"2023-06-09T11:12:09.822247+0000","last_undegraded":"2023-06-09T11:12:09.822247+0000","last_fullsized":"2023-06-09T11:12:09.822247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824133+0000","last_change":"2023-06-09T11:12:08.829627+0000","last_active":"2023-06-09T11:12:09.824133+0000","last_peered":"2023-06-09T11:12:09.824133+0000","last_clean":"2023-06-09T11:12:09.824133+0000","last_became_active":"2023-06-09T11:12:08.829295+0000","last_became_peered":"2023-06-09T11:12:08.829295+0000","last_unstale":"2023-06-09T11:12:09.824133+0000","last_undegraded":"2023-06-09T11:12:09.824133+0000","last_fullsized":"2023-06-09T11:12:09.824133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:59.109592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819581+0000","last_change":"2023-06-09T11:12:08.286883+0000","last_active":"2023-06-09T11:12:09.819581+0000","last_peered":"2023-06-09T11:12:09.819581+0000","last_clean":"2023-06-09T11:12:09.819581+0000","last_became_active":"2023-06-09T11:12:08.283053+0000","last_became_peered":"2023-06-09T11:12:08.283053+0000","last_unstale":"2023-06-09T11:12:09.819581+0000","last_undegraded":"2023-06-09T11:12:09.819581+0000","last_fullsized":"2023-06-09T11:12:09.819581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849756+0000","last_change":"2023-06-09T11:12:08.840789+0000","last_active":"2023-06-09T11:12:09.849756+0000","last_peered":"2023-06-09T11:12:09.849756+0000","last_clean":"2023-06-09T11:12:09.849756+0000","last_became_active":"2023-06-09T11:12:08.840180+0000","last_became_peered":"2023-06-09T11:12:08.840180+0000","last_unstale":"2023-06-09T11:12:09.849756+0000","last_undegraded":"2023-06-09T11:12:09.849756+0000","last_fullsized":"2023-06-09T11:12:09.849756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845858+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:12:09.845858+0000","last_peered":"2023-06-09T11:12:09.845858+0000","last_clean":"2023-06-09T11:12:09.845858+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:12:09.845858+0000","last_undegraded":"2023-06-09T11:12:09.845858+0000","last_fullsized":"2023-06-09T11:12:09.845858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:26.915763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823010+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:12:09.823010+0000","last_peered":"2023-06-09T11:12:09.823010+0000","last_clean":"2023-06-09T11:12:09.823010+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:12:09.823010+0000","last_undegraded":"2023-06-09T11:12:09.823010+0000","last_fullsized":"2023-06-09T11:12:09.823010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:07.747592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820178+0000","last_change":"2023-06-09T11:12:08.274664+0000","last_active":"2023-06-09T11:12:09.820178+0000","last_peered":"2023-06-09T11:12:09.820178+0000","last_clean":"2023-06-09T11:12:09.820178+0000","last_became_active":"2023-06-09T11:12:08.274254+0000","last_became_peered":"2023-06-09T11:12:08.274254+0000","last_unstale":"2023-06-09T11:12:09.820178+0000","last_undegraded":"2023-06-09T11:12:09.820178+0000","last_fullsized":"2023-06-09T11:12:09.820178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:38.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139313+0000","last_change":"2023-06-09T11:12:08.833072+0000","last_active":"2023-06-09T11:12:10.139313+0000","last_peered":"2023-06-09T11:12:10.139313+0000","last_clean":"2023-06-09T11:12:10.139313+0000","last_became_active":"2023-06-09T11:12:08.832494+0000","last_became_peered":"2023-06-09T11:12:08.832494+0000","last_unstale":"2023-06-09T11:12:10.139313+0000","last_undegraded":"2023-06-09T11:12:10.139313+0000","last_fullsized":"2023-06-09T11:12:10.139313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:49.564145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845511+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:12:09.845511+0000","last_peered":"2023-06-09T11:12:09.845511+0000","last_clean":"2023-06-09T11:12:09.845511+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:12:09.845511+0000","last_undegraded":"2023-06-09T11:12:09.845511+0000","last_fullsized":"2023-06-09T11:12:09.845511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:16.600288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140167+0000","last_change":"2023-06-09T11:12:08.288683+0000","last_active":"2023-06-09T11:12:10.140167+0000","last_peered":"2023-06-09T11:12:10.140167+0000","last_clean":"2023-06-09T11:12:10.140167+0000","last_became_active":"2023-06-09T11:12:08.288403+0000","last_became_peered":"2023-06-09T11:12:08.288403+0000","last_unstale":"2023-06-09T11:12:10.140167+0000","last_undegraded":"2023-06-09T11:12:10.140167+0000","last_fullsized":"2023-06-09T11:12:10.140167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:48.550064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140943+0000","last_change":"2023-06-09T11:12:08.835534+0000","last_active":"2023-06-09T11:12:10.140943+0000","last_peered":"2023-06-09T11:12:10.140943+0000","last_clean":"2023-06-09T11:12:10.140943+0000","last_became_active":"2023-06-09T11:12:08.835265+0000","last_became_peered":"2023-06-09T11:12:08.835265+0000","last_unstale":"2023-06-09T11:12:10.140943+0000","last_undegraded":"2023-06-09T11:12:10.140943+0000","last_fullsized":"2023-06-09T11:12:10.140943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838427+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:12:09.838427+0000","last_peered":"2023-06-09T11:12:09.838427+0000","last_clean":"2023-06-09T11:12:09.838427+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:12:09.838427+0000","last_undegraded":"2023-06-09T11:12:09.838427+0000","last_fullsized":"2023-06-09T11:12:09.838427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:17:15.668229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848689+0000","last_change":"2023-06-09T11:12:08.284371+0000","last_active":"2023-06-09T11:12:09.848689+0000","last_peered":"2023-06-09T11:12:09.848689+0000","last_clean":"2023-06-09T11:12:09.848689+0000","last_became_active":"2023-06-09T11:12:08.284025+0000","last_became_peered":"2023-06-09T11:12:08.284025+0000","last_unstale":"2023-06-09T11:12:09.848689+0000","last_undegraded":"2023-06-09T11:12:09.848689+0000","last_fullsized":"2023-06-09T11:12:09.848689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:17.551253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849884+0000","last_change":"2023-06-09T11:12:08.843683+0000","last_active":"2023-06-09T11:12:09.849884+0000","last_peered":"2023-06-09T11:12:09.849884+0000","last_clean":"2023-06-09T11:12:09.849884+0000","last_became_active":"2023-06-09T11:12:08.843390+0000","last_became_peered":"2023-06-09T11:12:08.843390+0000","last_unstale":"2023-06-09T11:12:09.849884+0000","last_undegraded":"2023-06-09T11:12:09.849884+0000","last_fullsized":"2023-06-09T11:12:09.849884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822778+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:12:09.822778+0000","last_peered":"2023-06-09T11:12:09.822778+0000","last_clean":"2023-06-09T11:12:09.822778+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:12:09.822778+0000","last_undegraded":"2023-06-09T11:12:09.822778+0000","last_fullsized":"2023-06-09T11:12:09.822778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:21.222898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823463+0000","last_change":"2023-06-09T11:12:08.285595+0000","last_active":"2023-06-09T11:12:09.823463+0000","last_peered":"2023-06-09T11:12:09.823463+0000","last_clean":"2023-06-09T11:12:09.823463+0000","last_became_active":"2023-06-09T11:12:08.285164+0000","last_became_peered":"2023-06-09T11:12:08.285164+0000","last_unstale":"2023-06-09T11:12:09.823463+0000","last_undegraded":"2023-06-09T11:12:09.823463+0000","last_fullsized":"2023-06-09T11:12:09.823463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849103+0000","last_change":"2023-06-09T11:12:08.834527+0000","last_active":"2023-06-09T11:12:09.849103+0000","last_peered":"2023-06-09T11:12:09.849103+0000","last_clean":"2023-06-09T11:12:09.849103+0000","last_became_active":"2023-06-09T11:12:08.834243+0000","last_became_peered":"2023-06-09T11:12:08.834243+0000","last_unstale":"2023-06-09T11:12:09.849103+0000","last_undegraded":"2023-06-09T11:12:09.849103+0000","last_fullsized":"2023-06-09T11:12:09.849103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823400+0000","last_change":"2023-06-09T11:12:08.286284+0000","last_active":"2023-06-09T11:12:09.823400+0000","last_peered":"2023-06-09T11:12:09.823400+0000","last_clean":"2023-06-09T11:12:09.823400+0000","last_became_active":"2023-06-09T11:12:08.282889+0000","last_became_peered":"2023-06-09T11:12:08.282889+0000","last_unstale":"2023-06-09T11:12:09.823400+0000","last_undegraded":"2023-06-09T11:12:09.823400+0000","last_fullsized":"2023-06-09T11:12:09.823400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849294+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:12:09.849294+0000","last_peered":"2023-06-09T11:12:09.849294+0000","last_clean":"2023-06-09T11:12:09.849294+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:12:09.849294+0000","last_undegraded":"2023-06-09T11:12:09.849294+0000","last_fullsized":"2023-06-09T11:12:09.849294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:38.034603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848923+0000","last_change":"2023-06-09T11:12:08.843701+0000","last_active":"2023-06-09T11:12:09.848923+0000","last_peered":"2023-06-09T11:12:09.848923+0000","last_clean":"2023-06-09T11:12:09.848923+0000","last_became_active":"2023-06-09T11:12:08.843450+0000","last_became_peered":"2023-06-09T11:12:08.843450+0000","last_unstale":"2023-06-09T11:12:09.848923+0000","last_undegraded":"2023-06-09T11:12:09.848923+0000","last_fullsized":"2023-06-09T11:12:09.848923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849032+0000","last_change":"2023-06-09T11:12:08.284028+0000","last_active":"2023-06-09T11:12:09.849032+0000","last_peered":"2023-06-09T11:12:09.849032+0000","last_clean":"2023-06-09T11:12:09.849032+0000","last_became_active":"2023-06-09T11:12:08.283697+0000","last_became_peered":"2023-06-09T11:12:08.283697+0000","last_unstale":"2023-06-09T11:12:09.849032+0000","last_undegraded":"2023-06-09T11:12:09.849032+0000","last_fullsized":"2023-06-09T11:12:09.849032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846609+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:12:09.846609+0000","last_peered":"2023-06-09T11:12:09.846609+0000","last_clean":"2023-06-09T11:12:09.846609+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:12:09.846609+0000","last_undegraded":"2023-06-09T11:12:09.846609+0000","last_fullsized":"2023-06-09T11:12:09.846609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:02.343312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140533+0000","last_change":"2023-06-09T11:12:08.840903+0000","last_active":"2023-06-09T11:12:10.140533+0000","last_peered":"2023-06-09T11:12:10.140533+0000","last_clean":"2023-06-09T11:12:10.140533+0000","last_became_active":"2023-06-09T11:12:08.840625+0000","last_became_peered":"2023-06-09T11:12:08.840625+0000","last_unstale":"2023-06-09T11:12:10.140533+0000","last_undegraded":"2023-06-09T11:12:10.140533+0000","last_fullsized":"2023-06-09T11:12:10.140533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820155+0000","last_change":"2023-06-09T11:12:08.282096+0000","last_active":"2023-06-09T11:12:09.820155+0000","last_peered":"2023-06-09T11:12:09.820155+0000","last_clean":"2023-06-09T11:12:09.820155+0000","last_became_active":"2023-06-09T11:12:08.281746+0000","last_became_peered":"2023-06-09T11:12:08.281746+0000","last_unstale":"2023-06-09T11:12:09.820155+0000","last_undegraded":"2023-06-09T11:12:09.820155+0000","last_fullsized":"2023-06-09T11:12:09.820155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849748+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:12:09.849748+0000","last_peered":"2023-06-09T11:12:09.849748+0000","last_clean":"2023-06-09T11:12:09.849748+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:12:09.849748+0000","last_undegraded":"2023-06-09T11:12:09.849748+0000","last_fullsized":"2023-06-09T11:12:09.849748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:50:58.945136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819086+0000","last_change":"2023-06-09T11:12:08.838416+0000","last_active":"2023-06-09T11:12:09.819086+0000","last_peered":"2023-06-09T11:12:09.819086+0000","last_clean":"2023-06-09T11:12:09.819086+0000","last_became_active":"2023-06-09T11:12:08.838099+0000","last_became_peered":"2023-06-09T11:12:08.838099+0000","last_unstale":"2023-06-09T11:12:09.819086+0000","last_undegraded":"2023-06-09T11:12:09.819086+0000","last_fullsized":"2023-06-09T11:12:09.819086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:18.012644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141256+0000","last_change":"2023-06-09T11:12:08.284961+0000","last_active":"2023-06-09T11:12:10.141256+0000","last_peered":"2023-06-09T11:12:10.141256+0000","last_clean":"2023-06-09T11:12:10.141256+0000","last_became_active":"2023-06-09T11:12:08.281299+0000","last_became_peered":"2023-06-09T11:12:08.281299+0000","last_unstale":"2023-06-09T11:12:10.141256+0000","last_undegraded":"2023-06-09T11:12:10.141256+0000","last_fullsized":"2023-06-09T11:12:10.141256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:21.658968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139133+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:12:10.139133+0000","last_peered":"2023-06-09T11:12:10.139133+0000","last_clean":"2023-06-09T11:12:10.139133+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:12:10.139133+0000","last_undegraded":"2023-06-09T11:12:10.139133+0000","last_fullsized":"2023-06-09T11:12:10.139133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:39:06.854929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822149+0000","last_change":"2023-06-09T11:12:08.839244+0000","last_active":"2023-06-09T11:12:09.822149+0000","last_peered":"2023-06-09T11:12:09.822149+0000","last_clean":"2023-06-09T11:12:09.822149+0000","last_became_active":"2023-06-09T11:12:08.838923+0000","last_became_peered":"2023-06-09T11:12:08.838923+0000","last_unstale":"2023-06-09T11:12:09.822149+0000","last_undegraded":"2023-06-09T11:12:09.822149+0000","last_fullsized":"2023-06-09T11:12:09.822149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823299+0000","last_change":"2023-06-09T11:12:08.833132+0000","last_active":"2023-06-09T11:12:09.823299+0000","last_peered":"2023-06-09T11:12:09.823299+0000","last_clean":"2023-06-09T11:12:09.823299+0000","last_became_active":"2023-06-09T11:12:08.832882+0000","last_became_peered":"2023-06-09T11:12:08.832882+0000","last_unstale":"2023-06-09T11:12:09.823299+0000","last_undegraded":"2023-06-09T11:12:09.823299+0000","last_fullsized":"2023-06-09T11:12:09.823299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824098+0000","last_change":"2023-06-09T11:12:08.275292+0000","last_active":"2023-06-09T11:12:09.824098+0000","last_peered":"2023-06-09T11:12:09.824098+0000","last_clean":"2023-06-09T11:12:09.824098+0000","last_became_active":"2023-06-09T11:12:08.274936+0000","last_became_peered":"2023-06-09T11:12:08.274936+0000","last_unstale":"2023-06-09T11:12:09.824098+0000","last_undegraded":"2023-06-09T11:12:09.824098+0000","last_fullsized":"2023-06-09T11:12:09.824098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848668+0000","last_change":"2023-06-09T11:12:08.835600+0000","last_active":"2023-06-09T11:12:09.848668+0000","last_peered":"2023-06-09T11:12:09.848668+0000","last_clean":"2023-06-09T11:12:09.848668+0000","last_became_active":"2023-06-09T11:12:08.835304+0000","last_became_peered":"2023-06-09T11:12:08.835304+0000","last_unstale":"2023-06-09T11:12:09.848668+0000","last_undegraded":"2023-06-09T11:12:09.848668+0000","last_fullsized":"2023-06-09T11:12:09.848668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846324+0000","last_change":"2023-06-09T11:12:08.288784+0000","last_active":"2023-06-09T11:12:09.846324+0000","last_peered":"2023-06-09T11:12:09.846324+0000","last_clean":"2023-06-09T11:12:09.846324+0000","last_became_active":"2023-06-09T11:12:08.288524+0000","last_became_peered":"2023-06-09T11:12:08.288524+0000","last_unstale":"2023-06-09T11:12:09.846324+0000","last_undegraded":"2023-06-09T11:12:09.846324+0000","last_fullsized":"2023-06-09T11:12:09.846324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:58.095511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823908+0000","last_change":"2023-06-09T11:12:08.279785+0000","last_active":"2023-06-09T11:12:09.823908+0000","last_peered":"2023-06-09T11:12:09.823908+0000","last_clean":"2023-06-09T11:12:09.823908+0000","last_became_active":"2023-06-09T11:12:08.279392+0000","last_became_peered":"2023-06-09T11:12:08.279392+0000","last_unstale":"2023-06-09T11:12:09.823908+0000","last_undegraded":"2023-06-09T11:12:09.823908+0000","last_fullsized":"2023-06-09T11:12:09.823908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:44.593553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819358+0000","last_change":"2023-06-09T11:12:08.845707+0000","last_active":"2023-06-09T11:12:09.819358+0000","last_peered":"2023-06-09T11:12:09.819358+0000","last_clean":"2023-06-09T11:12:09.819358+0000","last_became_active":"2023-06-09T11:12:08.845389+0000","last_became_peered":"2023-06-09T11:12:08.845389+0000","last_unstale":"2023-06-09T11:12:09.819358+0000","last_undegraded":"2023-06-09T11:12:09.819358+0000","last_fullsized":"2023-06-09T11:12:09.819358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141311+0000","last_change":"2023-06-09T11:12:08.281454+0000","last_active":"2023-06-09T11:12:10.141311+0000","last_peered":"2023-06-09T11:12:10.141311+0000","last_clean":"2023-06-09T11:12:10.141311+0000","last_became_active":"2023-06-09T11:12:08.280712+0000","last_became_peered":"2023-06-09T11:12:08.280712+0000","last_unstale":"2023-06-09T11:12:10.141311+0000","last_undegraded":"2023-06-09T11:12:10.141311+0000","last_fullsized":"2023-06-09T11:12:10.141311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819053+0000","last_change":"2023-06-09T11:12:08.840190+0000","last_active":"2023-06-09T11:12:09.819053+0000","last_peered":"2023-06-09T11:12:09.819053+0000","last_clean":"2023-06-09T11:12:09.819053+0000","last_became_active":"2023-06-09T11:12:08.839207+0000","last_became_peered":"2023-06-09T11:12:08.839207+0000","last_unstale":"2023-06-09T11:12:09.819053+0000","last_undegraded":"2023-06-09T11:12:09.819053+0000","last_fullsized":"2023-06-09T11:12:09.819053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.842234+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.841945+0000","last_became_peered":"2023-06-09T11:12:08.841945+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:45.639089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819318+0000","last_change":"2023-06-09T11:12:08.287948+0000","last_active":"2023-06-09T11:12:09.819318+0000","last_peered":"2023-06-09T11:12:09.819318+0000","last_clean":"2023-06-09T11:12:09.819318+0000","last_became_active":"2023-06-09T11:12:08.287279+0000","last_became_peered":"2023-06-09T11:12:08.287279+0000","last_unstale":"2023-06-09T11:12:09.819318+0000","last_undegraded":"2023-06-09T11:12:09.819318+0000","last_fullsized":"2023-06-09T11:12:09.819318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:52.750567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140755+0000","last_change":"2023-06-09T11:12:08.846000+0000","last_active":"2023-06-09T11:12:10.140755+0000","last_peered":"2023-06-09T11:12:10.140755+0000","last_clean":"2023-06-09T11:12:10.140755+0000","last_became_active":"2023-06-09T11:12:08.845741+0000","last_became_peered":"2023-06-09T11:12:08.845741+0000","last_unstale":"2023-06-09T11:12:10.140755+0000","last_undegraded":"2023-06-09T11:12:10.140755+0000","last_fullsized":"2023-06-09T11:12:10.140755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848766+0000","last_change":"2023-06-09T11:12:08.283831+0000","last_active":"2023-06-09T11:12:09.848766+0000","last_peered":"2023-06-09T11:12:09.848766+0000","last_clean":"2023-06-09T11:12:09.848766+0000","last_became_active":"2023-06-09T11:12:08.283264+0000","last_became_peered":"2023-06-09T11:12:08.283264+0000","last_unstale":"2023-06-09T11:12:09.848766+0000","last_undegraded":"2023-06-09T11:12:09.848766+0000","last_fullsized":"2023-06-09T11:12:09.848766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819930+0000","last_change":"2023-06-09T11:12:08.834819+0000","last_active":"2023-06-09T11:12:09.819930+0000","last_peered":"2023-06-09T11:12:09.819930+0000","last_clean":"2023-06-09T11:12:09.819930+0000","last_became_active":"2023-06-09T11:12:08.834508+0000","last_became_peered":"2023-06-09T11:12:08.834508+0000","last_unstale":"2023-06-09T11:12:09.819930+0000","last_undegraded":"2023-06-09T11:12:09.819930+0000","last_fullsized":"2023-06-09T11:12:09.819930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822732+0000","last_change":"2023-06-09T11:12:08.280846+0000","last_active":"2023-06-09T11:12:09.822732+0000","last_peered":"2023-06-09T11:12:09.822732+0000","last_clean":"2023-06-09T11:12:09.822732+0000","last_became_active":"2023-06-09T11:12:08.280236+0000","last_became_peered":"2023-06-09T11:12:08.280236+0000","last_unstale":"2023-06-09T11:12:09.822732+0000","last_undegraded":"2023-06-09T11:12:09.822732+0000","last_fullsized":"2023-06-09T11:12:09.822732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.835695+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.835460+0000","last_became_peered":"2023-06-09T11:12:08.835460+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:57.336221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140920+0000","last_change":"2023-06-09T11:12:08.285330+0000","last_active":"2023-06-09T11:12:10.140920+0000","last_peered":"2023-06-09T11:12:10.140920+0000","last_clean":"2023-06-09T11:12:10.140920+0000","last_became_active":"2023-06-09T11:12:08.285034+0000","last_became_peered":"2023-06-09T11:12:08.285034+0000","last_unstale":"2023-06-09T11:12:10.140920+0000","last_undegraded":"2023-06-09T11:12:10.140920+0000","last_fullsized":"2023-06-09T11:12:10.140920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823127+0000","last_change":"2023-06-09T11:12:08.827779+0000","last_active":"2023-06-09T11:12:09.823127+0000","last_peered":"2023-06-09T11:12:09.823127+0000","last_clean":"2023-06-09T11:12:09.823127+0000","last_became_active":"2023-06-09T11:12:08.827529+0000","last_became_peered":"2023-06-09T11:12:08.827529+0000","last_unstale":"2023-06-09T11:12:09.823127+0000","last_undegraded":"2023-06-09T11:12:09.823127+0000","last_fullsized":"2023-06-09T11:12:09.823127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822947+0000","last_change":"2023-06-09T11:12:08.278445+0000","last_active":"2023-06-09T11:12:09.822947+0000","last_peered":"2023-06-09T11:12:09.822947+0000","last_clean":"2023-06-09T11:12:09.822947+0000","last_became_active":"2023-06-09T11:12:08.276493+0000","last_became_peered":"2023-06-09T11:12:08.276493+0000","last_unstale":"2023-06-09T11:12:09.822947+0000","last_undegraded":"2023-06-09T11:12:09.822947+0000","last_fullsized":"2023-06-09T11:12:09.822947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822406+0000","last_change":"2023-06-09T11:12:08.825777+0000","last_active":"2023-06-09T11:12:09.822406+0000","last_peered":"2023-06-09T11:12:09.822406+0000","last_clean":"2023-06-09T11:12:09.822406+0000","last_became_active":"2023-06-09T11:12:08.825486+0000","last_became_peered":"2023-06-09T11:12:08.825486+0000","last_unstale":"2023-06-09T11:12:09.822406+0000","last_undegraded":"2023-06-09T11:12:09.822406+0000","last_fullsized":"2023-06-09T11:12:09.822406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823362+0000","last_change":"2023-06-09T11:12:08.279306+0000","last_active":"2023-06-09T11:12:09.823362+0000","last_peered":"2023-06-09T11:12:09.823362+0000","last_clean":"2023-06-09T11:12:09.823362+0000","last_became_active":"2023-06-09T11:12:08.278839+0000","last_became_peered":"2023-06-09T11:12:08.278839+0000","last_unstale":"2023-06-09T11:12:09.823362+0000","last_undegraded":"2023-06-09T11:12:09.823362+0000","last_fullsized":"2023-06-09T11:12:09.823362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819796+0000","last_change":"2023-06-09T11:12:08.826596+0000","last_active":"2023-06-09T11:12:09.819796+0000","last_peered":"2023-06-09T11:12:09.819796+0000","last_clean":"2023-06-09T11:12:09.819796+0000","last_became_active":"2023-06-09T11:12:08.826297+0000","last_became_peered":"2023-06-09T11:12:08.826297+0000","last_unstale":"2023-06-09T11:12:09.819796+0000","last_undegraded":"2023-06-09T11:12:09.819796+0000","last_fullsized":"2023-06-09T11:12:09.819796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819593+0000","last_change":"2023-06-09T11:12:08.275890+0000","last_active":"2023-06-09T11:12:09.819593+0000","last_peered":"2023-06-09T11:12:09.819593+0000","last_clean":"2023-06-09T11:12:09.819593+0000","last_became_active":"2023-06-09T11:12:08.275473+0000","last_became_peered":"2023-06-09T11:12:08.275473+0000","last_unstale":"2023-06-09T11:12:09.819593+0000","last_undegraded":"2023-06-09T11:12:09.819593+0000","last_fullsized":"2023-06-09T11:12:09.819593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821857+0000","last_change":"2023-06-09T11:12:08.838762+0000","last_active":"2023-06-09T11:12:09.821857+0000","last_peered":"2023-06-09T11:12:09.821857+0000","last_clean":"2023-06-09T11:12:09.821857+0000","last_became_active":"2023-06-09T11:12:08.834883+0000","last_became_peered":"2023-06-09T11:12:08.834883+0000","last_unstale":"2023-06-09T11:12:09.821857+0000","last_undegraded":"2023-06-09T11:12:09.821857+0000","last_fullsized":"2023-06-09T11:12:09.821857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141101+0000","last_change":"2023-06-09T11:12:08.282540+0000","last_active":"2023-06-09T11:12:10.141101+0000","last_peered":"2023-06-09T11:12:10.141101+0000","last_clean":"2023-06-09T11:12:10.141101+0000","last_became_active":"2023-06-09T11:12:08.281150+0000","last_became_peered":"2023-06-09T11:12:08.281150+0000","last_unstale":"2023-06-09T11:12:10.141101+0000","last_undegraded":"2023-06-09T11:12:10.141101+0000","last_fullsized":"2023-06-09T11:12:10.141101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7976,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363864,"statfs":{"total":96636764160,"available":96628596736,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.8629999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9080,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362760,"statfs":{"total":96636764160,"available":96627466240,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:12:13.917 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T11:12:13.918 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-09T11:12:13.918 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-09T11:12:13.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-09T11:12:13.919 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-09T11:12:14.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.120+0000 7f6831fa1700 1 Processor -- start 2023-06-09T11:12:14.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f6831fa1700 1 -- start start 2023-06-09T11:12:14.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f6831fa1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f682c06dca0 0x7f682c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f6831fa1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c06e160 con 0x7f682c15c3b0 2023-06-09T11:12:14.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f6831fa1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0cc980 con 0x7f682c15c780 2023-06-09T11:12:14.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f6831fa1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c0ccc20 con 0x7f682c06dca0 2023-06-09T11:12:14.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f6830f9f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f682c15c3b0 0x7f682c06d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43394/0 (socket says 172.21.15.78:43394) 2023-06-09T11:12:14.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f6830f9f700 1 -- 172.21.15.78:0/4164570066 learned_addr learned my addr 172.21.15.78:0/4164570066 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:14.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68317a0700 1 --2- 172.21.15.78:0/4164570066 >> v2:172.21.15.78:3300/0 conn(0x7f682c06dca0 0x7f682c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68237fe700 1 -- 172.21.15.78:0/4164570066 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178544015 0 0) 0x7f682c06e160 con 0x7f682c15c3b0 2023-06-09T11:12:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68237fe700 1 -- 172.21.15.78:0/4164570066 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68140035d0 con 0x7f682c15c3b0 2023-06-09T11:12:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68237fe700 1 -- 172.21.15.78:0/4164570066 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722864998 0 0) 0x7f682c0cc980 con 0x7f682c15c780 2023-06-09T11:12:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68237fe700 1 -- 172.21.15.78:0/4164570066 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f682c06e160 con 0x7f682c15c780 2023-06-09T11:12:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68317a0700 1 -- 172.21.15.78:0/4164570066 >> v1:172.21.15.187:6789/0 conn(0x7f682c15c780 legacy=0x7f682c070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68317a0700 1 -- 172.21.15.78:0/4164570066 >> v1:172.21.15.78:6789/0 conn(0x7f682c15c3b0 legacy=0x7f682c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.124+0000 7f68317a0700 1 -- 172.21.15.78:0/4164570066 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c06e400 con 0x7f682c06dca0 2023-06-09T11:12:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f68317a0700 1 --2- 172.21.15.78:0/4164570066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c06dca0 0x7f682c0c8fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6824009d90 tx=0x7f682400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312a58146150a928 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f68237fe700 1 -- 172.21.15.78:0/4164570066 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400e070 con 0x7f682c06dca0 2023-06-09T11:12:14.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f68237fe700 1 -- 172.21.15.78:0/4164570066 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682400bb20 con 0x7f682c06dca0 2023-06-09T11:12:14.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f68237fe700 1 -- 172.21.15.78:0/4164570066 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824012430 con 0x7f682c06dca0 2023-06-09T11:12:14.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 -- 172.21.15.78:0/4164570066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c06dca0 msgr2=0x7f682c0c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 --2- 172.21.15.78:0/4164570066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c06dca0 0x7f682c0c8fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6824009d90 tx=0x7f682400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 -- 172.21.15.78:0/4164570066 shutdown_connections 2023-06-09T11:12:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 --2- 172.21.15.78:0/4164570066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c06dca0 0x7f682c0c8fa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 -- 172.21.15.78:0/4164570066 >> 172.21.15.78:0/4164570066 conn(0x7f682c0cf670 msgr2=0x7f682c0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 -- 172.21.15.78:0/4164570066 shutdown_connections 2023-06-09T11:12:14.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 -- 172.21.15.78:0/4164570066 wait complete. 2023-06-09T11:12:14.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 Processor -- start 2023-06-09T11:12:14.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.128+0000 7f6831fa1700 1 -- start start 2023-06-09T11:12:14.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f682c06dca0 0x7f682c15e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c15c3b0 0x7f682c15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f682c158f10 0x7f682c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ae080 con 0x7f682c15c3b0 2023-06-09T11:12:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ae360 con 0x7f682c158f10 2023-06-09T11:12:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ae640 con 0x7f682c06dca0 2023-06-09T11:12:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c15c3b0 0x7f682c15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c15c3b0 0x7f682c15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42316/0 (socket says 172.21.15.78:42316) 2023-06-09T11:12:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 -- 172.21.15.78:0/3079568093 learned_addr learned my addr 172.21.15.78:0/3079568093 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:14.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 -- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f682c06dca0 msgr2=0x7f682c15e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6830f9f700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f682c06dca0 0x7f682c15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f68317a0700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f682c158f10 0x7f682c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f682c06dca0 0x7f682c15e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 -- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f682c158f10 msgr2=0x7f682c159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f682c158f10 0x7f682c159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 -- 172.21.15.78:0/3079568093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009a70 con 0x7f682c15c3b0 2023-06-09T11:12:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6830f9f700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f682c06dca0 0x7f682c15e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6823fff700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c15c3b0 0x7f682c15e690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c490 tx=0x7f681c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f68217fa700 1 -- 172.21.15.78:0/3079568093 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0052d0 con 0x7f682c15c3b0 2023-06-09T11:12:14.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f68217fa700 1 -- 172.21.15.78:0/3079568093 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c005450 con 0x7f682c15c3b0 2023-06-09T11:12:14.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f68217fa700 1 -- 172.21.15.78:0/3079568093 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0038e0 con 0x7f682c15c3b0 2023-06-09T11:12:14.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c0ccf00 con 0x7f682c15c3b0 2023-06-09T11:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.132+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c0ce680 con 0x7f682c15c3b0 2023-06-09T11:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.136+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c0cd090 con 0x7f682c15c3b0 2023-06-09T11:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.136+0000 7f68217fa700 1 -- 172.21.15.78:0/3079568093 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f681c003a40 con 0x7f682c15c3b0 2023-06-09T11:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.136+0000 7f68217fa700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68180662f0 0x7f68180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.136+0000 7f68217fa700 1 -- 172.21.15.78:0/3079568093 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f681c083150 con 0x7f682c15c3b0 2023-06-09T11:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.140+0000 7f6830f9f700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68180662f0 0x7f68180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.140+0000 7f6830f9f700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68180662f0 0x7f68180687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68280011e0 tx=0x7f6828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.144+0000 7f68217fa700 1 -- 172.21.15.78:0/3079568093 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f681c050660 con 0x7f682c15c3b0 2023-06-09T11:12:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.356+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f682c0741c0 con 0x7f682c15c3b0 2023-06-09T11:12:14.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.364+0000 7f68217fa700 1 -- 172.21.15.78:0/3079568093 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164248 (secure 0 0 0) 0x7f681c053c80 con 0x7f682c15c3b0 2023-06-09T11:12:14.374 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:14.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68180662f0 msgr2=0x7f68180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68180662f0 0x7f68180687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68280011e0 tx=0x7f6828009040 comp rx=0 tx=0).stop 2023-06-09T11:12:14.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c15c3b0 msgr2=0x7f682c15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c15c3b0 0x7f682c15e690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c490 tx=0x7f681c00c850 comp rx=0 tx=0).stop 2023-06-09T11:12:14.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 shutdown_connections 2023-06-09T11:12:14.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68180662f0 0x7f68180687a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f682c158f10 0x7f682c159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c15c3b0 0x7f682c15e690 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 --2- 172.21.15.78:0/3079568093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f682c06dca0 0x7f682c15e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 >> 172.21.15.78:0/3079568093 conn(0x7f682c0cf670 msgr2=0x7f682c0b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:14.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 shutdown_connections 2023-06-09T11:12:14.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.368+0000 7f6831fa1700 1 -- 172.21.15.78:0/3079568093 wait complete. 2023-06-09T11:12:14.385 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T11:12:14.374+0000 7f55696af700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T11:12:14.397 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3679615404},{"type":"v1","addr":"172.21.15.187:6833","nonce":3679615404}]},"active_addr":"172.21.15.187:6833/3679615404","active_change":"2023-06-09T11:11:47.582162+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2880716291}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2850640962}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":247231959}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":3245945560}]}]} 2023-06-09T11:12:14.403 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-09T11:12:14.403 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-09T11:12:14.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:14.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.568+0000 7f0b99b37700 1 Processor -- start 2023-06-09T11:12:14.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.568+0000 7f0b99b37700 1 -- start start 2023-06-09T11:12:14.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99b37700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b94160940 0x7f0b940ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99b37700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94164c00 0x7f0b9406dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99b37700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b940adb00 con 0x7f0b9406f2a0 2023-06-09T11:12:14.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99b37700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b941653a0 con 0x7f0b94160940 2023-06-09T11:12:14.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99b37700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9406ba70 con 0x7f0b94164c00 2023-06-09T11:12:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b98b35700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b94160940 0x7f0b940ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94164c00 0x7f0b9406dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94164c00 0x7f0b9406dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:33470/0 (socket says 172.21.15.78:33470) 2023-06-09T11:12:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b98b35700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b94160940 0x7f0b940ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:56310/0 (socket says 172.21.15.78:56310) 2023-06-09T11:12:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 -- 172.21.15.78:0/2168802947 learned_addr learned my addr 172.21.15.78:0/2168802947 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 -- 172.21.15.78:0/2168802947 >> v2:172.21.15.187:3300/0 conn(0x7f0b94160940 msgr2=0x7f0b940ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:14.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 --2- 172.21.15.78:0/2168802947 >> v2:172.21.15.187:3300/0 conn(0x7f0b94160940 0x7f0b940ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 -- 172.21.15.78:0/2168802947 >> v1:172.21.15.187:6789/0 conn(0x7f0b9406f2a0 legacy=0x7f0b941644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 -- 172.21.15.78:0/2168802947 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940ccb10 con 0x7f0b94164c00 2023-06-09T11:12:14.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b98b35700 1 --2- 172.21.15.78:0/2168802947 >> v2:172.21.15.187:3300/0 conn(0x7f0b94160940 0x7f0b940ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:14.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b99336700 1 --2- 172.21.15.78:0/2168802947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94164c00 0x7f0b9406dfa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009e50 tx=0x7f0b8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b997991a3944f2c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b8b7fe700 1 -- 172.21.15.78:0/2168802947 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00e070 con 0x7f0b94164c00 2023-06-09T11:12:14.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b8b7fe700 1 -- 172.21.15.78:0/2168802947 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c00b910 con 0x7f0b94164c00 2023-06-09T11:12:14.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.572+0000 7f0b8b7fe700 1 -- 172.21.15.78:0/2168802947 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00bcc0 con 0x7f0b94164c00 2023-06-09T11:12:14.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 -- 172.21.15.78:0/2168802947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94164c00 msgr2=0x7f0b9406dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 --2- 172.21.15.78:0/2168802947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94164c00 0x7f0b9406dfa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009e50 tx=0x7f0b8c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:14.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 -- 172.21.15.78:0/2168802947 shutdown_connections 2023-06-09T11:12:14.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 --2- 172.21.15.78:0/2168802947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94164c00 0x7f0b9406dfa0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 --2- 172.21.15.78:0/2168802947 >> v2:172.21.15.187:3300/0 conn(0x7f0b94160940 0x7f0b940ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 -- 172.21.15.78:0/2168802947 >> 172.21.15.78:0/2168802947 conn(0x7f0b940cf670 msgr2=0x7f0b940cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 -- 172.21.15.78:0/2168802947 shutdown_connections 2023-06-09T11:12:14.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 -- 172.21.15.78:0/2168802947 wait complete. 2023-06-09T11:12:14.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 Processor -- start 2023-06-09T11:12:14.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.576+0000 7f0b99b37700 1 -- start start 2023-06-09T11:12:14.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9406f2a0 0x7f0b9415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94160940 0x7f0b940ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b94164c00 0x7f0b940af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940b27d0 con 0x7f0b9406f2a0 2023-06-09T11:12:14.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940b2ab0 con 0x7f0b94164c00 2023-06-09T11:12:14.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940b2d90 con 0x7f0b94160940 2023-06-09T11:12:14.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9406f2a0 0x7f0b9415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9406f2a0 0x7f0b9415a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42324/0 (socket says 172.21.15.78:42324) 2023-06-09T11:12:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 -- 172.21.15.78:0/4272245532 learned_addr learned my addr 172.21.15.78:0/4272245532 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b8bfff700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94160940 0x7f0b940ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99336700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b94164c00 0x7f0b940af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 -- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94160940 msgr2=0x7f0b940ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94160940 0x7f0b940ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 -- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b94164c00 msgr2=0x7f0b940af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b94164c00 0x7f0b940af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 -- 172.21.15.78:0/4272245532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900094b0 con 0x7f0b9406f2a0 2023-06-09T11:12:14.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b98b35700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9406f2a0 0x7f0b9415a060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000ebe0 tx=0x7f0b9000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b897fa700 1 -- 172.21.15.78:0/4272245532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000c850 con 0x7f0b9406f2a0 2023-06-09T11:12:14.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b897fa700 1 -- 172.21.15.78:0/4272245532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9000c9b0 con 0x7f0b9406f2a0 2023-06-09T11:12:14.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c009b30 con 0x7f0b9406f2a0 2023-06-09T11:12:14.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b897fa700 1 -- 172.21.15.78:0/4272245532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000cd40 con 0x7f0b9406f2a0 2023-06-09T11:12:14.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.580+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b941650c0 con 0x7f0b9406f2a0 2023-06-09T11:12:14.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.584+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b940add50 con 0x7f0b9406f2a0 2023-06-09T11:12:14.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.584+0000 7f0b897fa700 1 -- 172.21.15.78:0/4272245532 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b90013470 con 0x7f0b9406f2a0 2023-06-09T11:12:14.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.588+0000 7f0b897fa700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0b800662f0 0x7f0b800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.588+0000 7f0b897fa700 1 -- 172.21.15.78:0/4272245532 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b90083d80 con 0x7f0b9406f2a0 2023-06-09T11:12:14.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.588+0000 7f0b8bfff700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0b800662f0 0x7f0b800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.588+0000 7f0b8bfff700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0b800662f0 0x7f0b800687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b9406af30 tx=0x7f0b84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.596+0000 7f0b897fa700 1 -- 172.21.15.78:0/4272245532 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0b900511f0 con 0x7f0b9406f2a0 2023-06-09T11:12:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.764+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b94161d20 con 0x7f0b9406f2a0 2023-06-09T11:12:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.764+0000 7f0b897fa700 1 -- 172.21.15.78:0/4272245532 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f0b9000cea0 con 0x7f0b9406f2a0 2023-06-09T11:12:14.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:14.773 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0b800662f0 msgr2=0x7f0b800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0b800662f0 0x7f0b800687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b9406af30 tx=0x7f0b84009040 comp rx=0 tx=0).stop 2023-06-09T11:12:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9406f2a0 msgr2=0x7f0b9415a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9406f2a0 0x7f0b9415a060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000ebe0 tx=0x7f0b9000eef0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 shutdown_connections 2023-06-09T11:12:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0b800662f0 0x7f0b800687a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b94164c00 0x7f0b940af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b94160940 0x7f0b940ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 --2- 172.21.15.78:0/4272245532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b9406f2a0 0x7f0b9415a060 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 >> 172.21.15.78:0/4272245532 conn(0x7f0b940cf670 msgr2=0x7f0b9415b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 shutdown_connections 2023-06-09T11:12:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.768+0000 7f0b99b37700 1 -- 172.21.15.78:0/4272245532 wait complete. 2023-06-09T11:12:14.797 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-09T11:12:14.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.956+0000 7fcfbd6fc700 1 Processor -- start 2023-06-09T11:12:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.956+0000 7fcfbd6fc700 1 -- start start 2023-06-09T11:12:14.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfbd6fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb80ae020 0x7fcfb806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfbd6fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcfb806aca0 0x7fcfb8162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfbd6fc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80c5710 con 0x7fcfb8158b60 2023-06-09T11:12:14.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfbd6fc700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb8158f30 con 0x7fcfb806aca0 2023-06-09T11:12:14.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfbd6fc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb806b120 con 0x7fcfb80ae020 2023-06-09T11:12:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfaf7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb80ae020 0x7fcfb806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfbcefb700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcfb806aca0 0x7fcfb8162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfaf7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb80ae020 0x7fcfb806a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45312/0 (socket says 172.21.15.78:45312) 2023-06-09T11:12:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfaf7fe700 1 -- 172.21.15.78:0/3991495369 learned_addr learned my addr 172.21.15.78:0/3991495369 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfaf7fe700 1 -- 172.21.15.78:0/3991495369 >> v2:172.21.15.187:3300/0 conn(0x7fcfb806aca0 msgr2=0x7fcfb8162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfaf7fe700 1 --2- 172.21.15.78:0/3991495369 >> v2:172.21.15.187:3300/0 conn(0x7fcfb806aca0 0x7fcfb8162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfaf7fe700 1 -- 172.21.15.78:0/3991495369 >> v1:172.21.15.187:6789/0 conn(0x7fcfb8158b60 legacy=0x7fcfb8070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.960+0000 7fcfaf7fe700 1 -- 172.21.15.78:0/3991495369 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80cd830 con 0x7fcfb80ae020 2023-06-09T11:12:14.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfaf7fe700 1 --2- 172.21.15.78:0/3991495369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb80ae020 0x7fcfb806a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009910 tx=0x7fcfa0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d7f12f5ad9cef9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfb77fe700 1 -- 172.21.15.78:0/3991495369 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0011830 con 0x7fcfb80ae020 2023-06-09T11:12:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfb77fe700 1 -- 172.21.15.78:0/3991495369 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0011990 con 0x7fcfb80ae020 2023-06-09T11:12:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfb77fe700 1 -- 172.21.15.78:0/3991495369 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0011d40 con 0x7fcfb80ae020 2023-06-09T11:12:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/3991495369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb80ae020 msgr2=0x7fcfb806a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/3991495369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb80ae020 0x7fcfb806a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009910 tx=0x7fcfa0009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/3991495369 shutdown_connections 2023-06-09T11:12:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/3991495369 >> v2:172.21.15.187:3300/0 conn(0x7fcfb806aca0 0x7fcfb8162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/3991495369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb80ae020 0x7fcfb806a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/3991495369 >> 172.21.15.78:0/3991495369 conn(0x7fcfb80cf670 msgr2=0x7fcfb80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/3991495369 shutdown_connections 2023-06-09T11:12:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.964+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/3991495369 wait complete. 2023-06-09T11:12:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 Processor -- start 2023-06-09T11:12:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 -- start start 2023-06-09T11:12:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb806aca0 0x7fcfb81568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb80ae020 0x7fcfb80c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb8158b60 0x7fcfb814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80ca330 con 0x7fcfb8158b60 2023-06-09T11:12:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80c94c0 con 0x7fcfb80ae020 2023-06-09T11:12:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.968+0000 7fcfbd6fc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80c9720 con 0x7fcfb806aca0 2023-06-09T11:12:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb8158b60 0x7fcfb814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfb7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb806aca0 0x7fcfb81568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb8158b60 0x7fcfb814d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47564/0 (socket says 172.21.15.78:47564) 2023-06-09T11:12:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 -- 172.21.15.78:0/2766786722 learned_addr learned my addr 172.21.15.78:0/2766786722 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfaf7fe700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb80ae020 0x7fcfb80c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 -- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb806aca0 msgr2=0x7fcfb81568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb806aca0 0x7fcfb81568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 -- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb80ae020 msgr2=0x7fcfb80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb80ae020 0x7fcfb80c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 -- 172.21.15.78:0/2766786722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0009570 con 0x7fcfb8158b60 2023-06-09T11:12:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfb7fff700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb806aca0 0x7fcfb81568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbcefb700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb8158b60 0x7fcfb814d810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009db0 tx=0x7fcfb00074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfb57fa700 1 -- 172.21.15.78:0/2766786722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0003c40 con 0x7fcfb8158b60 2023-06-09T11:12:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfb57fa700 1 -- 172.21.15.78:0/2766786722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0010040 con 0x7fcfb8158b60 2023-06-09T11:12:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb80cd550 con 0x7fcfb8158b60 2023-06-09T11:12:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfb57fa700 1 -- 172.21.15.78:0/2766786722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00079d0 con 0x7fcfb8158b60 2023-06-09T11:12:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.972+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb80cd270 con 0x7fcfb8158b60 2023-06-09T11:12:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.976+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb80c3f00 con 0x7fcfb8158b60 2023-06-09T11:12:14.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.976+0000 7fcfb57fa700 1 -- 172.21.15.78:0/2766786722 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfb0007d40 con 0x7fcfb8158b60 2023-06-09T11:12:14.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.976+0000 7fcfb57fa700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcf98066320 0x7fcf980687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:14.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.980+0000 7fcfb57fa700 1 -- 172.21.15.78:0/2766786722 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfb0083c70 con 0x7fcfb8158b60 2023-06-09T11:12:14.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.980+0000 7fcfb7fff700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcf98066320 0x7fcf980687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:14.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.980+0000 7fcfb7fff700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcf98066320 0x7fcf980687d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000f60 tx=0x7fcfa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:14.984+0000 7fcfb57fa700 1 -- 172.21.15.78:0/2766786722 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcfb0050fd0 con 0x7fcfb8158b60 2023-06-09T11:12:15.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.160+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb815c3d0 con 0x7fcfb8158b60 2023-06-09T11:12:15.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.164+0000 7fcfb57fa700 1 -- 172.21.15.78:0/2766786722 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7fcfb000a1f0 con 0x7fcfb8158b60 2023-06-09T11:12:15.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:15.171 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.164+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcf98066320 msgr2=0x7fcf980687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.164+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcf98066320 0x7fcf980687d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000f60 tx=0x7fcfa8009040 comp rx=0 tx=0).stop 2023-06-09T11:12:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.164+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb8158b60 msgr2=0x7fcfb814d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.164+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb8158b60 0x7fcfb814d810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009db0 tx=0x7fcfb00074f0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 shutdown_connections 2023-06-09T11:12:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcf98066320 0x7fcf980687d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb8158b60 0x7fcfb814d810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb80ae020 0x7fcfb80c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 --2- 172.21.15.78:0/2766786722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb806aca0 0x7fcfb81568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 >> 172.21.15.78:0/2766786722 conn(0x7fcfb80cf670 msgr2=0x7fcfb80b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 shutdown_connections 2023-06-09T11:12:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.168+0000 7fcfbd6fc700 1 -- 172.21.15.78:0/2766786722 wait complete. 2023-06-09T11:12:15.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-09T11:12:15.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-09T11:12:15.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-09T11:12:15.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-09T11:12:15.197 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-09T11:12:15.197 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-09T11:12:15.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-09T11:12:15.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-09T11:12:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.420+0000 7f879173f700 1 Processor -- start 2023-06-09T11:12:15.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.420+0000 7f879173f700 1 -- start start 2023-06-09T11:12:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.420+0000 7f879173f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f878c0707e0 0x7f878c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.420+0000 7f879173f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f878c15ce60 0x7f878c159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.420+0000 7f879173f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c159c50 con 0x7f878c1561a0 2023-06-09T11:12:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.420+0000 7f879173f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c1596b0 con 0x7f878c15ce60 2023-06-09T11:12:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.420+0000 7f879173f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c159970 con 0x7f878c0707e0 2023-06-09T11:12:15.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f878c15ce60 0x7f878c159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f878c15ce60 0x7f878c159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47566/0 (socket says 172.21.15.78:47566) 2023-06-09T11:12:15.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 -- 172.21.15.78:0/355575275 learned_addr learned my addr 172.21.15.78:0/355575275 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878a7fc700 1 --2- 172.21.15.78:0/355575275 >> v2:172.21.15.187:3300/0 conn(0x7f878c0707e0 0x7f878c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 -- 172.21.15.78:0/355575275 >> v2:172.21.15.187:3300/0 conn(0x7f878c0707e0 msgr2=0x7f878c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 --2- 172.21.15.78:0/355575275 >> v2:172.21.15.187:3300/0 conn(0x7f878c0707e0 0x7f878c158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 -- 172.21.15.78:0/355575275 >> v1:172.21.15.187:6789/0 conn(0x7f878c1561a0 legacy=0x7f878c0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 -- 172.21.15.78:0/355575275 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c15c380 con 0x7f878c15ce60 2023-06-09T11:12:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f5882a71700 1 Processor -- start 2023-06-09T11:12:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f5882a71700 1 -- start start 2023-06-09T11:12:15.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f878b7fe700 1 --2- 172.21.15.78:0/355575275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c15ce60 0x7f878c159170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f878c06d460 tx=0x7f8780009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60208315ec7b8f8f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f224b7d2700 1 Processor -- start 2023-06-09T11:12:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f8789ffb700 1 -- 172.21.15.78:0/355575275 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780011830 con 0x7f878c15ce60 2023-06-09T11:12:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f8789ffb700 1 -- 172.21.15.78:0/355575275 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780011990 con 0x7f878c15ce60 2023-06-09T11:12:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f8789ffb700 1 -- 172.21.15.78:0/355575275 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780011d20 con 0x7f878c15ce60 2023-06-09T11:12:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f224b7d2700 1 -- start start 2023-06-09T11:12:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7ff7fdac3700 1 Processor -- start 2023-06-09T11:12:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f879173f700 1 -- 172.21.15.78:0/355575275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c15ce60 msgr2=0x7f878c159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f879173f700 1 --2- 172.21.15.78:0/355575275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c15ce60 0x7f878c159170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f878c06d460 tx=0x7f8780009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f879173f700 1 -- 172.21.15.78:0/355575275 shutdown_connections 2023-06-09T11:12:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f879173f700 1 --2- 172.21.15.78:0/355575275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c15ce60 0x7f878c159170 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f879173f700 1 --2- 172.21.15.78:0/355575275 >> v2:172.21.15.187:3300/0 conn(0x7f878c0707e0 0x7f878c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f879173f700 1 -- 172.21.15.78:0/355575275 >> 172.21.15.78:0/355575275 conn(0x7f878c0cb460 msgr2=0x7f878c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f879173f700 1 -- 172.21.15.78:0/355575275 shutdown_connections 2023-06-09T11:12:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7ff7fdac3700 1 -- start start 2023-06-09T11:12:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f879173f700 1 -- 172.21.15.78:0/355575275 wait complete. 2023-06-09T11:12:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f224b7d2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224415ce60 0x7f2244159340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f224b7d2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2244159c50 con 0x7f22440707e0 2023-06-09T11:12:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f224b7d2700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2244159970 con 0x7f22441561a0 2023-06-09T11:12:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f224b7d2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224415c380 con 0x7f224415ce60 2023-06-09T11:12:15.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.424+0000 7f5882a71700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f587c06f880 0x7f587c155f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f5882a71700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f587c156470 0x7f587c0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7fdac3700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff7f00e6d20 0x7ff7f004f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7fdac3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff7f0051170 0x7ff7f0036630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7fdac3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f0005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f588080d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f587c06f880 0x7f587c155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f588080d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f587c06f880 0x7f587c155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36842/0 (socket says 172.21.15.78:36842) 2023-06-09T11:12:15.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7fdac3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f0048570 con 0x7ff7f0051170 2023-06-09T11:12:15.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7fdac3700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f0036ff0 con 0x7ff7f00e6d20 2023-06-09T11:12:15.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7fdac3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0033940 con 0x7ff7f0036b70 2023-06-09T11:12:15.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f588100e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f587c15ce60 0x7f587c158c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37762/0 (socket says 172.21.15.78:37762) 2023-06-09T11:12:15.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f588080d700 1 -- 172.21.15.78:0/75023403 learned_addr learned my addr 172.21.15.78:0/75023403 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c159c50 con 0x7f587c15ce60 2023-06-09T11:12:15.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c15c380 con 0x7f587c156470 2023-06-09T11:12:15.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c15c660 con 0x7f587c06f880 2023-06-09T11:12:15.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f2249d6f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224415ce60 0x7f2244159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f224956e700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f22441561a0 0x7f22440700d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45688/0 (socket says 172.21.15.78:45688) 2023-06-09T11:12:15.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f224956e700 1 -- 172.21.15.78:0/20105822 learned_addr learned my addr 172.21.15.78:0/20105822 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:15.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732249834 0 0) 0x7f2244159c50 con 0x7f22440707e0 2023-06-09T11:12:15.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22300035d0 con 0x7f22440707e0 2023-06-09T11:12:15.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619403171 0 0) 0x7f2244159970 con 0x7f22441561a0 2023-06-09T11:12:15.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2244159c50 con 0x7f22441561a0 2023-06-09T11:12:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391963294 0 0) 0x7f22300035d0 con 0x7f22440707e0 2023-06-09T11:12:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224415ce60 msgr2=0x7f2244159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f224415ce60 0x7f2244159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 >> v1:172.21.15.187:6789/0 conn(0x7f22441561a0 legacy=0x7f22440700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224415c660 con 0x7f22440707e0 2023-06-09T11:12:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f2234001670 con 0x7f22440707e0 2023-06-09T11:12:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 >> v1:172.21.15.78:6789/0 conn(0x7f22440707e0 legacy=0x7f2244158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f223bfff700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2230003be0 0x7f2230003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230004870 0x7f2230004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2230005220 0x7f223000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224415c380 con 0x7f2230005220 2023-06-09T11:12:15.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223000bfd0 con 0x7f2230003be0 2023-06-09T11:12:15.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223000c190 con 0x7f2230004870 2023-06-09T11:12:15.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f0005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f0005f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45336/0 (socket says 172.21.15.78:45336) 2023-06-09T11:12:15.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f77fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff7f00e6d20 0x7ff7f004f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 -- 172.21.15.78:0/2525883987 learned_addr learned my addr 172.21.15.78:0/2525883987 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 -- 172.21.15.78:0/2525883987 >> v2:172.21.15.187:3300/0 conn(0x7ff7f00e6d20 msgr2=0x7ff7f004f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 --2- 172.21.15.78:0/2525883987 >> v2:172.21.15.187:3300/0 conn(0x7ff7f00e6d20 0x7ff7f004f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 -- 172.21.15.78:0/2525883987 >> v2:172.21.15.78:3300/0 conn(0x7ff7f0051170 msgr2=0x7ff7f0036630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 --2- 172.21.15.78:0/2525883987 >> v2:172.21.15.78:3300/0 conn(0x7ff7f0051170 0x7ff7f0036630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7ff7f7fff700 1 -- 172.21.15.78:0/2525883987 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0033c20 con 0x7ff7f0036b70 2023-06-09T11:12:15.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7f7fff700 1 --2- 172.21.15.78:0/2525883987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f0005f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000bc00 tx=0x7ff7e4009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=184d94ba3988c7fe server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f587bfff700 1 --2- 172.21.15.78:0/75023403 >> v2:172.21.15.78:3300/0 conn(0x7f587c156470 0x7f587c0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f587b7fe700 1 -- 172.21.15.78:0/75023403 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564555986 0 0) 0x7f587c159c50 con 0x7f587c15ce60 2023-06-09T11:12:15.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f587b7fe700 1 -- 172.21.15.78:0/75023403 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58640035d0 con 0x7f587c15ce60 2023-06-09T11:12:15.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f587bfff700 1 -- 172.21.15.78:0/75023403 >> v2:172.21.15.187:3300/0 conn(0x7f587c06f880 msgr2=0x7f587c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f587bfff700 1 --2- 172.21.15.78:0/75023403 >> v2:172.21.15.187:3300/0 conn(0x7f587c06f880 0x7f587c155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f587bfff700 1 -- 172.21.15.78:0/75023403 >> v1:172.21.15.78:6789/0 conn(0x7f587c15ce60 legacy=0x7f587c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f587bfff700 1 -- 172.21.15.78:0/75023403 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c15c940 con 0x7f587c156470 2023-06-09T11:12:15.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f588080d700 1 --2- 172.21.15.78:0/75023403 >> v2:172.21.15.187:3300/0 conn(0x7f587c06f880 0x7f587c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.428+0000 7f879173f700 1 Processor -- start 2023-06-09T11:12:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f879173f700 1 -- start start 2023-06-09T11:12:15.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f224956e700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2230003be0 0x7f2230003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f2249d6f700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2230005220 0x7f223000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f2248d6d700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230004870 0x7f2230004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f587bfff700 1 --2- 172.21.15.78:0/75023403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587c156470 0x7f587c0700d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f587c06ee80 tx=0x7f5870009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86973fff4d7a524f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f224956e700 1 -- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230004870 msgr2=0x7f2230004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f224956e700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230004870 0x7f2230004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f224956e700 1 -- 172.21.15.78:0/20105822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2230005220 msgr2=0x7f223000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f224956e700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2230005220 0x7f223000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f224956e700 1 -- 172.21.15.78:0/20105822 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300035d0 con 0x7f2230003be0 2023-06-09T11:12:15.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7f67fc700 1 -- 172.21.15.78:0/2525883987 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4011830 con 0x7ff7f0036b70 2023-06-09T11:12:15.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7f67fc700 1 -- 172.21.15.78:0/2525883987 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4011990 con 0x7ff7f0036b70 2023-06-09T11:12:15.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7f67fc700 1 -- 172.21.15.78:0/2525883987 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4011d20 con 0x7ff7f0036b70 2023-06-09T11:12:15.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f224956e700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2230003be0 0x7f2230003fb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f223c007f50 tx=0x7f22300058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ea7cdb6dac6cf0e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 -- 172.21.15.78:0/2525883987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 msgr2=0x7ff7f0005f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 --2- 172.21.15.78:0/2525883987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f0005f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000bc00 tx=0x7ff7e4009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f6475d1d700 1 Processor -- start 2023-06-09T11:12:15.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f587b7fe700 1 -- 172.21.15.78:0/75023403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870011830 con 0x7f587c156470 2023-06-09T11:12:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f587b7fe700 1 -- 172.21.15.78:0/75023403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870011990 con 0x7f587c156470 2023-06-09T11:12:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f587b7fe700 1 -- 172.21.15.78:0/75023403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870011d20 con 0x7f587c156470 2023-06-09T11:12:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587c156470 msgr2=0x7f587c0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f879173f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c0707e0 0x7f878c1fe260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 --2- 172.21.15.78:0/75023403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587c156470 0x7f587c0700d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f587c06ee80 tx=0x7f5870009b30 comp rx=0 tx=0).stop 2023-06-09T11:12:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 -- 172.21.15.78:0/2525883987 shutdown_connections 2023-06-09T11:12:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 --2- 172.21.15.78:0/2525883987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f0005f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 --2- 172.21.15.78:0/2525883987 >> v2:172.21.15.78:3300/0 conn(0x7ff7f0051170 0x7ff7f0036630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 --2- 172.21.15.78:0/2525883987 >> v2:172.21.15.187:3300/0 conn(0x7ff7f00e6d20 0x7ff7f004f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 -- 172.21.15.78:0/2525883987 >> 172.21.15.78:0/2525883987 conn(0x7ff7f0051630 msgr2=0x7ff7f0051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 shutdown_connections 2023-06-09T11:12:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 --2- 172.21.15.78:0/75023403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587c156470 0x7f587c0700d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 --2- 172.21.15.78:0/75023403 >> v2:172.21.15.187:3300/0 conn(0x7f587c06f880 0x7f587c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 >> 172.21.15.78:0/75023403 conn(0x7f587c0cb460 msgr2=0x7f587c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 shutdown_connections 2023-06-09T11:12:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f6475d1d700 1 -- start start 2023-06-09T11:12:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 -- 172.21.15.78:0/2525883987 shutdown_connections 2023-06-09T11:12:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f878affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c0707e0 0x7f878c1fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f879173f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f878c1561a0 0x7f878c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f878affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c0707e0 0x7f878c1fe260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47598/0 (socket says 172.21.15.78:47598) 2023-06-09T11:12:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0079f0 con 0x7f2230003be0 2023-06-09T11:12:15.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c0072f0 con 0x7f2230003be0 2023-06-09T11:12:15.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f5882a71700 1 -- 172.21.15.78:0/75023403 wait complete. 2023-06-09T11:12:15.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7ff7fdac3700 1 -- 172.21.15.78:0/2525883987 wait complete. 2023-06-09T11:12:15.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f879173f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f878c15ce60 0x7f878c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f879173f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1fe7a0 con 0x7f878c0707e0 2023-06-09T11:12:15.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f223bfff700 1 -- 172.21.15.78:0/20105822 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00cb10 con 0x7f2230003be0 2023-06-09T11:12:15.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f879173f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b1930 con 0x7f878c1561a0 2023-06-09T11:12:15.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f879173f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b1c10 con 0x7f878c15ce60 2023-06-09T11:12:15.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f878affd700 1 -- 172.21.15.78:0/3120156166 learned_addr learned my addr 172.21.15.78:0/3120156166 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f878a7fc700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f878c1561a0 0x7f878c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.432+0000 7f878b7fe700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f878c15ce60 0x7f878c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878a7fc700 1 -- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f878c15ce60 msgr2=0x7f878c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878a7fc700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f878c15ce60 0x7f878c0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878a7fc700 1 -- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c0707e0 msgr2=0x7f878c1fe260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878a7fc700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c0707e0 0x7f878c1fe260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878a7fc700 1 -- 172.21.15.78:0/3120156166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780009570 con 0x7f878c1561a0 2023-06-09T11:12:15.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f224b7d2700 1 -- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2230003be0 msgr2=0x7f2230003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f224b7d2700 1 --2- 172.21.15.78:0/20105822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2230003be0 0x7f2230003fb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f223c007f50 tx=0x7f22300058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f2249d6f700 1 -- 172.21.15.78:0/20105822 reap_dead start 2023-06-09T11:12:15.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878affd700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f878c0707e0 0x7f878c1fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:15.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878b7fe700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f878c15ce60 0x7f878c0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:15.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f878a7fc700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f878c1561a0 0x7f878c0ccdb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f877c00e8d0 tx=0x7f877c00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f224b7d2700 1 -- 172.21.15.78:0/20105822 shutdown_connections 2023-06-09T11:12:15.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f224b7d2700 1 -- 172.21.15.78:0/20105822 >> 172.21.15.78:0/20105822 conn(0x7f22440cb460 msgr2=0x7f22440cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f6475d1d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f647006ff40 0x7f6470070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f5882a71700 1 Processor -- start 2023-06-09T11:12:15.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f87737fe700 1 -- 172.21.15.78:0/3120156166 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c00c690 con 0x7f878c1561a0 2023-06-09T11:12:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f87737fe700 1 -- 172.21.15.78:0/3120156166 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c00c7f0 con 0x7f878c1561a0 2023-06-09T11:12:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f879173f700 1 -- 172.21.15.78:0/3120156166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c15c940 con 0x7f878c1561a0 2023-06-09T11:12:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f87737fe700 1 -- 172.21.15.78:0/3120156166 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c00cb60 con 0x7f878c1561a0 2023-06-09T11:12:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f879173f700 1 -- 172.21.15.78:0/3120156166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c15c660 con 0x7f878c1561a0 2023-06-09T11:12:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f224b7d2700 1 -- 172.21.15.78:0/20105822 shutdown_connections 2023-06-09T11:12:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7ff7fdac3700 1 Processor -- start 2023-06-09T11:12:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f5882a71700 1 -- start start 2023-06-09T11:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f6475d1d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647015d9d0 con 0x7f64700c4180 2023-06-09T11:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f6475d1d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647006e040 con 0x7f647015d570 2023-06-09T11:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f6475d1d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6470157060 con 0x7f647006ff40 2023-06-09T11:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f647551c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f647015d570 0x7f6470069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45692/0 (socket says 172.21.15.78:45692) 2023-06-09T11:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f647551c700 1 -- 172.21.15.78:0/3147547143 learned_addr learned my addr 172.21.15.78:0/3147547143 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:15.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f3313fff700 1 Processor -- start 2023-06-09T11:12:15.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f5882a71700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c06f880 0x7f587c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f224b7d2700 1 -- 172.21.15.78:0/20105822 wait complete. 2023-06-09T11:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7ff7fdac3700 1 -- start start 2023-06-09T11:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f6474d1b700 1 --2- 172.21.15.78:0/3147547143 >> v2:172.21.15.78:3300/0 conn(0x7f647006ff40 0x7f6470070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7ff7fdac3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f00dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f5882a71700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587c156470 0x7f587c13e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f64677fe700 1 -- 172.21.15.78:0/3147547143 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943618266 0 0) 0x7f647006e040 con 0x7f647015d570 2023-06-09T11:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f64677fe700 1 -- 172.21.15.78:0/3147547143 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64580035d0 con 0x7f647015d570 2023-06-09T11:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f64677fe700 1 -- 172.21.15.78:0/3147547143 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183364532 0 0) 0x7f647015d9d0 con 0x7f64700c4180 2023-06-09T11:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f64677fe700 1 -- 172.21.15.78:0/3147547143 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f647006e040 con 0x7f64700c4180 2023-06-09T11:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7ff7fdac3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7f0051170 0x7ff7f004ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f00dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f00dbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45372/0 (socket says 172.21.15.78:45372) 2023-06-09T11:12:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7fdac3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7f00e6d20 0x7ff7f017f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588080d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c06f880 0x7f587c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588080d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c06f880 0x7f587c14f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45366/0 (socket says 172.21.15.78:45366) 2023-06-09T11:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7fdac3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0048a70 con 0x7ff7f0051170 2023-06-09T11:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7fdac3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0048d50 con 0x7ff7f00e6d20 2023-06-09T11:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7fdac3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0049030 con 0x7ff7f0036b70 2023-06-09T11:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 -- 172.21.15.78:0/240746752 learned_addr learned my addr 172.21.15.78:0/240746752 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f6ffd700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7f0051170 0x7ff7f004ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f224b7d2700 1 Processor -- start 2023-06-09T11:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f7fff700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7f00e6d20 0x7ff7f017f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f6474d1b700 1 -- 172.21.15.78:0/3147547143 >> v1:172.21.15.187:6789/0 conn(0x7f647015d570 legacy=0x7f6470069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f6474d1b700 1 -- 172.21.15.78:0/3147547143 >> v1:172.21.15.78:6789/0 conn(0x7f64700c4180 legacy=0x7f647015ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f6474d1b700 1 -- 172.21.15.78:0/3147547143 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470070850 con 0x7f647006ff40 2023-06-09T11:12:15.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.436+0000 7f3313fff700 1 -- start start 2023-06-09T11:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3313fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3314069ed0 0x7f331406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3313fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f33140d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3313fff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331415cb00 con 0x7f331415c730 2023-06-09T11:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3313fff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331406dfe0 con 0x7f3314069ed0 2023-06-09T11:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3313fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331406a4b0 con 0x7f331406db60 2023-06-09T11:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f87737fe700 1 -- 172.21.15.78:0/3120156166 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f877c00ccc0 con 0x7f878c1561a0 2023-06-09T11:12:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f224b7d2700 1 -- start start 2023-06-09T11:12:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 -- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7f00e6d20 msgr2=0x7ff7f017f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7f00e6d20 0x7ff7f017f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 -- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7f0051170 msgr2=0x7ff7f004ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7f0051170 0x7ff7f004ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 -- 172.21.15.78:0/240746752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4009570 con 0x7ff7f0036b70 2023-06-09T11:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f6ffd700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7f0051170 0x7ff7f004ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33127fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3314069ed0 0x7f331406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3312ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f331415c730 0x7f3314160c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37806/0 (socket says 172.21.15.78:37806) 2023-06-09T11:12:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3312ffd700 1 -- 172.21.15.78:0/1083515351 learned_addr learned my addr 172.21.15.78:0/1083515351 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33137fe700 1 --2- 172.21.15.78:0/1083515351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f33140d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33127fc700 1 -- 172.21.15.78:0/1083515351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 msgr2=0x7f33140d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33127fc700 1 --2- 172.21.15.78:0/1083515351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f33140d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33127fc700 1 -- 172.21.15.78:0/1083515351 >> v1:172.21.15.78:6789/0 conn(0x7f331415c730 legacy=0x7f3314160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33127fc700 1 -- 172.21.15.78:0/1083515351 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331406a790 con 0x7f3314069ed0 2023-06-09T11:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33137fe700 1 --2- 172.21.15.78:0/1083515351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f33140d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f6474d1b700 1 --2- 172.21.15.78:0/3147547143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f647006ff40 0x7f6470070310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f646c009850 tx=0x7f646c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4420db3e01b16667 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f224b7d2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230003be0 0x7f224415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7f77fe700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f00dbe00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7f804eb90 tx=0x7ff7f8073de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f5882a71700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c15ce60 0x7f587c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f5882a71700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c14f9d0 con 0x7f587c156470 2023-06-09T11:12:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f5882a71700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c14e7c0 con 0x7f587c15ce60 2023-06-09T11:12:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f5882a71700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c13ea40 con 0x7f587c06f880 2023-06-09T11:12:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588080d700 1 -- 172.21.15.78:0/1708398251 learned_addr learned my addr 172.21.15.78:0/1708398251 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588100e700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c15ce60 0x7f587c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f33127fc700 1 --2- 172.21.15.78:0/1083515351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 0x7f331406d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89722c8327f71fe server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3311ffb700 1 -- 172.21.15.78:0/1083515351 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00e070 con 0x7f3314069ed0 2023-06-09T11:12:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f224b7d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2244153410 0x7f2244149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f87737fe700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87780663c0 0x7f8778068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f87737fe700 1 -- 172.21.15.78:0/3120156166 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f877c083ce0 con 0x7f878c1561a0 2023-06-09T11:12:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f879173f700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7f878c0b29d0 0x7f878c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f808e070 con 0x7ff7f0036b70 2023-06-09T11:12:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3311ffb700 1 -- 172.21.15.78:0/1083515351 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00bb90 con 0x7f3314069ed0 2023-06-09T11:12:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f878affd700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87780663c0 0x7f8778068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f878b7fe700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7f878c0b29d0 0x7f878c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f64677fe700 1 -- 172.21.15.78:0/3147547143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c004230 con 0x7f647006ff40 2023-06-09T11:12:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f64677fe700 1 -- 172.21.15.78:0/3147547143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c004390 con 0x7f647006ff40 2023-06-09T11:12:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f64677fe700 1 -- 172.21.15.78:0/3147547143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0036c0 con 0x7f647006ff40 2023-06-09T11:12:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f6475d1d700 1 -- 172.21.15.78:0/3147547143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f647006ff40 msgr2=0x7f6470070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f6475d1d700 1 --2- 172.21.15.78:0/3147547143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f647006ff40 0x7f6470070310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f646c009850 tx=0x7f646c009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588080d700 1 -- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c15ce60 msgr2=0x7f587c157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588080d700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f587c15ce60 0x7f587c157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588080d700 1 -- 172.21.15.78:0/1708398251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587c156470 msgr2=0x7f587c13e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f588080d700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587c156470 0x7f587c13e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f588080d700 1 -- 172.21.15.78:0/1708398251 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700094b0 con 0x7f587c06f880 2023-06-09T11:12:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.440+0000 7f3311ffb700 1 -- 172.21.15.78:0/1083515351 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c003a40 con 0x7f3314069ed0 2023-06-09T11:12:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224b7d2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2244151ab0 0x7f224406b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224b7d2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244152ff0 con 0x7f2244153410 2023-06-09T11:12:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224b7d2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244152370 con 0x7f2244151ab0 2023-06-09T11:12:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224b7d2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2244152650 con 0x7f2230003be0 2023-06-09T11:12:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230003be0 0x7f224415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230003be0 0x7f224415af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45392/0 (socket says 172.21.15.78:45392) 2023-06-09T11:12:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 -- 172.21.15.78:0/1190248752 learned_addr learned my addr 172.21.15.78:0/1190248752 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f00341e0 con 0x7ff7f0036b70 2023-06-09T11:12:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f0033f00 con 0x7ff7f0036b70 2023-06-09T11:12:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8072070 con 0x7ff7f0036b70 2023-06-09T11:12:15.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80723e0 con 0x7ff7f0036b70 2023-06-09T11:12:15.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f588080d700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c06f880 0x7f587c14f490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f587400ce00 tx=0x7f587400a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f6475d1d700 1 -- 172.21.15.78:0/3147547143 shutdown_connections 2023-06-09T11:12:15.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f6475d1d700 1 --2- 172.21.15.78:0/3147547143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f647006ff40 0x7f6470070310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f6475d1d700 1 -- 172.21.15.78:0/3147547143 >> 172.21.15.78:0/3147547143 conn(0x7f64700cb460 msgr2=0x7f64700cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f6475d1d700 1 -- 172.21.15.78:0/3147547143 shutdown_connections 2023-06-09T11:12:15.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f6475d1d700 1 -- 172.21.15.78:0/3147547143 wait complete. 2023-06-09T11:12:15.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 -- 172.21.15.78:0/1083515351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 msgr2=0x7f331406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 --2- 172.21.15.78:0/1083515351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 0x7f331406d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:15.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400f480 con 0x7f587c06f880 2023-06-09T11:12:15.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c1594d0 con 0x7f587c06f880 2023-06-09T11:12:15.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f879173f700 1 -- 172.21.15.78:0/3120156166 --> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f878c0741c0 con 0x7f878c0b29d0 2023-06-09T11:12:15.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f878affd700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87780663c0 0x7f8778068870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f878400e300 tx=0x7f8784009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f2248d6d700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2244153410 0x7f2244149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f2249d6f700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2244151ab0 0x7f224406b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 -- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2244151ab0 msgr2=0x7f224406b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2244151ab0 0x7f224406b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 -- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2244153410 msgr2=0x7f2244149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2244153410 0x7f2244149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 -- 172.21.15.78:0/1190248752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244156570 con 0x7f2230003be0 2023-06-09T11:12:15.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c159340 con 0x7f587c06f880 2023-06-09T11:12:15.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400f5e0 con 0x7f587c06f880 2023-06-09T11:12:15.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400f950 con 0x7f587c06f880 2023-06-09T11:12:15.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 -- 172.21.15.78:0/1083515351 shutdown_connections 2023-06-09T11:12:15.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 --2- 172.21.15.78:0/1083515351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f33140d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 --2- 172.21.15.78:0/1083515351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 0x7f331406d620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 -- 172.21.15.78:0/1083515351 >> 172.21.15.78:0/1083515351 conn(0x7f33140d2e70 msgr2=0x7f33140d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f878b7fe700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7f878c0b29d0 0x7f878c1510c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224956e700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230003be0 0x7f224415af10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f223000c160 tx=0x7f223c005020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f585c000fc0 con 0x7f587c06f880 2023-06-09T11:12:15.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 -- 172.21.15.78:0/1083515351 shutdown_connections 2023-06-09T11:12:15.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7fd8f982f700 1 Processor -- start 2023-06-09T11:12:15.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f2239ffb700 1 -- 172.21.15.78:0/1190248752 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0058b0 con 0x7f2230003be0 2023-06-09T11:12:15.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f2239ffb700 1 -- 172.21.15.78:0/1190248752 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c005a10 con 0x7f2230003be0 2023-06-09T11:12:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f2239ffb700 1 -- 172.21.15.78:0/1190248752 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c005dc0 con 0x7f2230003be0 2023-06-09T11:12:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224415c940 con 0x7f2230003be0 2023-06-09T11:12:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2244152c10 con 0x7f2230003be0 2023-06-09T11:12:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7d8000fc0 con 0x7ff7f0036b70 2023-06-09T11:12:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.444+0000 7f3313fff700 1 -- 172.21.15.78:0/1083515351 wait complete. 2023-06-09T11:12:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f982f700 1 -- start start 2023-06-09T11:12:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f87737fe700 1 -- 172.21.15.78:0/3120156166 <== osd.0 v2:172.21.15.78:6800/1561635544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f878c0741c0 con 0x7f878c0b29d0 2023-06-09T11:12:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f6475d1d700 1 Processor -- start 2023-06-09T11:12:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f57ec919700 1 Processor -- start 2023-06-09T11:12:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f57ec919700 1 -- start start 2023-06-09T11:12:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f3313fff700 1 Processor -- start 2023-06-09T11:12:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f2239ffb700 1 -- 172.21.15.78:0/1190248752 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f223c028450 con 0x7f2230003be0 2023-06-09T11:12:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f6475d1d700 1 -- start start 2023-06-09T11:12:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f587400b040 con 0x7f587c06f880 2023-06-09T11:12:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f58797fa700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f58680662f0 0x7f58680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5874084c90 con 0x7f587c06f880 2023-06-09T11:12:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f58797fa700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f586806eba0 0x7f5868070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 --> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5868071660 con 0x7f586806eba0 2023-06-09T11:12:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5874085040 con 0x7f587c06f880 2023-06-09T11:12:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f587bfff700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f58680662f0 0x7f58680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7f3313fff700 1 -- start start 2023-06-09T11:12:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 0x7f33140c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f331415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f982f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8f406fc80 0x7fd8f4070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f982f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f40c7cb0 0x7fd8f406a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f982f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40c87a0 con 0x7fd8f415c880 2023-06-09T11:12:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f982f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f406e660 con 0x7fd8f406fc80 2023-06-09T11:12:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f982f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4070590 con 0x7fd8f40c7cb0 2023-06-09T11:12:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f882d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8f406fc80 0x7fd8f4070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f882d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8f406fc80 0x7fd8f4070050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36896/0 (socket says 172.21.15.78:36896) 2023-06-09T11:12:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f882d700 1 -- 172.21.15.78:0/1813710976 learned_addr learned my addr 172.21.15.78:0/1813710976 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f902e700 1 --2- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f40c7cb0 0x7fd8f406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f882d700 1 -- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f40c7cb0 msgr2=0x7fd8f406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f37fe700 1 -- 172.21.15.78:0/1813710976 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236140568 0 0) 0x7fd8f40c87a0 con 0x7fd8f415c880 2023-06-09T11:12:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f2239ffb700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f22280663f0 0x7f22280688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f2239ffb700 1 -- 172.21.15.78:0/1190248752 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f223c085370 con 0x7f2230003be0 2023-06-09T11:12:15.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f2248d6d700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f22280663f0 0x7f22280688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7f8091070 con 0x7ff7f0036b70 2023-06-09T11:12:15.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7ff7e3fff700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff7dc0663c0 0x7ff7dc068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7f80fe080 con 0x7ff7f0036b70 2023-06-09T11:12:15.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7ff7e3fff700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7ff7dc06ec70 0x7ff7dc071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 --> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7dc071730 con 0x7ff7dc06ec70 2023-06-09T11:12:15.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f80fe430 con 0x7ff7f0036b70 2023-06-09T11:12:15.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7ff7f6ffd700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff7dc0663c0 0x7ff7dc068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7ff7f7fff700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7ff7dc06ec70 0x7ff7dc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f587bfff700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f58680662f0 0x7f58680687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f587c156870 tx=0x7f5870010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f588100e700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f586806eba0 0x7f5868070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331415c730 0x7f3314156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140c8bf0 con 0x7f3314069ed0 2023-06-09T11:12:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3312ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 0x7f33140c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f331415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140c7420 con 0x7f331415c730 2023-06-09T11:12:15.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f331415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45414/0 (socket says 172.21.15.78:45414) 2023-06-09T11:12:15.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 -- 172.21.15.78:0/2351863143 learned_addr learned my addr 172.21.15.78:0/2351863143 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 -- 172.21.15.78:0/2351863143 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331415dd30 con 0x7f331406db60 2023-06-09T11:12:15.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33137fe700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331415c730 0x7f3314156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 -- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331415c730 msgr2=0x7f3314156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331415c730 0x7f3314156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 -- 172.21.15.78:0/2351863143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 msgr2=0x7f33140c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3314069ed0 0x7f33140c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 -- 172.21.15.78:0/2351863143 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c009a70 con 0x7f331406db60 2023-06-09T11:12:15.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57ec919700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f57e000c2d0 0x7f57e0036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57ec919700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e0036cb0 0x7f57e00de870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57ec919700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00345a0 con 0x7f57e004f340 2023-06-09T11:12:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57ec919700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e00e3440 con 0x7f57e000c2d0 2023-06-09T11:12:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57ec919700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00370e0 con 0x7f57e0036cb0 2023-06-09T11:12:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e759e700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f57e004f340 0x7f57e004f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45708/0 (socket says 172.21.15.78:45708) 2023-06-09T11:12:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e759e700 1 -- 172.21.15.78:0/2709243091 learned_addr learned my addr 172.21.15.78:0/2709243091 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.448+0000 7fd8f882d700 1 --2- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f40c7cb0 0x7fd8f406a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f882d700 1 -- 172.21.15.78:0/1813710976 >> v1:172.21.15.78:6789/0 conn(0x7fd8f415c880 legacy=0x7fd8f406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f882d700 1 -- 172.21.15.78:0/1813710976 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40c81e0 con 0x7fd8f406fc80 2023-06-09T11:12:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f882d700 1 --2- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f406fc80 0x7fd8f4070050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009940 tx=0x7fd8e4009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18b3c1601feaa263 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f37fe700 1 -- 172.21.15.78:0/1813710976 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400ba20 con 0x7fd8f406fc80 2023-06-09T11:12:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f37fe700 1 -- 172.21.15.78:0/1813710976 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4009e90 con 0x7fd8f406fc80 2023-06-09T11:12:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f37fe700 1 -- 172.21.15.78:0/1813710976 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400bda0 con 0x7fd8f406fc80 2023-06-09T11:12:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e659c700 1 --2- 172.21.15.78:0/2709243091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e0036cb0 0x7f57e00de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f33127fc700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f331415d7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f330c00b370 tx=0x7f330c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c012430 con 0x7f331406db60 2023-06-09T11:12:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c012590 con 0x7f331406db60 2023-06-09T11:12:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c012940 con 0x7f331406db60 2023-06-09T11:12:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f588100e700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f586806eba0 0x7f5868070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f982f700 1 -- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f406fc80 msgr2=0x7fd8f4070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f982f700 1 --2- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f406fc80 0x7fd8f4070050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009940 tx=0x7fd8e4009c50 comp rx=0 tx=0).stop 2023-06-09T11:12:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6475d1d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647006ff40 0x7f64701548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6475d1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64700c4180 0x7f64700ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6475d1d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647015d570 0x7f64700aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6475d1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700cb2f0 con 0x7f64700c4180 2023-06-09T11:12:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6475d1d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64701f6180 con 0x7f647015d570 2023-06-09T11:12:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6475d1d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64701f6cc0 con 0x7f647006ff40 2023-06-09T11:12:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 -- 172.21.15.78:0/2351863143 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33140d1050 con 0x7f331406db60 2023-06-09T11:12:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f2248d6d700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f22280663f0 0x7f22280688a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2244149e40 tx=0x7f2234009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e6d9d700 1 --2- 172.21.15.78:0/2709243091 >> v2:172.21.15.187:3300/0 conn(0x7f57e000c2d0 0x7f57e0036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6474d1b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647006ff40 0x7f64701548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f3313fff700 1 -- 172.21.15.78:0/2351863143 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33140d0d70 con 0x7f331406db60 2023-06-09T11:12:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6474d1b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647006ff40 0x7f64701548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45438/0 (socket says 172.21.15.78:45438) 2023-06-09T11:12:15.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6474d1b700 1 -- 172.21.15.78:0/1715652134 learned_addr learned my addr 172.21.15.78:0/1715652134 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f224b7d2700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7f2244151e80 0x7f224414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 --> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2244153130 con 0x7f2244151e80 2023-06-09T11:12:15.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f6467fff700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64700c4180 0x7f64700ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f982f700 1 -- 172.21.15.78:0/1813710976 shutdown_connections 2023-06-09T11:12:15.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f982f700 1 --2- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f40c7cb0 0x7fd8f406a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f982f700 1 --2- 172.21.15.78:0/1813710976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f406fc80 0x7fd8f4070050 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7fd8f982f700 1 -- 172.21.15.78:0/1813710976 >> 172.21.15.78:0/1813710976 conn(0x7fd8f40cf870 msgr2=0x7fd8f40cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e659c700 1 -- 172.21.15.78:0/2709243091 >> v2:172.21.15.187:3300/0 conn(0x7f57e000c2d0 msgr2=0x7f57e0036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e659c700 1 --2- 172.21.15.78:0/2709243091 >> v2:172.21.15.187:3300/0 conn(0x7f57e000c2d0 0x7f57e0036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e659c700 1 -- 172.21.15.78:0/2709243091 >> v1:172.21.15.187:6789/0 conn(0x7f57e004f340 legacy=0x7f57e004f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.452+0000 7f57e659c700 1 -- 172.21.15.78:0/2709243091 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00df1d0 con 0x7f57e0036cb0 2023-06-09T11:12:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f647551c700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647015d570 0x7f64700aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7fd8f982f700 1 -- 172.21.15.78:0/1813710976 shutdown_connections 2023-06-09T11:12:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f2249d6f700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7f2244151e80 0x7f224414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7ff7f6ffd700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff7dc0663c0 0x7ff7dc068870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0179c60 tx=0x7ff7ec0091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6474d1b700 1 -- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647015d570 msgr2=0x7f64700aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6474d1b700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647015d570 0x7f64700aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6474d1b700 1 -- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64700c4180 msgr2=0x7f64700ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6474d1b700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64700c4180 0x7f64700ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6474d1b700 1 -- 172.21.15.78:0/1715652134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0094b0 con 0x7f647006ff40 2023-06-09T11:12:15.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7fd8f982f700 1 -- 172.21.15.78:0/1813710976 wait complete. 2023-06-09T11:12:15.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6467fff700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64700c4180 0x7f64700ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:15.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57e659c700 1 --2- 172.21.15.78:0/2709243091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e0036cb0 0x7f57e00de870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57e8000b60 tx=0x7f57e8073dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98ed7474373daf96 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33140d1330 con 0x7f331406db60 2023-06-09T11:12:15.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6474d1b700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647006ff40 0x7f64701548a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f646c0090b0 tx=0x7f646c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57e5d9b700 1 -- 172.21.15.78:0/2709243091 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e806f350 con 0x7f57e0036cb0 2023-06-09T11:12:15.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7ff7f7fff700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7ff7dc06ec70 0x7ff7dc071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57e5d9b700 1 -- 172.21.15.78:0/2709243091 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e808d070 con 0x7f57e0036cb0 2023-06-09T11:12:15.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f2249d6f700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7f2244151e80 0x7f224414a4e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 -- 172.21.15.78:0/2709243091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e0036cb0 msgr2=0x7f57e00de870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 --2- 172.21.15.78:0/2709243091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e0036cb0 0x7f57e00de870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57e8000b60 tx=0x7f57e8073dd0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c011630 con 0x7f647006ff40 2023-06-09T11:12:15.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c01e070 con 0x7f647006ff40 2023-06-09T11:12:15.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0119b0 con 0x7f647006ff40 2023-06-09T11:12:15.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647006d9f0 con 0x7f647006ff40 2023-06-09T11:12:15.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647006d710 con 0x7f647006ff40 2023-06-09T11:12:15.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 -- 172.21.15.78:0/2709243091 shutdown_connections 2023-06-09T11:12:15.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 --2- 172.21.15.78:0/2709243091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e0036cb0 0x7f57e00de870 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 --2- 172.21.15.78:0/2709243091 >> v2:172.21.15.187:3300/0 conn(0x7f57e000c2d0 0x7f57e0036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 -- 172.21.15.78:0/2709243091 >> 172.21.15.78:0/2709243091 conn(0x7f57e0051770 msgr2=0x7f57e0051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f2239ffb700 1 -- 172.21.15.78:0/1190248752 <== osd.1 v2:172.21.15.78:6817/80014187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2244153130 con 0x7f2244151e80 2023-06-09T11:12:15.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 -- 172.21.15.78:0/2709243091 shutdown_connections 2023-06-09T11:12:15.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== osd.3 v2:172.21.15.78:6807/358574958 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff7dc071730 con 0x7ff7dc06ec70 2023-06-09T11:12:15.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== osd.4 v2:172.21.15.187:6809/225897659 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5868071660 con 0x7f586806eba0 2023-06-09T11:12:15.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f330c012aa0 con 0x7f331406db60 2023-06-09T11:12:15.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f330b7fe700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f32f40662f0 0x7f32f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f330c085d80 con 0x7f331406db60 2023-06-09T11:12:15.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f330b7fe700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f32f406eb20 0x7f32f4070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 --> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32f40715e0 con 0x7f32f406eb20 2023-06-09T11:12:15.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f330c08a030 con 0x7f331406db60 2023-06-09T11:12:15.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f33137fe700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f32f406eb20 0x7f32f4070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f3312ffd700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f32f40662f0 0x7f32f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f3312ffd700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f32f40662f0 0x7f32f40687a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009350 tx=0x7f32fc0092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.456+0000 7f57ec919700 1 -- 172.21.15.78:0/2709243091 wait complete. 2023-06-09T11:12:15.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f646c011b10 con 0x7f647006ff40 2023-06-09T11:12:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f57ec919700 1 Processor -- start 2023-06-09T11:12:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f6456ffd700 1 -- 172.21.15.78:0/1715652134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f647006dcd0 con 0x7f647006ff40 2023-06-09T11:12:15.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f33137fe700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f32f406eb20 0x7f32f4070f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f57ec919700 1 -- start start 2023-06-09T11:12:15.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7fd8f982f700 1 Processor -- start 2023-06-09T11:12:15.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f64657fa700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f645c066340 0x7f645c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.460+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f646c084ea0 con 0x7f647006ff40 2023-06-09T11:12:15.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f6467fff700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f645c066340 0x7f645c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== osd.5 v2:172.21.15.187:6824/3523281429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f32f40715e0 con 0x7f32f406eb20 2023-06-09T11:12:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f64657fa700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7f645c06ebf0 0x7f645c071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 --> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f645c0716b0 con 0x7f645c06ebf0 2023-06-09T11:12:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f646c087480 con 0x7f647006ff40 2023-06-09T11:12:15.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e000c2d0 0x7f57e00d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f647551c700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7f645c06ebf0 0x7f645c071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e6d9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e000c2d0 0x7f57e00d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e6d9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e000c2d0 0x7f57e00d1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45454/0 (socket says 172.21.15.78:45454) 2023-06-09T11:12:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f6467fff700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f645c066340 0x7f645c0687f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f647015c490 tx=0x7f6460009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f647551c700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7f645c06ebf0 0x7f645c071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57e0036cb0 0x7f57e00dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e004f340 0x7f57e00dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e004b2d0 con 0x7f57e0036cb0 2023-06-09T11:12:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e004b5b0 con 0x7f57e004f340 2023-06-09T11:12:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e004c870 con 0x7f57e000c2d0 2023-06-09T11:12:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e6d9d700 1 -- 172.21.15.78:0/3460315268 learned_addr learned my addr 172.21.15.78:0/3460315268 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e659c700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57e0036cb0 0x7f57e00dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e759e700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e004f340 0x7f57e00dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e759e700 1 -- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e000c2d0 msgr2=0x7f57e00d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e759e700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57e000c2d0 0x7f57e00d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e759e700 1 -- 172.21.15.78:0/3460315268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57e0036cb0 msgr2=0x7f57e00dceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e759e700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57e0036cb0 0x7f57e00dceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e759e700 1 -- 172.21.15.78:0/3460315268 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8066b50 con 0x7f57e004f340 2023-06-09T11:12:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57e759e700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e004f340 0x7f57e00dd3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c460 tx=0x7f57dc00c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7fd8f982f700 1 -- start start 2023-06-09T11:12:15.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc004ca0 con 0x7f57e004f340 2023-06-09T11:12:15.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 -- 172.21.15.78:0/3460315268 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e00df790 con 0x7f57e004f340 2023-06-09T11:12:15.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57ec919700 1 -- 172.21.15.78:0/3460315268 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e00df4b0 con 0x7f57e004f340 2023-06-09T11:12:15.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc004e00 con 0x7f57e004f340 2023-06-09T11:12:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.464+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== osd.2 v2:172.21.15.78:6816/1132416136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f645c0716b0 con 0x7f645c06ebf0 2023-06-09T11:12:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f982f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f406fc80 0x7fd8f4159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f982f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f40c7cb0 0x7fd8f415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f982f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f415c880 0x7fd8f40b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f982f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f41608b0 con 0x7fd8f40c7cb0 2023-06-09T11:12:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f982f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f415f9e0 con 0x7fd8f415c880 2023-06-09T11:12:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f982f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40cb500 con 0x7fd8f406fc80 2023-06-09T11:12:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f40c7cb0 0x7fd8f415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f902e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f415c880 0x7fd8f40b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f40c7cb0 0x7fd8f415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47678/0 (socket says 172.21.15.78:47678) 2023-06-09T11:12:15.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f3fff700 1 -- 172.21.15.78:0/898246217 learned_addr learned my addr 172.21.15.78:0/898246217 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc007310 con 0x7f57e004f340 2023-06-09T11:12:15.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7f57ec919700 1 -- 172.21.15.78:0/3460315268 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57c8000fc0 con 0x7f57e004f340 2023-06-09T11:12:15.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f902e700 1 -- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f406fc80 msgr2=0x7fd8f4159860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T11:12:15.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57dc0074f0 con 0x7f57e004f340 2023-06-09T11:12:15.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f902e700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f406fc80 0x7fd8f4159860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f902e700 1 -- 172.21.15.78:0/898246217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f40c7cb0 msgr2=0x7fd8f415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f902e700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f40c7cb0 0x7fd8f415e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.468+0000 7fd8f902e700 1 -- 172.21.15.78:0/898246217 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4009570 con 0x7fd8f415c880 2023-06-09T11:12:15.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f902e700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f415c880 0x7fd8f40b31b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec007d90 tx=0x7fd8ec00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec018070 con 0x7fd8f415c880 2023-06-09T11:12:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f406a070 con 0x7fd8f415c880 2023-06-09T11:12:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f40c84c0 con 0x7fd8f415c880 2023-06-09T11:12:15.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57cf7fe700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57d4066340 0x7f57d40687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00ebe0 con 0x7fd8f415c880 2023-06-09T11:12:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57dc0837c0 con 0x7f57e004f340 2023-06-09T11:12:15.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57cf7fe700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f57d406ea80 0x7f57d4070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 --> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57d4071540 con 0x7f57d406ea80 2023-06-09T11:12:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57dc085da0 con 0x7f57e004f340 2023-06-09T11:12:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57e6d9d700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57d4066340 0x7f57d40687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57e659c700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f57d406ea80 0x7f57d4070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57e6d9d700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57d4066340 0x7f57d40687f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009cb0 tx=0x7f57d8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7f57e659c700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f57d406ea80 0x7f57d4070e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec003a40 con 0x7fd8f415c880 2023-06-09T11:12:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8d4000fc0 con 0x7fd8f415c880 2023-06-09T11:12:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.472+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8ec014420 con 0x7fd8f415c880 2023-06-09T11:12:15.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.476+0000 7fd8f17fa700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd8e00662f0 0x7fd8e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.476+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8ec03a030 con 0x7fd8f415c880 2023-06-09T11:12:15.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.476+0000 7fd8f17fa700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd8e006e9b0 0x7fd8e0070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.476+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 --> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8e0071470 con 0x7fd8e006e9b0 2023-06-09T11:12:15.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.476+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== osd.6 v2:172.21.15.187:6800/2841984916 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f57d4071540 con 0x7f57d406ea80 2023-06-09T11:12:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.476+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8ec084c40 con 0x7fd8f415c880 2023-06-09T11:12:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.476+0000 7fd8f882d700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd8e00662f0 0x7fd8e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7fd8f3fff700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd8e006e9b0 0x7fd8e0070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f879173f700 1 -- 172.21.15.78:0/3120156166 --> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f878c06f340 con 0x7f878c0b29d0 2023-06-09T11:12:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7fd8f882d700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd8e00662f0 0x7fd8e00687a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009c90 tx=0x7fd8e4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7fd8f3fff700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd8e006e9b0 0x7fd8e0070dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87737fe700 1 -- 172.21.15.78:0/3120156166 <== osd.0 v2:172.21.15.78:6800/1561635544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f878c06f340 con 0x7f878c0b29d0 2023-06-09T11:12:15.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 -- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7f878c0b29d0 msgr2=0x7f878c1510c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7f878c0b29d0 0x7f878c1510c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 -- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87780663c0 msgr2=0x7f8778068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f87780663c0 0x7f8778068870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f878400e300 tx=0x7f8784009040 comp rx=0 tx=0).stop 2023-06-09T11:12:15.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 -- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f878c1561a0 msgr2=0x7f878c0ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 --2- 172.21.15.78:0/3120156166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f878c1561a0 0x7f878c0ccdb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f877c00e8d0 tx=0x7f877c00ebe0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f878b7fe700 1 -- 172.21.15.78:0/3120156166 reap_dead start 2023-06-09T11:12:15.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 -- 172.21.15.78:0/3120156166 shutdown_connections 2023-06-09T11:12:15.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 -- 172.21.15.78:0/3120156166 >> 172.21.15.78:0/3120156166 conn(0x7f878c0cb460 msgr2=0x7f878c0afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 -- 172.21.15.78:0/3120156166 shutdown_connections 2023-06-09T11:12:15.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7f87717fa700 1 -- 172.21.15.78:0/3120156166 wait complete. 2023-06-09T11:12:15.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.480+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== osd.7 v2:172.21.15.187:6808/3928672602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd8e0071470 con 0x7fd8e006e9b0 2023-06-09T11:12:15.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.484+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 --> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22440741c0 con 0x7f2244151e80 2023-06-09T11:12:15.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.484+0000 7f2239ffb700 1 -- 172.21.15.78:0/1190248752 <== osd.1 v2:172.21.15.78:6817/80014187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22440741c0 con 0x7f2244151e80 2023-06-09T11:12:15.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7f2244151e80 msgr2=0x7f224414a4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7f2244151e80 0x7f224414a4e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f22280663f0 msgr2=0x7f22280688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f22280663f0 0x7f22280688a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2244149e40 tx=0x7f2234009040 comp rx=0 tx=0).stop 2023-06-09T11:12:15.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230003be0 msgr2=0x7f224415af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 --2- 172.21.15.78:0/1190248752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2230003be0 0x7f224415af10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f223000c160 tx=0x7f223c005020 comp rx=0 tx=0).stop 2023-06-09T11:12:15.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f2249d6f700 1 -- 172.21.15.78:0/1190248752 reap_dead start 2023-06-09T11:12:15.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 shutdown_connections 2023-06-09T11:12:15.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 >> 172.21.15.78:0/1190248752 conn(0x7f22440cb460 msgr2=0x7f224406de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 shutdown_connections 2023-06-09T11:12:15.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f224b7d2700 1 -- 172.21.15.78:0/1190248752 wait complete. 2023-06-09T11:12:15.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.488+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 --> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33140741c0 con 0x7f32f406eb20 2023-06-09T11:12:15.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 --> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f585c002d60 con 0x7f586806eba0 2023-06-09T11:12:15.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f330b7fe700 1 -- 172.21.15.78:0/2351863143 <== osd.5 v2:172.21.15.187:6824/3523281429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33140741c0 con 0x7f32f406eb20 2023-06-09T11:12:15.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f58797fa700 1 -- 172.21.15.78:0/1708398251 <== osd.4 v2:172.21.15.187:6809/225897659 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f585c002d60 con 0x7f586806eba0 2023-06-09T11:12:15.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f586806eba0 msgr2=0x7f5868070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f586806eba0 0x7f5868070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f58680662f0 msgr2=0x7f58680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f58680662f0 0x7f58680687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f587c156870 tx=0x7f5870010000 comp rx=0 tx=0).stop 2023-06-09T11:12:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c06f880 msgr2=0x7f587c14f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 --2- 172.21.15.78:0/1708398251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f587c06f880 0x7f587c14f490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f587400ce00 tx=0x7f587400a560 comp rx=0 tx=0).stop 2023-06-09T11:12:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f588100e700 1 -- 172.21.15.78:0/1708398251 reap_dead start 2023-06-09T11:12:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 shutdown_connections 2023-06-09T11:12:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 >> 172.21.15.78:0/1708398251 conn(0x7f587c0cb460 msgr2=0x7f587c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 --> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7d8002d60 con 0x7ff7dc06ec70 2023-06-09T11:12:15.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.492+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 shutdown_connections 2023-06-09T11:12:15.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7f5882a71700 1 -- 172.21.15.78:0/1708398251 wait complete. 2023-06-09T11:12:15.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7e3fff700 1 -- 172.21.15.78:0/240746752 <== osd.3 v2:172.21.15.78:6807/358574958 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7d8002d60 con 0x7ff7dc06ec70 2023-06-09T11:12:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7ff7dc06ec70 msgr2=0x7ff7dc071080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7ff7dc06ec70 0x7ff7dc071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7f6456ffd700 1 -- 172.21.15.78:0/1715652134 --> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f647006dcd0 con 0x7f645c06ebf0 2023-06-09T11:12:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff7dc0663c0 msgr2=0x7ff7dc068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff7dc0663c0 0x7ff7dc068870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0179c60 tx=0x7ff7ec0091c0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 msgr2=0x7ff7f00dbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 --2- 172.21.15.78:0/240746752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7f0036b70 0x7ff7f00dbe00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7f804eb90 tx=0x7ff7f8073de0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7f7fff700 1 -- 172.21.15.78:0/240746752 reap_dead start 2023-06-09T11:12:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 shutdown_connections 2023-06-09T11:12:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 >> 172.21.15.78:0/240746752 conn(0x7ff7f0051630 msgr2=0x7ff7f00e3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f32f406eb20 msgr2=0x7f32f4070f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7f33097fa700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f32f406eb20 0x7f32f4070f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 shutdown_connections 2023-06-09T11:12:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7ff7fdac3700 1 -- 172.21.15.78:0/240746752 wait complete. 2023-06-09T11:12:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7f64657fa700 1 -- 172.21.15.78:0/1715652134 <== osd.2 v2:172.21.15.78:6816/1132416136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f647006dcd0 con 0x7f645c06ebf0 2023-06-09T11:12:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7f645c06ebf0 msgr2=0x7f645c071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.496+0000 7f6475d1d700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7f645c06ebf0 0x7f645c071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f645c066340 msgr2=0x7f645c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f645c066340 0x7f645c0687f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f647015c490 tx=0x7f6460009040 comp rx=0 tx=0).stop 2023-06-09T11:12:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57ec919700 1 -- 172.21.15.78:0/3460315268 --> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57c8002d60 con 0x7f57d406ea80 2023-06-09T11:12:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647006ff40 msgr2=0x7f64701548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 --2- 172.21.15.78:0/1715652134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647006ff40 0x7f64701548a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f646c0090b0 tx=0x7f646c004770 comp rx=0 tx=0).stop 2023-06-09T11:12:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f647551c700 1 -- 172.21.15.78:0/1715652134 reap_dead start 2023-06-09T11:12:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 shutdown_connections 2023-06-09T11:12:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 >> 172.21.15.78:0/1715652134 conn(0x7f64700cb460 msgr2=0x7f64700af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cf7fe700 1 -- 172.21.15.78:0/3460315268 <== osd.6 v2:172.21.15.187:6800/2841984916 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57c8002d60 con 0x7f57d406ea80 2023-06-09T11:12:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 shutdown_connections 2023-06-09T11:12:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f6475d1d700 1 -- 172.21.15.78:0/1715652134 wait complete. 2023-06-09T11:12:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 -- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f57d406ea80 msgr2=0x7f57d4070e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f57d406ea80 0x7f57d4070e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 -- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57d4066340 msgr2=0x7f57d40687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57d4066340 0x7f57d40687f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009cb0 tx=0x7f57d8009240 comp rx=0 tx=0).stop 2023-06-09T11:12:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 -- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e004f340 msgr2=0x7f57e00dd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 --2- 172.21.15.78:0/3460315268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e004f340 0x7f57e00dd3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c460 tx=0x7f57dc00c770 comp rx=0 tx=0).stop 2023-06-09T11:12:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57e759e700 1 -- 172.21.15.78:0/3460315268 reap_dead start 2023-06-09T11:12:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 -- 172.21.15.78:0/3460315268 shutdown_connections 2023-06-09T11:12:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 -- 172.21.15.78:0/3460315268 >> 172.21.15.78:0/3460315268 conn(0x7f57e0051770 msgr2=0x7f57e0005950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 -- 172.21.15.78:0/3460315268 shutdown_connections 2023-06-09T11:12:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.500+0000 7f57cd7fa700 1 -- 172.21.15.78:0/3460315268 wait complete. 2023-06-09T11:12:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f32f40662f0 msgr2=0x7f32f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f32f40662f0 0x7f32f40687a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009350 tx=0x7f32fc0092e0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 msgr2=0x7f331415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 --2- 172.21.15.78:0/2351863143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331406db60 0x7f331415d7f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f330c00b370 tx=0x7f330c004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33137fe700 1 -- 172.21.15.78:0/2351863143 reap_dead start 2023-06-09T11:12:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 shutdown_connections 2023-06-09T11:12:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 >> 172.21.15.78:0/2351863143 conn(0x7f33140d2e70 msgr2=0x7f3314156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 shutdown_connections 2023-06-09T11:12:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.504+0000 7f33097fa700 1 -- 172.21.15.78:0/2351863143 wait complete. 2023-06-09T11:12:15.578 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-09T11:12:15.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T11:12:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.508+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 --> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8d4002d60 con 0x7fd8e006e9b0 2023-06-09T11:12:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.508+0000 7fd8f17fa700 1 -- 172.21.15.78:0/898246217 <== osd.7 v2:172.21.15.187:6808/3928672602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd8d4002d60 con 0x7fd8e006e9b0 2023-06-09T11:12:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd8e006e9b0 msgr2=0x7fd8e0070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd8e006e9b0 0x7fd8e0070dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd8e00662f0 msgr2=0x7fd8e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd8e00662f0 0x7fd8e00687a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009c90 tx=0x7fd8e4008030 comp rx=0 tx=0).stop 2023-06-09T11:12:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f415c880 msgr2=0x7fd8f40b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 --2- 172.21.15.78:0/898246217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f415c880 0x7fd8f40b31b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec007d90 tx=0x7fd8ec00e3c0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f902e700 1 -- 172.21.15.78:0/898246217 reap_dead start 2023-06-09T11:12:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 shutdown_connections 2023-06-09T11:12:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 >> 172.21.15.78:0/898246217 conn(0x7fd8f40cf870 msgr2=0x7fd8f40b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 shutdown_connections 2023-06-09T11:12:15.583 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-09T11:12:15.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T11:12:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.512+0000 7fd8f982f700 1 -- 172.21.15.78:0/898246217 wait complete. 2023-06-09T11:12:15.586 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:15.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T11:12:15.587 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:15.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T11:12:15.589 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:15.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T11:12:15.590 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-09T11:12:15.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T11:12:15.591 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-09T11:12:15.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T11:12:15.598 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-09T11:12:15.599 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T11:12:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.836+0000 7f025eb2d700 1 Processor -- start 2023-06-09T11:12:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.836+0000 7f025eb2d700 1 -- start start 2023-06-09T11:12:15.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f6be7616700 1 Processor -- start 2023-06-09T11:12:15.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025eb2d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f02581561a0 0x7f02580700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025eb2d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f0258070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025eb2d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0258159c50 con 0x7f025815ce60 2023-06-09T11:12:15.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025eb2d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0258159760 con 0x7f02581561a0 2023-06-09T11:12:15.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025eb2d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0258159970 con 0x7f0258159340 2023-06-09T11:12:15.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f6be7616700 1 -- start start 2023-06-09T11:12:15.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025c8c9700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f02581561a0 0x7f02580700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025c8c9700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f02581561a0 0x7f02580700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36932/0 (socket says 172.21.15.78:36932) 2023-06-09T11:12:15.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025c8c9700 1 -- 172.21.15.78:0/2160103616 learned_addr learned my addr 172.21.15.78:0/2160103616 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025d0ca700 1 --2- 172.21.15.78:0/2160103616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f0258070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f02577fe700 1 -- 172.21.15.78:0/2160103616 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668288744 0 0) 0x7f0258159c50 con 0x7f025815ce60 2023-06-09T11:12:15.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f6be7616700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6be0164c00 0x7f6be00ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f6be7616700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6be006f2a0 0x7f6be006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f6be7616700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be00adb00 con 0x7f6be0160940 2023-06-09T11:12:15.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f6be7616700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be01653a0 con 0x7f6be0164c00 2023-06-09T11:12:15.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f6be7616700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be006ba70 con 0x7f6be006f2a0 2023-06-09T11:12:15.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025d0ca700 1 -- 172.21.15.78:0/2160103616 >> v2:172.21.15.187:3300/0 conn(0x7f02581561a0 msgr2=0x7f02580700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025d0ca700 1 --2- 172.21.15.78:0/2160103616 >> v2:172.21.15.187:3300/0 conn(0x7f02581561a0 0x7f02580700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025d0ca700 1 -- 172.21.15.78:0/2160103616 >> v1:172.21.15.187:6789/0 conn(0x7f025815ce60 legacy=0x7f0258158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025d0ca700 1 -- 172.21.15.78:0/2160103616 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025815c380 con 0x7f0258159340 2023-06-09T11:12:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.840+0000 7f025d0ca700 1 --2- 172.21.15.78:0/2160103616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f0258070610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0248009850 tx=0x7f0248009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279cdffab9f699d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be5bb3700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6be006f2a0 0x7f6be006dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be53b2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6be0160940 0x7f6be01644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37822/0 (socket says 172.21.15.78:37822) 2023-06-09T11:12:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be53b2700 1 -- 172.21.15.78:0/3715819486 learned_addr learned my addr 172.21.15.78:0/3715819486 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be5bb3700 1 --2- 172.21.15.78:0/3715819486 >> v2:172.21.15.187:3300/0 conn(0x7f6be006f2a0 0x7f6be006dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36944/0 (socket says 172.21.15.78:36944) 2023-06-09T11:12:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be4bb1700 1 --2- 172.21.15.78:0/3715819486 >> v2:172.21.15.78:3300/0 conn(0x7f6be0164c00 0x7f6be00ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f02577fe700 1 -- 172.21.15.78:0/2160103616 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248011830 con 0x7f0258159340 2023-06-09T11:12:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f02577fe700 1 -- 172.21.15.78:0/2160103616 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0248011990 con 0x7f0258159340 2023-06-09T11:12:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f02577fe700 1 -- 172.21.15.78:0/2160103616 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248011d40 con 0x7f0258159340 2023-06-09T11:12:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be5bb3700 1 -- 172.21.15.78:0/3715819486 >> v2:172.21.15.78:3300/0 conn(0x7f6be0164c00 msgr2=0x7f6be00ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be5bb3700 1 --2- 172.21.15.78:0/3715819486 >> v2:172.21.15.78:3300/0 conn(0x7f6be0164c00 0x7f6be00ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be5bb3700 1 -- 172.21.15.78:0/3715819486 >> v1:172.21.15.78:6789/0 conn(0x7f6be0160940 legacy=0x7f6be01644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be5bb3700 1 -- 172.21.15.78:0/3715819486 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00ccb10 con 0x7f6be006f2a0 2023-06-09T11:12:15.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 -- 172.21.15.78:0/2160103616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 msgr2=0x7f0258070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 --2- 172.21.15.78:0/2160103616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f0258070610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0248009850 tx=0x7f0248009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:15.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 -- 172.21.15.78:0/2160103616 shutdown_connections 2023-06-09T11:12:15.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 --2- 172.21.15.78:0/2160103616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f0258070610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 --2- 172.21.15.78:0/2160103616 >> v2:172.21.15.187:3300/0 conn(0x7f02581561a0 0x7f02580700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 -- 172.21.15.78:0/2160103616 >> 172.21.15.78:0/2160103616 conn(0x7f02580cb460 msgr2=0x7f02580cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be5bb3700 1 --2- 172.21.15.78:0/3715819486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be006f2a0 0x7f6be006dfa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6be00ae170 tx=0x7f6bd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f633a52b18768e1b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 -- 172.21.15.78:0/2160103616 shutdown_connections 2023-06-09T11:12:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f025eb2d700 1 -- 172.21.15.78:0/2160103616 wait complete. 2023-06-09T11:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6bd7fff700 1 -- 172.21.15.78:0/3715819486 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800e070 con 0x7f6be006f2a0 2023-06-09T11:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6bd7fff700 1 -- 172.21.15.78:0/3715819486 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800bbd0 con 0x7f6be006f2a0 2023-06-09T11:12:15.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6bd7fff700 1 -- 172.21.15.78:0/3715819486 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8012430 con 0x7f6be006f2a0 2023-06-09T11:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 -- 172.21.15.78:0/3715819486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be006f2a0 msgr2=0x7f6be006dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 --2- 172.21.15.78:0/3715819486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be006f2a0 0x7f6be006dfa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6be00ae170 tx=0x7f6bd800b330 comp rx=0 tx=0).stop 2023-06-09T11:12:15.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 -- 172.21.15.78:0/3715819486 shutdown_connections 2023-06-09T11:12:15.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 --2- 172.21.15.78:0/3715819486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be006f2a0 0x7f6be006dfa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 --2- 172.21.15.78:0/3715819486 >> v2:172.21.15.78:3300/0 conn(0x7f6be0164c00 0x7f6be00ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 -- 172.21.15.78:0/3715819486 >> 172.21.15.78:0/3715819486 conn(0x7f6be00cf670 msgr2=0x7f6be00cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 -- 172.21.15.78:0/3715819486 shutdown_connections 2023-06-09T11:12:15.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.844+0000 7f6be7616700 1 -- 172.21.15.78:0/3715819486 wait complete. 2023-06-09T11:12:15.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 Processor -- start 2023-06-09T11:12:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7fd404a5a700 1 Processor -- start 2023-06-09T11:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 -- start start 2023-06-09T11:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02581561a0 0x7f02581f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f02581f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f6be7616700 1 Processor -- start 2023-06-09T11:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f025815ce60 0x7f02580ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02581fa580 con 0x7f02581561a0 2023-06-09T11:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02580b2160 con 0x7f025815ce60 2023-06-09T11:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025eb2d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0258158790 con 0x7f0258159340 2023-06-09T11:12:15.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025c8c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02581561a0 0x7f02581f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025c8c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02581561a0 0x7f02581f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47700/0 (socket says 172.21.15.78:47700) 2023-06-09T11:12:15.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025c8c9700 1 -- 172.21.15.78:0/876724159 learned_addr learned my addr 172.21.15.78:0/876724159 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f0257fff700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f02581f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f025d0ca700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f025815ce60 0x7f02580ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7fc4abd7a700 1 Processor -- start 2023-06-09T11:12:15.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7f6be7616700 1 -- start start 2023-06-09T11:12:15.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f0257fff700 1 -- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f025815ce60 msgr2=0x7f02580ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f0257fff700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f025815ce60 0x7f02580ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f0257fff700 1 -- 172.21.15.78:0/876724159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02581561a0 msgr2=0x7f02581f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f0257fff700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02581561a0 0x7f02581f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f0257fff700 1 -- 172.21.15.78:0/876724159 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02480094b0 con 0x7f0258159340 2023-06-09T11:12:15.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be7616700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be006f2a0 0x7f6be0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be7616700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be0160940 0x7f6be0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be7616700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6be0164c00 0x7f6be015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.848+0000 7fd404a5a700 1 -- start start 2023-06-09T11:12:15.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd404a5a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4000b4a80 0x7fd4000cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd404a5a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd4000b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd404a5a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4000b4e50 0x7fd4000ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd404a5a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40006b1b0 con 0x7fd4000b4e50 2023-06-09T11:12:15.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd404a5a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000cca20 con 0x7fd4000b4a80 2023-06-09T11:12:15.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd404a5a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ccd00 con 0x7fd400159560 2023-06-09T11:12:15.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4000b4e50 0x7fd4000ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4000b4e50 0x7fd4000ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47716/0 (socket says 172.21.15.78:47716) 2023-06-09T11:12:15.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 -- 172.21.15.78:0/1839356109 learned_addr learned my addr 172.21.15.78:0/1839356109 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3fe59c700 1 --2- 172.21.15.78:0/1839356109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd4000b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be4bb1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be0160940 0x7f6be0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be4bb1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be0160940 0x7f6be0159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36968/0 (socket says 172.21.15.78:36968) 2023-06-09T11:12:15.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3fed9d700 1 --2- 172.21.15.78:0/1839356109 >> v2:172.21.15.187:3300/0 conn(0x7fd4000b4a80 0x7fd4000cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be5bb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6be0164c00 0x7f6be015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be5bb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6be0164c00 0x7f6be015a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47732/0 (socket says 172.21.15.78:47732) 2023-06-09T11:12:15.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f0257fff700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f02581f9590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f025000cc90 tx=0x7f025000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f02557fa700 1 -- 172.21.15.78:0/876724159 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250003e50 con 0x7f0258159340 2023-06-09T11:12:15.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f02557fa700 1 -- 172.21.15.78:0/876724159 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000a750 con 0x7f0258159340 2023-06-09T11:12:15.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f025eb2d700 1 -- 172.21.15.78:0/876724159 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025815c940 con 0x7f0258159340 2023-06-09T11:12:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f02557fa700 1 -- 172.21.15.78:0/876724159 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000ab00 con 0x7f0258159340 2023-06-09T11:12:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be53b2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be006f2a0 0x7f6be0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 -- 172.21.15.78:0/1839356109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 msgr2=0x7fd4000b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 --2- 172.21.15.78:0/1839356109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd4000b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 -- 172.21.15.78:0/1839356109 >> v2:172.21.15.187:3300/0 conn(0x7fd4000b4a80 msgr2=0x7fd4000cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 --2- 172.21.15.78:0/1839356109 >> v2:172.21.15.187:3300/0 conn(0x7fd4000b4a80 0x7fd4000cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 -- 172.21.15.78:0/1839356109 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000ccfe0 con 0x7fd4000b4e50 2023-06-09T11:12:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4abd7a700 1 -- start start 2023-06-09T11:12:15.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4abd7a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc49c0e6d20 0x7fc49c005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4abd7a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc49c0e70f0 0x7fc49c033f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4abd7a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c036630 0x7fc49c036a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4abd7a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c006eb0 con 0x7fc49c0e70f0 2023-06-09T11:12:15.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4abd7a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c036fb0 con 0x7fc49c0e6d20 2023-06-09T11:12:15.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4abd7a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c034440 con 0x7fc49c036630 2023-06-09T11:12:15.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3ff59e700 1 --2- 172.21.15.78:0/1839356109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4000ca130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd40006de10 tx=0x7fd3f000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55317b22f251df1a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4a9315700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc49c0e70f0 0x7fc49c033f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4a9315700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc49c0e70f0 0x7fc49c033f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47748/0 (socket says 172.21.15.78:47748) 2023-06-09T11:12:15.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4a9315700 1 -- 172.21.15.78:0/2574022274 learned_addr learned my addr 172.21.15.78:0/2574022274 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3fdd9b700 1 -- 172.21.15.78:0/1839356109 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000caa0 con 0x7fd4000b4e50 2023-06-09T11:12:15.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4aa317700 1 --2- 172.21.15.78:0/2574022274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c036630 0x7fc49c036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3fdd9b700 1 -- 172.21.15.78:0/1839356109 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f000cc00 con 0x7fd4000b4e50 2023-06-09T11:12:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be4bb1700 1 -- 172.21.15.78:0/1344226441 learned_addr learned my addr 172.21.15.78:0/1344226441 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0155310 con 0x7f6be0164c00 2023-06-09T11:12:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be015ce90 con 0x7f6be0160940 2023-06-09T11:12:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0163390 con 0x7f6be006f2a0 2023-06-09T11:12:15.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd3fdd9b700 1 -- 172.21.15.78:0/1839356109 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000f460 con 0x7fd4000b4e50 2023-06-09T11:12:15.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f025eb2d700 1 -- 172.21.15.78:0/876724159 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025815c660 con 0x7f0258159340 2023-06-09T11:12:15.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fd54b59e700 1 Processor -- start 2023-06-09T11:12:15.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fddfb40d700 1 Processor -- start 2023-06-09T11:12:15.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4aa317700 1 -- 172.21.15.78:0/2574022274 >> v2:172.21.15.187:3300/0 conn(0x7fc49c0e6d20 msgr2=0x7fc49c005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4aa317700 1 --2- 172.21.15.78:0/2574022274 >> v2:172.21.15.187:3300/0 conn(0x7fc49c0e6d20 0x7fc49c005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4aa317700 1 -- 172.21.15.78:0/2574022274 >> v2:172.21.15.78:3300/0 conn(0x7fc49c0e70f0 msgr2=0x7fc49c033f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4aa317700 1 --2- 172.21.15.78:0/2574022274 >> v2:172.21.15.78:3300/0 conn(0x7fc49c0e70f0 0x7fc49c033f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7fc4aa317700 1 -- 172.21.15.78:0/2574022274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c006610 con 0x7fc49c036630 2023-06-09T11:12:15.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be5bb3700 1 -- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be006f2a0 msgr2=0x7f6be0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be5bb3700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be006f2a0 0x7f6be0154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be5bb3700 1 -- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be0160940 msgr2=0x7f6be0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be5bb3700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be0160940 0x7f6be0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be5bb3700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8009a70 con 0x7f6be0164c00 2023-06-09T11:12:15.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f1c39501700 1 Processor -- start 2023-06-09T11:12:15.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54b59e700 1 -- start start 2023-06-09T11:12:15.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 -- 172.21.15.78:0/1839356109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 msgr2=0x7fd4000ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 --2- 172.21.15.78:0/1839356109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4000ca130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd40006de10 tx=0x7fd3f000bca0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.852+0000 7f025eb2d700 1 -- 172.21.15.78:0/876724159 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0258156570 con 0x7f0258159340 2023-06-09T11:12:15.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f1c39501700 1 -- start start 2023-06-09T11:12:15.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fc4aa317700 1 --2- 172.21.15.78:0/2574022274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c036630 0x7fc49c036a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4a404fba0 tx=0x7fc4a4066ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f78daa368d10e751 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fddfb40d700 1 -- start start 2023-06-09T11:12:15.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 -- 172.21.15.78:0/1839356109 shutdown_connections 2023-06-09T11:12:15.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 --2- 172.21.15.78:0/1839356109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4000ca130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 --2- 172.21.15.78:0/1839356109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd4000b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 --2- 172.21.15.78:0/1839356109 >> v2:172.21.15.187:3300/0 conn(0x7fd4000b4a80 0x7fd4000cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 -- 172.21.15.78:0/1839356109 >> 172.21.15.78:0/1839356109 conn(0x7fd400098e70 msgr2=0x7fd4000b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be5bb3700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6be0164c00 0x7f6be015a2e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8016000 tx=0x7f6bd8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f78474cf700 1 Processor -- start 2023-06-09T11:12:15.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 -- 172.21.15.78:0/1839356109 shutdown_connections 2023-06-09T11:12:15.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fc4a8b14700 1 -- 172.21.15.78:0/2574022274 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40671c0 con 0x7fc49c036630 2023-06-09T11:12:15.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fc4a8b14700 1 -- 172.21.15.78:0/2574022274 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a408d070 con 0x7fc49c036630 2023-06-09T11:12:15.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fc4a8b14700 1 -- 172.21.15.78:0/2574022274 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a406f350 con 0x7fc49c036630 2023-06-09T11:12:15.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd404a5a700 1 -- 172.21.15.78:0/1839356109 wait complete. 2023-06-09T11:12:15.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6bd5ffb700 1 -- 172.21.15.78:0/1344226441 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8025400 con 0x7f6be0164c00 2023-06-09T11:12:15.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6bd5ffb700 1 -- 172.21.15.78:0/1344226441 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd801f070 con 0x7f6be0164c00 2023-06-09T11:12:15.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6bd5ffb700 1 -- 172.21.15.78:0/1344226441 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80257c0 con 0x7f6be0164c00 2023-06-09T11:12:15.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be01650c0 con 0x7f6be0164c00 2023-06-09T11:12:15.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be00add50 con 0x7f6be0164c00 2023-06-09T11:12:15.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fc4abd7a700 1 -- 172.21.15.78:0/2574022274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c036630 msgr2=0x7fc49c036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fc4abd7a700 1 --2- 172.21.15.78:0/2574022274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c036630 0x7fc49c036a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4a404fba0 tx=0x7fc4a4066ca0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54b59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd54404f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54b59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5440512b0 0x7fd544036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54b59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd544053df0 con 0x7fd544036cb0 2023-06-09T11:12:15.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54b59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd544037150 con 0x7fd5440512b0 2023-06-09T11:12:15.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54b59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440486b0 con 0x7fd5440e6e60 2023-06-09T11:12:15.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54a59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd54404f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54a59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd54404f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45522/0 (socket says 172.21.15.78:45522) 2023-06-09T11:12:15.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd54a59c700 1 -- 172.21.15.78:0/2323135350 learned_addr learned my addr 172.21.15.78:0/2323135350 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fd549d9b700 1 --2- 172.21.15.78:0/2323135350 >> v2:172.21.15.78:3300/0 conn(0x7fd5440512b0 0x7fd544036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f78474cf700 1 -- start start 2023-06-09T11:12:15.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f78474cf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400b0c60 0x7f78400ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f78474cf700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f78400c9400 0x7f78400adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f02557fa700 1 -- 172.21.15.78:0/876724159 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f025000ac60 con 0x7f0258159340 2023-06-09T11:12:15.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f02557fa700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f02440662f0 0x7f02440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fddfb40d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0dee50 0x7fddec04f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7fddfb40d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddec04f880 0x7fddec04fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f78474cf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78400b1030 con 0x7f78400ae050 2023-06-09T11:12:15.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f78474cf700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78400ae4d0 con 0x7f78400c9400 2023-06-09T11:12:15.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.856+0000 7f78474cf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7840164870 con 0x7f78400b0c60 2023-06-09T11:12:15.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddfb40d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0064d0 con 0x7fddec006960 2023-06-09T11:12:15.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddfb40d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec050210 con 0x7fddec04f880 2023-06-09T11:12:15.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddfb40d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0df220 con 0x7fddec0dee50 2023-06-09T11:12:15.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7845a6c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f78400ae050 0x7f78400cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45726/0 (socket says 172.21.15.78:45726) 2023-06-09T11:12:15.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7845a6c700 1 -- 172.21.15.78:0/1920122957 learned_addr learned my addr 172.21.15.78:0/1920122957 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddec04f880 0x7fddec04fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fddec04f880 0x7fddec04fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47766/0 (socket says 172.21.15.78:47766) 2023-06-09T11:12:15.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 -- 172.21.15.78:0/3757934649 learned_addr learned my addr 172.21.15.78:0/3757934649 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddfa40b700 1 --2- 172.21.15.78:0/3757934649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0dee50 0x7fddec04f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7844a6a700 1 --2- 172.21.15.78:0/1920122957 >> v2:172.21.15.187:3300/0 conn(0x7f78400c9400 0x7f78400adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0005310 con 0x7f6be0164c00 2023-06-09T11:12:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f02557fa700 1 -- 172.21.15.78:0/876724159 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02500837e0 con 0x7f0258159340 2023-06-09T11:12:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f025c8c9700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f02440662f0 0x7f02440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fc4abd7a700 1 -- 172.21.15.78:0/2574022274 shutdown_connections 2023-06-09T11:12:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fc4abd7a700 1 --2- 172.21.15.78:0/2574022274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c036630 0x7fc49c036a70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fc4abd7a700 1 --2- 172.21.15.78:0/2574022274 >> v2:172.21.15.78:3300/0 conn(0x7fc49c0e70f0 0x7fc49c033f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fc4abd7a700 1 --2- 172.21.15.78:0/2574022274 >> v2:172.21.15.187:3300/0 conn(0x7fc49c0e6d20 0x7fc49c005f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fc4abd7a700 1 -- 172.21.15.78:0/2574022274 >> 172.21.15.78:0/2574022274 conn(0x7fc49c051630 msgr2=0x7fc49c051a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd54a59c700 1 -- 172.21.15.78:0/2323135350 >> v2:172.21.15.78:3300/0 conn(0x7fd5440512b0 msgr2=0x7fd544036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd54a59c700 1 --2- 172.21.15.78:0/2323135350 >> v2:172.21.15.78:3300/0 conn(0x7fd5440512b0 0x7fd544036770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd54a59c700 1 -- 172.21.15.78:0/2323135350 >> v1:172.21.15.78:6789/0 conn(0x7fd544036cb0 legacy=0x7fd5440060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd54a59c700 1 -- 172.21.15.78:0/2323135350 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544033a80 con 0x7fd5440e6e60 2023-06-09T11:12:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd54959a700 1 -- 172.21.15.78:0/2323135350 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717493669 0 0) 0x7fd544053df0 con 0x7fd544036cb0 2023-06-09T11:12:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f784526b700 1 --2- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400b0c60 0x7f78400ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fc4abd7a700 1 -- 172.21.15.78:0/2574022274 shutdown_connections 2023-06-09T11:12:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c39501700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c340707e0 0x7f1c341561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c32ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1c3406f880 0x7f1c340700d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37840/0 (socket says 172.21.15.78:37840) 2023-06-09T11:12:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c32ffd700 1 -- 172.21.15.78:0/668505899 learned_addr learned my addr 172.21.15.78:0/668505899 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c39501700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c341566e0 con 0x7f1c3406f880 2023-06-09T11:12:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c39501700 1 -- 172.21.15.78:0/668505899 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c34159c50 con 0x7f1c3415ce60 2023-06-09T11:12:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c39501700 1 -- 172.21.15.78:0/668505899 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c34159970 con 0x7f1c340707e0 2023-06-09T11:12:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd54a59c700 1 --2- 172.21.15.78:0/2323135350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd54404f340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0659f0 tx=0x7fd54c061ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e3c7f9232c53884 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c2a7fc700 1 --2- 172.21.15.78:0/668505899 >> v2:172.21.15.78:3300/0 conn(0x7f1c340707e0 0x7f1c341561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 -- 172.21.15.78:0/3757934649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0dee50 msgr2=0x7fddec04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 --2- 172.21.15.78:0/3757934649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0dee50 0x7fddec04f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 -- 172.21.15.78:0/3757934649 >> v1:172.21.15.78:6789/0 conn(0x7fddec006960 legacy=0x7fddec006de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fc4abd7a700 1 -- 172.21.15.78:0/2574022274 wait complete. 2023-06-09T11:12:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7837fff700 1 -- 172.21.15.78:0/1920122957 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889073551 0 0) 0x7f78400b1030 con 0x7f78400ae050 2023-06-09T11:12:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7844a6a700 1 -- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400b0c60 msgr2=0x7f78400ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7844a6a700 1 --2- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400b0c60 0x7f78400ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7844a6a700 1 -- 172.21.15.78:0/1920122957 >> v1:172.21.15.187:6789/0 conn(0x7f78400ae050 legacy=0x7f78400cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7844a6a700 1 -- 172.21.15.78:0/1920122957 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840164b00 con 0x7f78400c9400 2023-06-09T11:12:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 -- 172.21.15.78:0/3757934649 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0340b0 con 0x7fddec04f880 2023-06-09T11:12:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f025c8c9700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f02440662f0 0x7f02440687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f024c006fd0 tx=0x7f024c00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd404a5a700 1 Processor -- start 2023-06-09T11:12:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd404a5a700 1 -- start start 2023-06-09T11:12:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7844a6a700 1 --2- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400c9400 0x7f78400adb10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7830009850 tx=0x7f7830009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf5464817dd62361 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9c0a700 1 --2- 172.21.15.78:0/3757934649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec04f880 0x7fddec04fcd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdde4006fd0 tx=0x7fdde400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b7d269a5d19174 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c2a7fc700 1 -- 172.21.15.78:0/668505899 >> v1:172.21.15.187:6789/0 conn(0x7f1c3415ce60 legacy=0x7f1c34158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c2a7fc700 1 -- 172.21.15.78:0/668505899 >> v1:172.21.15.78:6789/0 conn(0x7f1c3406f880 legacy=0x7f1c340700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c2a7fc700 1 -- 172.21.15.78:0/668505899 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3415c380 con 0x7f1c340707e0 2023-06-09T11:12:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f1c2a7fc700 1 --2- 172.21.15.78:0/668505899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341561a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009850 tx=0x7f1c24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cd1a55cfc4f857 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7837fff700 1 -- 172.21.15.78:0/1920122957 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830011830 con 0x7f78400c9400 2023-06-09T11:12:15.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7837fff700 1 -- 172.21.15.78:0/1920122957 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7830011990 con 0x7f78400c9400 2023-06-09T11:12:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f7837fff700 1 -- 172.21.15.78:0/1920122957 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830011d40 con 0x7f78400c9400 2023-06-09T11:12:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f6bd5ffb700 1 -- 172.21.15.78:0/1344226441 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bd802d3f0 con 0x7f6be0164c00 2023-06-09T11:12:15.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9409700 1 -- 172.21.15.78:0/3757934649 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400dbe0 con 0x7fddec04f880 2023-06-09T11:12:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9409700 1 -- 172.21.15.78:0/3757934649 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde400dd40 con 0x7fddec04f880 2023-06-09T11:12:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddf9409700 1 -- 172.21.15.78:0/3757934649 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4017660 con 0x7fddec04f880 2023-06-09T11:12:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddfb40d700 1 -- 172.21.15.78:0/3757934649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec04f880 msgr2=0x7fddec04fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fddfb40d700 1 --2- 172.21.15.78:0/3757934649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec04f880 0x7fddec04fcd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdde4006fd0 tx=0x7fdde400bea0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f78474cf700 1 -- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400c9400 msgr2=0x7f78400adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f78474cf700 1 --2- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400c9400 0x7f78400adb10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7830009850 tx=0x7f7830009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f6bd5ffb700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6bc4066340 0x7f6bc40687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7f6bd5ffb700 1 -- 172.21.15.78:0/1344226441 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bd8084db0 con 0x7f6be0164c00 2023-06-09T11:12:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 -- 172.21.15.78:0/3757934649 shutdown_connections 2023-06-09T11:12:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 --2- 172.21.15.78:0/3757934649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec04f880 0x7fddec04fcd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 --2- 172.21.15.78:0/3757934649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0dee50 0x7fddec04f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 -- 172.21.15.78:0/3757934649 >> 172.21.15.78:0/3757934649 conn(0x7fddec051770 msgr2=0x7fddec051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 Processor -- start 2023-06-09T11:12:15.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 -- 172.21.15.78:0/3757934649 shutdown_connections 2023-06-09T11:12:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 -- 172.21.15.78:0/1920122957 shutdown_connections 2023-06-09T11:12:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 --2- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400c9400 0x7f78400adb10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 --2- 172.21.15.78:0/1920122957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400b0c60 0x7f78400ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 -- 172.21.15.78:0/1920122957 >> 172.21.15.78:0/1920122957 conn(0x7f78400ce9d0 msgr2=0x7f78400ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd404a5a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b4a80 0x7fd4000c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.860+0000 7fd404a5a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4001ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd404a5a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd40014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd404a5a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4001ee5a0 con 0x7fd4000b4e50 2023-06-09T11:12:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd404a5a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000adc70 con 0x7fd4000b4a80 2023-06-09T11:12:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd404a5a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000adf50 con 0x7fd400159560 2023-06-09T11:12:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3fe59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4001ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3fe59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4001ee060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47776/0 (socket says 172.21.15.78:47776) 2023-06-09T11:12:15.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3fe59c700 1 -- 172.21.15.78:0/3852313250 learned_addr learned my addr 172.21.15.78:0/3852313250 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3ff59e700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd40014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 -- start start 2023-06-09T11:12:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3fed9d700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b4a80 0x7fd4000c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 -- 172.21.15.78:0/1920122957 shutdown_connections 2023-06-09T11:12:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 -- 172.21.15.78:0/1920122957 wait complete. 2023-06-09T11:12:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 -- 172.21.15.78:0/3757934649 wait complete. 2023-06-09T11:12:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f6be53b2700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6bc4066340 0x7f6bc40687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3ff59e700 1 -- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b4a80 msgr2=0x7fd4000c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3ff59e700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b4a80 0x7fd4000c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3ff59e700 1 -- 172.21.15.78:0/3852313250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 msgr2=0x7fd4001ee060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3ff59e700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4001ee060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3ff59e700 1 -- 172.21.15.78:0/3852313250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f000b620 con 0x7fd400159560 2023-06-09T11:12:15.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3ff59e700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd40014aec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0016000 tx=0x7fd3f0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f6be53b2700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6bc4066340 0x7f6bc40687f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0005930 tx=0x7f6bd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc49c036630 0x7fc49c039880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c0e6d20 0x7fc49c04a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0e70f0 0x7fc49c0d5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0d6080 con 0x7fc49c0e70f0 2023-06-09T11:12:15.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4aa317700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0e70f0 0x7fc49c0d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4a9315700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c0e6d20 0x7fc49c04a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4a9315700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c0e6d20 0x7fc49c04a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45554/0 (socket says 172.21.15.78:45554) 2023-06-09T11:12:15.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c04a6b0 con 0x7fc49c036630 2023-06-09T11:12:15.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4a9315700 1 -- 172.21.15.78:0/272534752 learned_addr learned my addr 172.21.15.78:0/272534752 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4abd7a700 1 -- 172.21.15.78:0/272534752 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0d5e40 con 0x7fc49c0e6d20 2023-06-09T11:12:15.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4a9b16700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc49c036630 0x7fc49c039880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 Processor -- start 2023-06-09T11:12:15.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fddfb40d700 1 -- start start 2023-06-09T11:12:15.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4aa317700 1 -- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c0e6d20 msgr2=0x7fc49c04a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4aa317700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c0e6d20 0x7fc49c04a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4aa317700 1 -- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc49c036630 msgr2=0x7fc49c039880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4aa317700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc49c036630 0x7fc49c039880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4aa317700 1 -- 172.21.15.78:0/272534752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c006bd0 con 0x7fc49c0e70f0 2023-06-09T11:12:15.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4a9b16700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc49c036630 0x7fc49c039880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:15.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 Processor -- start 2023-06-09T11:12:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3e77fe700 1 -- 172.21.15.78:0/3852313250 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f001c070 con 0x7fd400159560 2023-06-09T11:12:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3e77fe700 1 -- 172.21.15.78:0/3852313250 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00036c0 con 0x7fd400159560 2023-06-09T11:12:15.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd3e77fe700 1 -- 172.21.15.78:0/3852313250 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0003a50 con 0x7fd400159560 2023-06-09T11:12:15.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fc4aa317700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0e70f0 0x7fc49c0d5900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4a404f090 tx=0x7fc4a404eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd54959a700 1 -- 172.21.15.78:0/2323135350 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c06f410 con 0x7fd5440e6e60 2023-06-09T11:12:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd54959a700 1 -- 172.21.15.78:0/2323135350 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c08d070 con 0x7fd5440e6e60 2023-06-09T11:12:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd54959a700 1 -- 172.21.15.78:0/2323135350 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c06f570 con 0x7fd5440e6e60 2023-06-09T11:12:15.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4000ca670 con 0x7fd400159560 2023-06-09T11:12:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f02557fa700 1 -- 172.21.15.78:0/876724159 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0250050cf0 con 0x7f0258159340 2023-06-09T11:12:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec006960 0x7fddec0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec04f880 0x7fddec177d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0dee50 0x7fddec0e1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec04dbf0 con 0x7fddec0dee50 2023-06-09T11:12:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0cd6c0 con 0x7fddec04f880 2023-06-09T11:12:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec04cf70 con 0x7fddec006960 2023-06-09T11:12:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 -- 172.21.15.78:0/2323135350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 msgr2=0x7fd54404f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 --2- 172.21.15.78:0/2323135350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd54404f340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0659f0 tx=0x7fd54c061ae0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 -- 172.21.15.78:0/2323135350 shutdown_connections 2023-06-09T11:12:15.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 --2- 172.21.15.78:0/2323135350 >> v2:172.21.15.78:3300/0 conn(0x7fd5440512b0 0x7fd544036770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 --2- 172.21.15.78:0/2323135350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd54404f340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 -- 172.21.15.78:0/2323135350 >> 172.21.15.78:0/2323135350 conn(0x7fd544051770 msgr2=0x7fd544051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.864+0000 7f78474cf700 1 -- start start 2023-06-09T11:12:15.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f78474cf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400ae050 0x7f78400c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4000cd2c0 con 0x7fd400159560 2023-06-09T11:12:15.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddf9c0a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec04f880 0x7fddec177d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddf9c0a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec04f880 0x7fddec177d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37012/0 (socket says 172.21.15.78:37012) 2023-06-09T11:12:15.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddf9c0a700 1 -- 172.21.15.78:0/1856410465 learned_addr learned my addr 172.21.15.78:0/1856410465 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfa40b700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec006960 0x7fddec0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 -- 172.21.15.78:0/2323135350 shutdown_connections 2023-06-09T11:12:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f78474cf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400b0c60 0x7f784014fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd54b59e700 1 -- 172.21.15.78:0/2323135350 wait complete. 2023-06-09T11:12:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfac0c700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0dee50 0x7fddec0e1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4000b52b0 con 0x7fd400159560 2023-06-09T11:12:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f78474cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78400c9400 0x7f78400c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f784526b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400ae050 0x7f78400c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f784526b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400ae050 0x7f78400c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45572/0 (socket says 172.21.15.78:45572) 2023-06-09T11:12:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfa40b700 1 -- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec04f880 msgr2=0x7fddec177d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfa40b700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec04f880 0x7fddec177d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfa40b700 1 -- 172.21.15.78:0/1856410465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0dee50 msgr2=0x7fddec0e1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfa40b700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0dee50 0x7fddec0e1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfa40b700 1 -- 172.21.15.78:0/1856410465 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde400b820 con 0x7fddec006960 2023-06-09T11:12:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400b0c60 0x7f784014fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400b0c60 0x7f784014fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37028/0 (socket says 172.21.15.78:37028) 2023-06-09T11:12:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f784526b700 1 -- 172.21.15.78:0/2671437662 learned_addr learned my addr 172.21.15.78:0/2671437662 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400c79b0 con 0x7f78400c9400 2023-06-09T11:12:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7840153500 con 0x7f78400b0c60 2023-06-09T11:12:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7840153220 con 0x7f78400ae050 2023-06-09T11:12:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfa40b700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec006960 0x7fddec0cd180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fddf000e8a0 tx=0x7fddf000ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddeaffd700 1 -- 172.21.15.78:0/1856410465 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0013680 con 0x7fddec006960 2023-06-09T11:12:15.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 -- 172.21.15.78:0/1856410465 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec054770 con 0x7fddec006960 2023-06-09T11:12:15.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddfb40d700 1 -- 172.21.15.78:0/1856410465 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec054490 con 0x7fddec006960 2023-06-09T11:12:15.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7845a6c700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78400c9400 0x7f78400c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddeaffd700 1 -- 172.21.15.78:0/1856410465 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0013800 con 0x7fddec006960 2023-06-09T11:12:15.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fddeaffd700 1 -- 172.21.15.78:0/1856410465 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0013bb0 con 0x7fddec006960 2023-06-09T11:12:15.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7fd3e77fe700 1 -- 172.21.15.78:0/3852313250 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3f0003bb0 con 0x7fd400159560 2023-06-09T11:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 -- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400ae050 msgr2=0x7f78400c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400ae050 0x7f78400c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 -- 172.21.15.78:0/2671437662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78400c9400 msgr2=0x7f78400c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78400c9400 0x7f78400c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300094b0 con 0x7f78400b0c60 2023-06-09T11:12:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.868+0000 7f7844a6a700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400b0c60 0x7f784014fbc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7830016000 tx=0x7f7830004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f7835ffb700 1 -- 172.21.15.78:0/2671437662 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783001a990 con 0x7f78400b0c60 2023-06-09T11:12:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f7835ffb700 1 -- 172.21.15.78:0/2671437662 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783001f070 con 0x7f78400b0c60 2023-06-09T11:12:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f7835ffb700 1 -- 172.21.15.78:0/2671437662 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783001ad30 con 0x7f78400b0c60 2023-06-09T11:12:15.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 Processor -- start 2023-06-09T11:12:15.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78401650c0 con 0x7f78400b0c60 2023-06-09T11:12:15.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7840164de0 con 0x7f78400b0c60 2023-06-09T11:12:15.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd3e77fe700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd3e77fe700 1 -- 172.21.15.78:0/3852313250 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3f0084e70 con 0x7fd400159560 2023-06-09T11:12:15.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd3fed9d700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fddfb40d700 1 -- 172.21.15.78:0/1856410465 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc005310 con 0x7fddec006960 2023-06-09T11:12:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f6bd5ffb700 1 -- 172.21.15.78:0/1344226441 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6bd80523a0 con 0x7f6be0164c00 2023-06-09T11:12:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 -- start start 2023-06-09T11:12:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fc49a7fc700 1 -- 172.21.15.78:0/272534752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4070c00 con 0x7fc49c0e70f0 2023-06-09T11:12:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fc49a7fc700 1 -- 172.21.15.78:0/272534752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4070d60 con 0x7fc49c0e70f0 2023-06-09T11:12:15.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fc49a7fc700 1 -- 172.21.15.78:0/272534752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4072270 con 0x7fc49c0e70f0 2023-06-09T11:12:15.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f1c327fc700 1 -- 172.21.15.78:0/668505899 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24004230 con 0x7f1c340707e0 2023-06-09T11:12:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7820005310 con 0x7f78400b0c60 2023-06-09T11:12:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544036cb0 0x7fd54404a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440512b0 0x7fd5440e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd544185470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544184cb0 con 0x7fd544036cb0 2023-06-09T11:12:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440e2c10 con 0x7fd5440512b0 2023-06-09T11:12:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54b59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5440e2ef0 con 0x7fd5440e6e60 2023-06-09T11:12:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544036cb0 0x7fd54404a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544036cb0 0x7fd54404a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47802/0 (socket says 172.21.15.78:47802) 2023-06-09T11:12:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 -- 172.21.15.78:0/179031557 learned_addr learned my addr 172.21.15.78:0/179031557 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f1c327fc700 1 -- 172.21.15.78:0/668505899 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24004390 con 0x7f1c340707e0 2023-06-09T11:12:15.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f1c327fc700 1 -- 172.21.15.78:0/668505899 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240036c0 con 0x7f1c340707e0 2023-06-09T11:12:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f1c39501700 1 -- 172.21.15.78:0/668505899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 msgr2=0x7f1c341561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f1c39501700 1 --2- 172.21.15.78:0/668505899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341561a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009850 tx=0x7f1c24009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fddeaffd700 1 -- 172.21.15.78:0/1856410465 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fddf0013d10 con 0x7fddec006960 2023-06-09T11:12:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fddeaffd700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fddd80662f0 0x7fddd80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fddeaffd700 1 -- 172.21.15.78:0/1856410465 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddf0083700 con 0x7fddec006960 2023-06-09T11:12:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7f1c39501700 1 -- 172.21.15.78:0/668505899 shutdown_connections 2023-06-09T11:12:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f1c39501700 1 --2- 172.21.15.78:0/668505899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341561a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f1c39501700 1 -- 172.21.15.78:0/668505899 >> 172.21.15.78:0/668505899 conn(0x7f1c340cb460 msgr2=0x7f1c340cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 -- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 msgr2=0x7fd544185470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T11:12:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd544185470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 -- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440512b0 msgr2=0x7fd5440e23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:15.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440512b0 0x7fd5440e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:15.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fd54a59c700 1 -- 172.21.15.78:0/179031557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c066b50 con 0x7fd544036cb0 2023-06-09T11:12:15.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.872+0000 7fddf9c0a700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fddd80662f0 0x7fddd80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:15.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f1c39501700 1 -- 172.21.15.78:0/668505899 shutdown_connections 2023-06-09T11:12:15.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd54a59c700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544036cb0 0x7fd54404a9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd54c067c20 tx=0x7fd54c068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f7835ffb700 1 -- 172.21.15.78:0/2671437662 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f783002e450 con 0x7f78400b0c60 2023-06-09T11:12:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f7835ffb700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7824066340 0x7f78240687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f7835ffb700 1 -- 172.21.15.78:0/2671437662 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7830084e70 con 0x7f78400b0c60 2023-06-09T11:12:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd3fed9d700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009b50 tx=0x7fd3f4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd53affd700 1 -- 172.21.15.78:0/179031557 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c067100 con 0x7fd544036cb0 2023-06-09T11:12:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd53affd700 1 -- 172.21.15.78:0/179031557 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c067260 con 0x7fd544036cb0 2023-06-09T11:12:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd53affd700 1 -- 172.21.15.78:0/179031557 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c072070 con 0x7fd544036cb0 2023-06-09T11:12:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd544034040 con 0x7fd544036cb0 2023-06-09T11:12:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd3e77fe700 1 -- 172.21.15.78:0/3852313250 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd3f0052430 con 0x7fd400159560 2023-06-09T11:12:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f1c39501700 1 -- 172.21.15.78:0/668505899 wait complete. 2023-06-09T11:12:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f1c39501700 1 Processor -- start 2023-06-09T11:12:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fddf9c0a700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fddd80662f0 0x7fddd80687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddec0cd9b0 tx=0x7fdde4014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544033d60 con 0x7fd544036cb0 2023-06-09T11:12:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.876+0000 7f1c39501700 1 -- start start 2023-06-09T11:12:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.880+0000 7f1c39501700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c3406f880 0x7f1c3415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:15.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.880+0000 7fc4abd7a700 1 -- 172.21.15.78:0/272534752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c0068f0 con 0x7fc49c0e70f0 2023-06-09T11:12:16.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.880+0000 7fc4abd7a700 1 -- 172.21.15.78:0/272534752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c052a50 con 0x7fc49c0e70f0 2023-06-09T11:12:16.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.880+0000 7fd53affd700 1 -- 172.21.15.78:0/179031557 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd54c0721d0 con 0x7fd544036cb0 2023-06-09T11:12:16.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.880+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd544034320 con 0x7fd544036cb0 2023-06-09T11:12:16.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.880+0000 7f1c39501700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc480005310 con 0x7fc49c0e70f0 2023-06-09T11:12:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c3406f880 0x7f1c3415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c3406f880 0x7f1c3415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45598/0 (socket says 172.21.15.78:45598) 2023-06-09T11:12:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c2a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c39501700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c3415ce60 0x7f1c3415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c2a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47808/0 (socket says 172.21.15.78:47808) 2023-06-09T11:12:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.880+0000 7fd53affd700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd52c066340 0x7fd52c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fd53affd700 1 -- 172.21.15.78:0/179031557 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd54c0fe520 con 0x7fd544036cb0 2023-06-09T11:12:16.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c39501700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3415bfd0 con 0x7f1c340707e0 2023-06-09T11:12:16.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c39501700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3415aee0 con 0x7f1c3415ce60 2023-06-09T11:12:16.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c39501700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3415bcf0 con 0x7f1c3406f880 2023-06-09T11:12:16.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c2a7fc700 1 -- 172.21.15.78:0/1866368398 learned_addr learned my addr 172.21.15.78:0/1866368398 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:16.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fd549d9b700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd52c066340 0x7fd52c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:16.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fc49a7fc700 1 -- 172.21.15.78:0/272534752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4a40723d0 con 0x7fc49c0e70f0 2023-06-09T11:12:16.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c337fe700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c3415ce60 0x7f1c3415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:16.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fddeaffd700 1 -- 172.21.15.78:0/1856410465 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fddf0054620 con 0x7fddec006960 2023-06-09T11:12:16.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fc49a7fc700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc4880663c0 0x7fc488068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:16.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fc49a7fc700 1 -- 172.21.15.78:0/272534752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4a40fe410 con 0x7fc49c0e70f0 2023-06-09T11:12:16.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 -- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c3415ce60 msgr2=0x7f1c3415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c3415ce60 0x7f1c3415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 -- 172.21.15.78:0/1866368398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 msgr2=0x7f1c341fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 -- 172.21.15.78:0/1866368398 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240094b0 con 0x7f1c3406f880 2023-06-09T11:12:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c32ffd700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c3406f880 0x7f1c3415a9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c000f60 tx=0x7f1c1c00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c2bfff700 1 -- 172.21.15.78:0/1866368398 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c005b60 con 0x7f1c3406f880 2023-06-09T11:12:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c2bfff700 1 -- 172.21.15.78:0/1866368398 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c005cc0 con 0x7f1c3406f880 2023-06-09T11:12:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f1c2bfff700 1 -- 172.21.15.78:0/1866368398 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0072d0 con 0x7f1c3406f880 2023-06-09T11:12:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f7835ffb700 1 -- 172.21.15.78:0/2671437662 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7830052360 con 0x7f78400b0c60 2023-06-09T11:12:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f784526b700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7824066340 0x7f78240687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7f784526b700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7824066340 0x7f78240687f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f783c009c10 tx=0x7f783c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.884+0000 7fd549d9b700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd52c066340 0x7fd52c0687f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd53c006b40 tx=0x7fd53c006ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.888+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3415c940 con 0x7f1c3406f880 2023-06-09T11:12:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.888+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3415c660 con 0x7f1c3406f880 2023-06-09T11:12:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.888+0000 7fc4a9b16700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc4880663c0 0x7fc488068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.888+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c34159340 con 0x7f1c3406f880 2023-06-09T11:12:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.888+0000 7fc4a9b16700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc4880663c0 0x7fc488068870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc49c033b10 tx=0x7fc494008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.892+0000 7fd53affd700 1 -- 172.21.15.78:0/179031557 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd54c103060 con 0x7fd544036cb0 2023-06-09T11:12:16.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.892+0000 7f1c2bfff700 1 -- 172.21.15.78:0/1866368398 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c1c007640 con 0x7f1c3406f880 2023-06-09T11:12:16.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.892+0000 7f1c2bfff700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1c140663c0 0x7f1c14068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:16.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.892+0000 7f1c2bfff700 1 -- 172.21.15.78:0/1866368398 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c1c083120 con 0x7f1c3406f880 2023-06-09T11:12:16.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.892+0000 7f1c2a7fc700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1c140663c0 0x7f1c14068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:16.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.892+0000 7f1c2a7fc700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1c140663c0 0x7f1c14068870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009ba0 tx=0x7f1c2401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:16.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.896+0000 7f1c2bfff700 1 -- 172.21.15.78:0/1866368398 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1c1c050630 con 0x7f1c3406f880 2023-06-09T11:12:16.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:15.904+0000 7fc49a7fc700 1 -- 172.21.15.78:0/272534752 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc4a40cb900 con 0x7fc49c0e70f0 2023-06-09T11:12:16.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.188+0000 7f025eb2d700 1 -- 172.21.15.78:0/876724159 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f02580741c0 con 0x7f0258159340 2023-06-09T11:12:16.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.188+0000 7f02557fa700 1 -- 172.21.15.78:0/876724159 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0250054310 con 0x7f0258159340 2023-06-09T11:12:16.198 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-06-09T11:12:16.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 -- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f02440662f0 msgr2=0x7f02440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f02440662f0 0x7f02440687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f024c006fd0 tx=0x7f024c00d040 comp rx=0 tx=0).stop 2023-06-09T11:12:16.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 -- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 msgr2=0x7f02581f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f02581f9590 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f025000cc90 tx=0x7f025000a060 comp rx=0 tx=0).stop 2023-06-09T11:12:16.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 -- 172.21.15.78:0/876724159 shutdown_connections 2023-06-09T11:12:16.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f02440662f0 0x7f02440687a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f025815ce60 0x7f02580ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0258159340 0x7f02581f9590 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 --2- 172.21.15.78:0/876724159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02581561a0 0x7f02581f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 -- 172.21.15.78:0/876724159 >> 172.21.15.78:0/876724159 conn(0x7f02580cb460 msgr2=0x7f02580ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 -- 172.21.15.78:0/876724159 shutdown_connections 2023-06-09T11:12:16.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f023effd700 1 -- 172.21.15.78:0/876724159 wait complete. 2023-06-09T11:12:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bc0005890 con 0x7f6be0164c00 2023-06-09T11:12:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.192+0000 7f6bd5ffb700 1 -- 172.21.15.78:0/1344226441 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bd8021020 con 0x7f6be0164c00 2023-06-09T11:12:16.202 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:16.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd544185190 con 0x7fd544036cb0 2023-06-09T11:12:16.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7fd53affd700 1 -- 172.21.15.78:0/179031557 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd544185190 con 0x7fd544036cb0 2023-06-09T11:12:16.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6bc4066340 msgr2=0x7f6bc40687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6bc4066340 0x7f6bc40687f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0005930 tx=0x7f6bd0009040 comp rx=0 tx=0).stop 2023-06-09T11:12:16.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6be0164c00 msgr2=0x7f6be015a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6be0164c00 0x7f6be015a2e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8016000 tx=0x7f6bd8004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.205 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-06-09T11:12:16.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 shutdown_connections 2023-06-09T11:12:16.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6bc4066340 0x7f6bc40687f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6be0164c00 0x7f6be015a2e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be0160940 0x7f6be0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 --2- 172.21.15.78:0/1344226441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be006f2a0 0x7f6be0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 >> 172.21.15.78:0/1344226441 conn(0x7f6be00cf670 msgr2=0x7f6be00c3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 shutdown_connections 2023-06-09T11:12:16.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.196+0000 7f6be7616700 1 -- 172.21.15.78:0/1344226441 wait complete. 2023-06-09T11:12:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd400066f00 con 0x7fd400159560 2023-06-09T11:12:16.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd3e77fe700 1 -- 172.21.15.78:0/3852313250 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3f0003e60 con 0x7fd400159560 2023-06-09T11:12:16.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd52c066340 msgr2=0x7fd52c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.209 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-09T11:12:16.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd52c066340 0x7fd52c0687f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd53c006b40 tx=0x7fd53c006ad0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544036cb0 msgr2=0x7fd54404a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544036cb0 0x7fd54404a9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd54c067c20 tx=0x7fd54c068e80 comp rx=0 tx=0).stop 2023-06-09T11:12:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 shutdown_connections 2023-06-09T11:12:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd52c066340 0x7fd52c0687f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5440e6e60 0x7fd544185470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440512b0 0x7fd5440e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 --2- 172.21.15.78:0/179031557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd544036cb0 0x7fd54404a9a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 >> 172.21.15.78:0/179031557 conn(0x7fd544051770 msgr2=0x7fd5440477d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 shutdown_connections 2023-06-09T11:12:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.200+0000 7fd54b59e700 1 -- 172.21.15.78:0/179031557 wait complete. 2023-06-09T11:12:16.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7820005890 con 0x7f78400b0c60 2023-06-09T11:12:16.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3ec0662f0 msgr2=0x7fd3ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009b50 tx=0x7fd3f4009240 comp rx=0 tx=0).stop 2023-06-09T11:12:16.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7f7835ffb700 1 -- 172.21.15.78:0/2671437662 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7830015020 con 0x7f78400b0c60 2023-06-09T11:12:16.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 msgr2=0x7fd40014aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd40014aec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0016000 tx=0x7fd3f0004770 comp rx=0 tx=0).stop 2023-06-09T11:12:16.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 shutdown_connections 2023-06-09T11:12:16.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3ec0662f0 0x7fd3ec0687a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.215 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:16.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd400159560 0x7fd40014aec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000b4e50 0x7fd4001ee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 --2- 172.21.15.78:0/3852313250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b4a80 0x7fd4000c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 >> 172.21.15.78:0/3852313250 conn(0x7fd400098e70 msgr2=0x7fd400157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 shutdown_connections 2023-06-09T11:12:16.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.204+0000 7fd404a5a700 1 -- 172.21.15.78:0/3852313250 wait complete. 2023-06-09T11:12:16.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7fddfb40d700 1 -- 172.21.15.78:0/1856410465 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdddc005890 con 0x7fddec006960 2023-06-09T11:12:16.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7824066340 msgr2=0x7f78240687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7824066340 0x7f78240687f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f783c009c10 tx=0x7f783c009240 comp rx=0 tx=0).stop 2023-06-09T11:12:16.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400b0c60 msgr2=0x7f784014fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400b0c60 0x7f784014fbc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7830016000 tx=0x7f7830004770 comp rx=0 tx=0).stop 2023-06-09T11:12:16.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 shutdown_connections 2023-06-09T11:12:16.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7824066340 0x7f78240687f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78400c9400 0x7f78400c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78400b0c60 0x7f784014fbc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 --2- 172.21.15.78:0/2671437662 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78400ae050 0x7f78400c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 >> 172.21.15.78:0/2671437662 conn(0x7f78400ce9d0 msgr2=0x7f784006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 shutdown_connections 2023-06-09T11:12:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.208+0000 7f78474cf700 1 -- 172.21.15.78:0/2671437662 wait complete. 2023-06-09T11:12:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.212+0000 7fddeaffd700 1 -- 172.21.15.78:0/1856410465 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddf00541b0 con 0x7fddec006960 2023-06-09T11:12:16.221 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-09T11:12:16.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-06-09T11:12:16.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 -- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fddd80662f0 msgr2=0x7fddd80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fddd80662f0 0x7fddd80687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddec0cd9b0 tx=0x7fdde4014000 comp rx=0 tx=0).stop 2023-06-09T11:12:16.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 -- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec006960 msgr2=0x7fddec0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec006960 0x7fddec0cd180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fddf000e8a0 tx=0x7fddf000ebb0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 -- 172.21.15.78:0/1856410465 shutdown_connections 2023-06-09T11:12:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fddd80662f0 0x7fddd80687a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddec0dee50 0x7fddec0e1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec04f880 0x7fddec177d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 --2- 172.21.15.78:0/1856410465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec006960 0x7fddec0cd180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 -- 172.21.15.78:0/1856410465 >> 172.21.15.78:0/1856410465 conn(0x7fddec051770 msgr2=0x7fddec0db2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 -- 172.21.15.78:0/1856410465 shutdown_connections 2023-06-09T11:12:16.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7fdde8ff9700 1 -- 172.21.15.78:0/1856410465 wait complete. 2023-06-09T11:12:16.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1c340741c0 con 0x7f1c3406f880 2023-06-09T11:12:16.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.216+0000 7f1c2bfff700 1 -- 172.21.15.78:0/1866368398 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c1c053c50 con 0x7f1c3406f880 2023-06-09T11:12:16.227 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:16.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.220+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1c140663c0 msgr2=0x7f1c14068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.220+0000 7f1c39501700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1c140663c0 0x7f1c14068870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009ba0 tx=0x7f1c2401c040 comp rx=0 tx=0).stop 2023-06-09T11:12:16.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.220+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c3406f880 msgr2=0x7f1c3415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.220+0000 7f1c39501700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c3406f880 0x7f1c3415a9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c000f60 tx=0x7f1c1c00c6e0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 shutdown_connections 2023-06-09T11:12:16.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1c140663c0 0x7f1c14068870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c3415ce60 0x7f1c3415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c340707e0 0x7f1c341fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 --2- 172.21.15.78:0/1866368398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c3406f880 0x7f1c3415a9a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 >> 172.21.15.78:0/1866368398 conn(0x7f1c340cb460 msgr2=0x7f1c340c4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc4800055c0 con 0x7fc49c0e70f0 2023-06-09T11:12:16.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 shutdown_connections 2023-06-09T11:12:16.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7fc49a7fc700 1 -- 172.21.15.78:0/272534752 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4a40cef20 con 0x7fc49c0e70f0 2023-06-09T11:12:16.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.224+0000 7f1c39501700 1 -- 172.21.15.78:0/1866368398 wait complete. 2023-06-09T11:12:16.234 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-09T11:12:16.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-06-09T11:12:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc4880663c0 msgr2=0x7fc488068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc4880663c0 0x7fc488068870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc49c033b10 tx=0x7fc494008040 comp rx=0 tx=0).stop 2023-06-09T11:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0e70f0 msgr2=0x7fc49c0d5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0e70f0 0x7fc49c0d5900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4a404f090 tx=0x7fc4a404eca0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 shutdown_connections 2023-06-09T11:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc4880663c0 0x7fc488068870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0e70f0 0x7fc49c0d5900 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc49c0e6d20 0x7fc49c04a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 --2- 172.21.15.78:0/272534752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc49c036630 0x7fc49c039880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 >> 172.21.15.78:0/272534752 conn(0x7fc49c051630 msgr2=0x7fc49c004c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:16.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 shutdown_connections 2023-06-09T11:12:16.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:16.228+0000 7fc487fff700 1 -- 172.21.15.78:0/272534752 wait complete. 2023-06-09T11:12:16.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-06-09T11:12:16.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-06-09T11:12:16.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-06-09T11:12:16.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-06-09T11:12:16.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-06-09T11:12:16.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-06-09T11:12:17.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T11:12:17.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T11:12:17.239 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T11:12:17.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T11:12:17.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T11:12:17.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T11:12:17.253 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T11:12:17.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T11:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.436+0000 7f3682282700 1 Processor -- start 2023-06-09T11:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.436+0000 7f3682282700 1 -- start start 2023-06-09T11:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.436+0000 7f3682282700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f367c1561a0 0x7f367c0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.436+0000 7f3682282700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f367c15ce60 0x7f367c070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.436+0000 7f3682282700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c159c50 con 0x7f367c158c30 2023-06-09T11:12:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.436+0000 7f3682282700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c159760 con 0x7f367c15ce60 2023-06-09T11:12:17.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.436+0000 7f3682282700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c159970 con 0x7f367c1561a0 2023-06-09T11:12:17.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f367c15ce60 0x7f367c070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367bfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f367c1561a0 0x7f367c0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367bfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f367c1561a0 0x7f367c0700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37054/0 (socket says 172.21.15.78:37054) 2023-06-09T11:12:17.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367bfff700 1 -- 172.21.15.78:0/2447321387 learned_addr learned my addr 172.21.15.78:0/2447321387 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367b7fe700 1 -- 172.21.15.78:0/2447321387 >> v2:172.21.15.187:3300/0 conn(0x7f367c1561a0 msgr2=0x7f367c0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367b7fe700 1 --2- 172.21.15.78:0/2447321387 >> v2:172.21.15.187:3300/0 conn(0x7f367c1561a0 0x7f367c0700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367b7fe700 1 -- 172.21.15.78:0/2447321387 >> v1:172.21.15.78:6789/0 conn(0x7f367c158c30 legacy=0x7f367c159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367b7fe700 1 -- 172.21.15.78:0/2447321387 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c15c380 con 0x7f367c15ce60 2023-06-09T11:12:17.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367bfff700 1 --2- 172.21.15.78:0/2447321387 >> v2:172.21.15.187:3300/0 conn(0x7f367c1561a0 0x7f367c0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:17.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367b7fe700 1 --2- 172.21.15.78:0/2447321387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c070610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f367c06ee80 tx=0x7f366c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b84ab3af7fa6696 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367affd700 1 -- 172.21.15.78:0/2447321387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c004230 con 0x7f367c15ce60 2023-06-09T11:12:17.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.440+0000 7f367affd700 1 -- 172.21.15.78:0/2447321387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c004390 con 0x7f367c15ce60 2023-06-09T11:12:17.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.444+0000 7f3682282700 1 -- 172.21.15.78:0/2447321387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 msgr2=0x7f367c070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.444+0000 7f3682282700 1 --2- 172.21.15.78:0/2447321387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c070610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f367c06ee80 tx=0x7f366c009b30 comp rx=0 tx=0).stop 2023-06-09T11:12:17.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.448+0000 7f3682282700 1 -- 172.21.15.78:0/2447321387 shutdown_connections 2023-06-09T11:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.448+0000 7f3682282700 1 --2- 172.21.15.78:0/2447321387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c070610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.448+0000 7f3682282700 1 --2- 172.21.15.78:0/2447321387 >> v2:172.21.15.187:3300/0 conn(0x7f367c1561a0 0x7f367c0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.448+0000 7f3682282700 1 -- 172.21.15.78:0/2447321387 >> 172.21.15.78:0/2447321387 conn(0x7f367c0cb460 msgr2=0x7f367c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.448+0000 7f3682282700 1 -- 172.21.15.78:0/2447321387 shutdown_connections 2023-06-09T11:12:17.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.448+0000 7f3682282700 1 -- 172.21.15.78:0/2447321387 wait complete. 2023-06-09T11:12:17.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.448+0000 7f3682282700 1 Processor -- start 2023-06-09T11:12:17.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f3682282700 1 -- start start 2023-06-09T11:12:17.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f3682282700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f367c1561a0 0x7f367c1fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f3682282700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f367c158c30 0x7f367c06b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f3682282700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f3682282700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c0b2790 con 0x7f367c15ce60 2023-06-09T11:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f3682282700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c0b1930 con 0x7f367c1561a0 2023-06-09T11:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f367bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f367c1561a0 0x7f367c1fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f367bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f367c1561a0 0x7f367c1fe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37066/0 (socket says 172.21.15.78:37066) 2023-06-09T11:12:17.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f367bfff700 1 -- 172.21.15.78:0/3972186230 learned_addr learned my addr 172.21.15.78:0/3972186230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f367b7fe700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f367c158c30 0x7f367c06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f3682282700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c0b1b80 con 0x7f367c158c30 2023-06-09T11:12:17.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f368081f700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f367bfff700 1 -- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f367c158c30 msgr2=0x7f367c06b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f367bfff700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f367c158c30 0x7f367c06b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.452+0000 7f367bfff700 1 -- 172.21.15.78:0/3972186230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 msgr2=0x7f367c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f367bfff700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c06b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f367bfff700 1 -- 172.21.15.78:0/3972186230 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367400d050 con 0x7f367c1561a0 2023-06-09T11:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f368081f700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c06b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:17.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f367bfff700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f367c1561a0 0x7f367c1fe5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f367400d2b0 tx=0x7f367400d5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f3678ff9700 1 -- 172.21.15.78:0/3972186230 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674010040 con 0x7f367c1561a0 2023-06-09T11:12:17.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f3678ff9700 1 -- 172.21.15.78:0/3972186230 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367400be90 con 0x7f367c1561a0 2023-06-09T11:12:17.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f3682282700 1 -- 172.21.15.78:0/3972186230 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c0094b0 con 0x7f367c1561a0 2023-06-09T11:12:17.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f3678ff9700 1 -- 172.21.15.78:0/3972186230 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674003e40 con 0x7f367c1561a0 2023-06-09T11:12:17.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f3682282700 1 -- 172.21.15.78:0/3972186230 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c15c940 con 0x7f367c1561a0 2023-06-09T11:12:17.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.456+0000 7f3682282700 1 -- 172.21.15.78:0/3972186230 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c15c660 con 0x7f367c1561a0 2023-06-09T11:12:17.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.460+0000 7f3678ff9700 1 -- 172.21.15.78:0/3972186230 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3674004030 con 0x7f367c1561a0 2023-06-09T11:12:17.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.460+0000 7f3678ff9700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3664066470 0x7f3664068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.460+0000 7f3678ff9700 1 -- 172.21.15.78:0/3972186230 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36740841b0 con 0x7f367c1561a0 2023-06-09T11:12:17.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.460+0000 7f367b7fe700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3664066470 0x7f3664068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.464+0000 7f367b7fe700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3664066470 0x7f3664068920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f367c06ee80 tx=0x7f366c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.468+0000 7f3678ff9700 1 -- 172.21.15.78:0/3972186230 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3674051590 con 0x7f367c1561a0 2023-06-09T11:12:17.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0908f77700 1 Processor -- start 2023-06-09T11:12:17.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3819df9700 1 Processor -- start 2023-06-09T11:12:17.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f9999700 1 Processor -- start 2023-06-09T11:12:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3819df9700 1 -- start start 2023-06-09T11:12:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0908f77700 1 -- start start 2023-06-09T11:12:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f9999700 1 -- start start 2023-06-09T11:12:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f49f4ff9700 1 Processor -- start 2023-06-09T11:12:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3819df9700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3814069ed0 0x7f381406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3819df9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381406db60 0x7f38140d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3819df9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381415cb00 con 0x7f381415c730 2023-06-09T11:12:17.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3819df9700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381406dfe0 con 0x7f3814069ed0 2023-06-09T11:12:17.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3819df9700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381406a4b0 con 0x7f381406db60 2023-06-09T11:12:17.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f9999700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29f4158b60 0x7f29f40ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f9999700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f29f4070290 0x7f29f406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3818df7700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f381415c730 0x7f3814160c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37854/0 (socket says 172.21.15.78:37854) 2023-06-09T11:12:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3818df7700 1 -- 172.21.15.78:0/208814089 learned_addr learned my addr 172.21.15.78:0/208814089 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0908f77700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f090415c880 0x7f090406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0908f77700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f09040c7cb0 0x7f090406a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0908f77700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09040c87a0 con 0x7f090406fc80 2023-06-09T11:12:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0908f77700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09040c81e0 con 0x7f090415c880 2023-06-09T11:12:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0908f77700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09040c84c0 con 0x7f09040c7cb0 2023-06-09T11:12:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f9999700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f406b100 con 0x7f29f406aca0 2023-06-09T11:12:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f9999700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f4158f30 con 0x7f29f4158b60 2023-06-09T11:12:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f9999700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40cd830 con 0x7f29f4070290 2023-06-09T11:12:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f3813fff700 1 --2- 172.21.15.78:0/208814089 >> v2:172.21.15.187:3300/0 conn(0x7f3814069ed0 0x7f381406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0902ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f090415c880 0x7f090406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0902ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f090415c880 0x7f090406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47828/0 (socket says 172.21.15.78:47828) 2023-06-09T11:12:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0902ffd700 1 -- 172.21.15.78:0/3009016328 learned_addr learned my addr 172.21.15.78:0/3009016328 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f5f39d2d700 1 Processor -- start 2023-06-09T11:12:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f37fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f29f406aca0 0x7f29f40c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45734/0 (socket says 172.21.15.78:45734) 2023-06-09T11:12:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f29f37fe700 1 -- 172.21.15.78:0/4154809749 learned_addr learned my addr 172.21.15.78:0/4154809749 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f49f4ff9700 1 -- start start 2023-06-09T11:12:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f38195f8700 1 --2- 172.21.15.78:0/208814089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381406db60 0x7f38140d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f27fc700 1 --2- 172.21.15.78:0/4154809749 >> v2:172.21.15.187:3300/0 conn(0x7f29f4070290 0x7f29f406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.500+0000 7f0903fff700 1 --2- 172.21.15.78:0/3009016328 >> v2:172.21.15.187:3300/0 conn(0x7f09040c7cb0 0x7f090406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f39d2d700 1 -- start start 2023-06-09T11:12:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49f4ff9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f49e80e2820 0x7f49e8053690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f2ffd700 1 --2- 172.21.15.78:0/4154809749 >> v2:172.21.15.78:3300/0 conn(0x7f29f4158b60 0x7f29f40ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f0902ffd700 1 -- 172.21.15.78:0/3009016328 >> v2:172.21.15.187:3300/0 conn(0x7f09040c7cb0 msgr2=0x7f090406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f0902ffd700 1 --2- 172.21.15.78:0/3009016328 >> v2:172.21.15.187:3300/0 conn(0x7f09040c7cb0 0x7f090406a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f0902ffd700 1 -- 172.21.15.78:0/3009016328 >> v1:172.21.15.78:6789/0 conn(0x7f090406fc80 legacy=0x7f0904070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f0902ffd700 1 -- 172.21.15.78:0/3009016328 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090406a070 con 0x7f090415c880 2023-06-09T11:12:17.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38195f8700 1 -- 172.21.15.78:0/208814089 >> v2:172.21.15.187:3300/0 conn(0x7f3814069ed0 msgr2=0x7f381406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38195f8700 1 --2- 172.21.15.78:0/208814089 >> v2:172.21.15.187:3300/0 conn(0x7f3814069ed0 0x7f381406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38195f8700 1 -- 172.21.15.78:0/208814089 >> v1:172.21.15.78:6789/0 conn(0x7f381415c730 legacy=0x7f3814160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38195f8700 1 -- 172.21.15.78:0/208814089 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381406a790 con 0x7f381406db60 2023-06-09T11:12:17.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49f4ff9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e8007860 con 0x7f49e803b1f0 2023-06-09T11:12:17.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49f4ff9700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e8057650 con 0x7f49e8053bd0 2023-06-09T11:12:17.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49f4ff9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e8057930 con 0x7f49e80e2820 2023-06-09T11:12:17.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f1ffb700 1 -- 172.21.15.78:0/4154809749 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267598399 0 0) 0x7f29f406b100 con 0x7f29f406aca0 2023-06-09T11:12:17.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f1ffb700 1 -- 172.21.15.78:0/4154809749 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29dc0035d0 con 0x7f29f406aca0 2023-06-09T11:12:17.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38195f8700 1 --2- 172.21.15.78:0/208814089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381406db60 0x7f38140d1850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f380c009d90 tx=0x7f380c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b9a27123cc781b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49edd9b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f49e8053bd0 0x7f49e803aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45742/0 (socket says 172.21.15.78:45742) 2023-06-09T11:12:17.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49edd9b700 1 -- 172.21.15.78:0/2103383901 learned_addr learned my addr 172.21.15.78:0/2103383901 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:17.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f2ffd700 1 -- 172.21.15.78:0/4154809749 >> v2:172.21.15.187:3300/0 conn(0x7f29f4070290 msgr2=0x7f29f406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f2ffd700 1 --2- 172.21.15.78:0/4154809749 >> v2:172.21.15.187:3300/0 conn(0x7f29f4070290 0x7f29f406a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f0902ffd700 1 --2- 172.21.15.78:0/3009016328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f090415c880 0x7f090406df50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009910 tx=0x7f08f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbaae9fd35283010 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f2ffd700 1 -- 172.21.15.78:0/4154809749 >> v1:172.21.15.187:6789/0 conn(0x7f29f406aca0 legacy=0x7f29f40c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f2ffd700 1 -- 172.21.15.78:0/4154809749 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f40cd270 con 0x7f29f4158b60 2023-06-09T11:12:17.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ee59c700 1 --2- 172.21.15.78:0/2103383901 >> v2:172.21.15.78:3300/0 conn(0x7f49e80e2820 0x7f49e8053690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38137fe700 1 -- 172.21.15.78:0/208814089 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00e070 con 0x7f381406db60 2023-06-09T11:12:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38137fe700 1 -- 172.21.15.78:0/208814089 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c00bb20 con 0x7f381406db60 2023-06-09T11:12:17.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f38137fe700 1 -- 172.21.15.78:0/208814089 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c012430 con 0x7f381406db60 2023-06-09T11:12:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862196057 0 0) 0x7f49e8057650 con 0x7f49e8053bd0 2023-06-09T11:12:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d80035d0 con 0x7f49e8053bd0 2023-06-09T11:12:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f39d2d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f340add80 0x7f5f3406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f39d2d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f39d2d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f340708f0 con 0x7f5f34160120 2023-06-09T11:12:17.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f39d2d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f34142c80 con 0x7f5f340add80 2023-06-09T11:12:17.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f39d2d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340ae150 con 0x7f5f3406ff60 2023-06-09T11:12:17.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f09027fc700 1 -- 172.21.15.78:0/3009016328 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8004230 con 0x7f090415c880 2023-06-09T11:12:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f2ffd700 1 --2- 172.21.15.78:0/4154809749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4158b60 0x7f29f40ae020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29f406d140 tx=0x7f29e400acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bf84a8f23f2fea server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f09027fc700 1 -- 172.21.15.78:0/3009016328 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8004390 con 0x7f090415c880 2023-06-09T11:12:17.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f09027fc700 1 -- 172.21.15.78:0/3009016328 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8009e60 con 0x7f090415c880 2023-06-09T11:12:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033220776 0 0) 0x7f49d80035d0 con 0x7f49e8053bd0 2023-06-09T11:12:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 >> v2:172.21.15.78:3300/0 conn(0x7f49e80e2820 msgr2=0x7f49e8053690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 --2- 172.21.15.78:0/2103383901 >> v2:172.21.15.78:3300/0 conn(0x7f49e80e2820 0x7f49e8053690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 >> v1:172.21.15.78:6789/0 conn(0x7f49e803b1f0 legacy=0x7f49e803beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8057c10 con 0x7f49e8053bd0 2023-06-09T11:12:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f49e0001670 con 0x7f49e8053bd0 2023-06-09T11:12:17.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 >> v1:172.21.15.187:6789/0 conn(0x7f49e8053bd0 legacy=0x7f49e803aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49d8003a20 0x7f49d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d8004450 0x7f49d8004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49d800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8057930 con 0x7f49d8004450 2023-06-09T11:12:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800c050 con 0x7f49d8005110 2023-06-09T11:12:17.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800c210 con 0x7f49d8003a20 2023-06-09T11:12:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f337fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f340add80 0x7f5f3406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f337fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f340add80 0x7f5f3406d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47860/0 (socket says 172.21.15.78:47860) 2023-06-09T11:12:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f5f337fe700 1 -- 172.21.15.78:0/3827108346 learned_addr learned my addr 172.21.15.78:0/3827108346 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f1ffb700 1 -- 172.21.15.78:0/4154809749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400cb70 con 0x7f29f4158b60 2023-06-09T11:12:17.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f0908f77700 1 -- 172.21.15.78:0/3009016328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f090415c880 msgr2=0x7f090406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f0908f77700 1 --2- 172.21.15.78:0/3009016328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f090415c880 0x7f090406df50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009910 tx=0x7f08f8009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:17.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f3819df9700 1 -- 172.21.15.78:0/208814089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381406db60 msgr2=0x7f38140d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f3819df9700 1 --2- 172.21.15.78:0/208814089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381406db60 0x7f38140d1850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f380c009d90 tx=0x7f380c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:17.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 -- 172.21.15.78:0/208814089 shutdown_connections 2023-06-09T11:12:17.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 --2- 172.21.15.78:0/208814089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381406db60 0x7f38140d1850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 --2- 172.21.15.78:0/208814089 >> v2:172.21.15.187:3300/0 conn(0x7f3814069ed0 0x7f381406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 -- 172.21.15.78:0/208814089 >> 172.21.15.78:0/208814089 conn(0x7f38140d2e70 msgr2=0x7f38140d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49d800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49edd9b700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d8004450 0x7f49d8004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd7d7f700 1 Processor -- start 2023-06-09T11:12:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49ee59c700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49d8003a20 0x7f49d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 -- 172.21.15.78:0/208814089 shutdown_connections 2023-06-09T11:12:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f0908f77700 1 -- 172.21.15.78:0/3009016328 shutdown_connections 2023-06-09T11:12:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f0908f77700 1 --2- 172.21.15.78:0/3009016328 >> v2:172.21.15.187:3300/0 conn(0x7f09040c7cb0 0x7f090406a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f0908f77700 1 --2- 172.21.15.78:0/3009016328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f090415c880 0x7f090406df50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f0908f77700 1 -- 172.21.15.78:0/3009016328 >> 172.21.15.78:0/3009016328 conn(0x7f09040cf870 msgr2=0x7f09040cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f1ffb700 1 -- 172.21.15.78:0/4154809749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400ccd0 con 0x7f29f4158b60 2023-06-09T11:12:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.504+0000 7f29f1ffb700 1 -- 172.21.15.78:0/4154809749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4018620 con 0x7f29f4158b60 2023-06-09T11:12:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 -- 172.21.15.78:0/4154809749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4158b60 msgr2=0x7f29f40ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 --2- 172.21.15.78:0/4154809749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4158b60 0x7f29f40ae020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29f406d140 tx=0x7f29e400acd0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f0908f77700 1 -- 172.21.15.78:0/3009016328 shutdown_connections 2023-06-09T11:12:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f32ffd700 1 --2- 172.21.15.78:0/3827108346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f337fe700 1 -- 172.21.15.78:0/3827108346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 msgr2=0x7f5f340703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f327fc700 1 -- 172.21.15.78:0/3827108346 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561699321 0 0) 0x7f5f24001110 con 0x7f5f34160120 2023-06-09T11:12:17.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f337fe700 1 --2- 172.21.15.78:0/3827108346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f337fe700 1 -- 172.21.15.78:0/3827108346 >> v1:172.21.15.187:6789/0 conn(0x7f5f34160120 legacy=0x7f5f34160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f337fe700 1 -- 172.21.15.78:0/3827108346 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340cc8e0 con 0x7f5f340add80 2023-06-09T11:12:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 -- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49d8003a20 msgr2=0x7f49d8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49d8003a20 0x7f49d8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 -- 172.21.15.78:0/2103383901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d8004450 msgr2=0x7f49d8004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d8004450 0x7f49d8004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 -- 172.21.15.78:0/2103383901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8057c10 con 0x7f49d8005110 2023-06-09T11:12:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 -- 172.21.15.78:0/2103383901 reap_dead start 2023-06-09T11:12:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49edd9b700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49d8004450 0x7f49d8004910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:17.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 -- 172.21.15.78:0/208814089 wait complete. 2023-06-09T11:12:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd7d7f700 1 -- start start 2023-06-09T11:12:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49eed9d700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49d800ba30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49e8059f50 tx=0x7f49d80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45fcbb658ef46a3a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 Processor -- start 2023-06-09T11:12:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f337fe700 1 --2- 172.21.15.78:0/3827108346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340add80 0x7f5f3406d590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009e50 tx=0x7f5f2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f6b73837139d90 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 -- 172.21.15.78:0/4154809749 shutdown_connections 2023-06-09T11:12:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 --2- 172.21.15.78:0/4154809749 >> v2:172.21.15.187:3300/0 conn(0x7f29f4070290 0x7f29f406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 --2- 172.21.15.78:0/4154809749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4158b60 0x7f29f40ae020 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 -- 172.21.15.78:0/4154809749 >> 172.21.15.78:0/4154809749 conn(0x7f29f40cf670 msgr2=0x7f29f40cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 -- 172.21.15.78:0/4154809749 shutdown_connections 2023-06-09T11:12:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0067280 con 0x7f49d8005110 2023-06-09T11:12:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f008d070 con 0x7f49d8005110 2023-06-09T11:12:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49ed59a700 1 -- 172.21.15.78:0/2103383901 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f006f390 con 0x7f49d8005110 2023-06-09T11:12:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49f4ff9700 1 -- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 msgr2=0x7f49d800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49d800ba30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49e8059f50 tx=0x7f49d80058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd7d7f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7fc80483e0 0x7f7fc80e7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd7d7f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80079b0 con 0x7f7fc8050e30 2023-06-09T11:12:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd7d7f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc8054e00 con 0x7f7fc8047e90 2023-06-09T11:12:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd7d7f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc8054840 con 0x7f7fc80483e0 2023-06-09T11:12:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f327fc700 1 -- 172.21.15.78:0/3827108346 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00e070 con 0x7f5f340add80 2023-06-09T11:12:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f327fc700 1 -- 172.21.15.78:0/3827108346 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c00b9c0 con 0x7f5f340add80 2023-06-09T11:12:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f327fc700 1 -- 172.21.15.78:0/3827108346 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00bd70 con 0x7f5f340add80 2023-06-09T11:12:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f39d2d700 1 -- 172.21.15.78:0/3827108346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340add80 msgr2=0x7f5f3406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/3827108346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340add80 0x7f5f3406d590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009e50 tx=0x7f5f2c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd5b1b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7fc8050e30 0x7f7fc8051200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37888/0 (socket says 172.21.15.78:37888) 2023-06-09T11:12:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/3733609747 learned_addr learned my addr 172.21.15.78:0/3733609747 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f0908f77700 1 -- 172.21.15.78:0/3009016328 wait complete. 2023-06-09T11:12:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f0908f77700 1 Processor -- start 2023-06-09T11:12:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f5f39d2d700 1 -- 172.21.15.78:0/3827108346 shutdown_connections 2023-06-09T11:12:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/3827108346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/3827108346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f340add80 0x7f5f3406d590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f5f39d2d700 1 -- 172.21.15.78:0/3827108346 >> 172.21.15.78:0/3827108346 conn(0x7f5f340cb460 msgr2=0x7f5f340cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7fd033fff700 1 Processor -- start 2023-06-09T11:12:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7fd033fff700 1 -- start start 2023-06-09T11:12:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980075754 0 0) 0x7f7fc80079b0 con 0x7f7fc8050e30 2023-06-09T11:12:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fbc0035d0 con 0x7f7fc8050e30 2023-06-09T11:12:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f3819df9700 1 -- start start 2023-06-09T11:12:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3819df9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3814069ed0 0x7f381408cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.508+0000 7f29f9999700 1 -- 172.21.15.78:0/4154809749 wait complete. 2023-06-09T11:12:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3456100845 0 0) 0x7f7fbc0035d0 con 0x7f7fc8050e30 2023-06-09T11:12:17.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 >> v2:172.21.15.187:3300/0 conn(0x7f7fc80483e0 msgr2=0x7f7fc80e7050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T11:12:17.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 --2- 172.21.15.78:0/3733609747 >> v2:172.21.15.187:3300/0 conn(0x7f7fc80483e0 0x7f7fc80e7050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 >> v1:172.21.15.187:6789/0 conn(0x7f7fc8047e90 legacy=0x7f7fc80eaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 Processor -- start 2023-06-09T11:12:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8054b20 con 0x7f7fc8050e30 2023-06-09T11:12:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f7fcc001670 con 0x7f7fc8050e30 2023-06-09T11:12:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 >> v1:172.21.15.78:6789/0 conn(0x7f7fc8050e30 legacy=0x7f7fc8051200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fbc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fbc004870 0x7f7fbc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fbc005420 0x7f7fbc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8054840 con 0x7f7fbc003a20 2023-06-09T11:12:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc00c2c0 con 0x7f7fbc005420 2023-06-09T11:12:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc00c480 con 0x7f7fbc004870 2023-06-09T11:12:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f0908f77700 1 -- start start 2023-06-09T11:12:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd033fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c0e6e60 0x7fd02c04f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd033fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd02c0512b0 0x7fd02c036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd033fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd02c036cb0 0x7fd02c0060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd033fff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02c037150 con 0x7fd02c0512b0 2023-06-09T11:12:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd033fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02c0486b0 con 0x7fd02c036cb0 2023-06-09T11:12:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd033fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c033a80 con 0x7fd02c0e6e60 2023-06-09T11:12:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f49f4ff9700 1 -- 172.21.15.78:0/2103383901 shutdown_connections 2023-06-09T11:12:17.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/2103383901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49d800ba30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f49f4ff9700 1 -- 172.21.15.78:0/2103383901 >> 172.21.15.78:0/2103383901 conn(0x7f49e8059060 msgr2=0x7f49e8059460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f49f4ff9700 1 -- 172.21.15.78:0/2103383901 shutdown_connections 2023-06-09T11:12:17.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f49f4ff9700 1 -- 172.21.15.78:0/2103383901 wait complete. 2023-06-09T11:12:17.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd531a700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fbc004870 0x7f7fbc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3819df9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381406db60 0x7f381415b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3819df9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381415c730 0x7f3814157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3819df9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3814159900 con 0x7f3814069ed0 2023-06-09T11:12:17.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3819df9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381408d210 con 0x7f381406db60 2023-06-09T11:12:17.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3819df9700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381408d4f0 con 0x7f381415c730 2023-06-09T11:12:17.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd631c700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fbc005420 0x7f7fbc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd5b1b700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fbc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3814069ed0 0x7f381408cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd02c0512b0 0x7fd02c036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd02c0512b0 0x7fd02c036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47888/0 (socket says 172.21.15.78:47888) 2023-06-09T11:12:17.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 -- 172.21.15.78:0/1388489575 learned_addr learned my addr 172.21.15.78:0/1388489575 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0337fe700 1 --2- 172.21.15.78:0/1388489575 >> v2:172.21.15.187:3300/0 conn(0x7fd02c036cb0 0x7fd02c0060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3814069ed0 0x7f381408cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47876/0 (socket says 172.21.15.78:47876) 2023-06-09T11:12:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 -- 172.21.15.78:0/3095928661 learned_addr learned my addr 172.21.15.78:0/3095928661 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f0908f77700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f090406fc80 0x7f090408d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3813fff700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381406db60 0x7f381415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd032ffd700 1 --2- 172.21.15.78:0/1388489575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c0e6e60 0x7fd02c04f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 -- 172.21.15.78:0/1388489575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c0e6e60 msgr2=0x7fd02c04f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 --2- 172.21.15.78:0/1388489575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c0e6e60 0x7fd02c04f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 -- 172.21.15.78:0/1388489575 >> v2:172.21.15.187:3300/0 conn(0x7fd02c036cb0 msgr2=0x7fd02c0060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 --2- 172.21.15.78:0/1388489575 >> v2:172.21.15.187:3300/0 conn(0x7fd02c036cb0 0x7fd02c0060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 -- 172.21.15.78:0/1388489575 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c033d60 con 0x7fd02c0512b0 2023-06-09T11:12:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f38195f8700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381415c730 0x7f3814157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f0908f77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09040c7cb0 0x7f0904160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fbc004870 msgr2=0x7f7fbc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd5b1b700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fbc004870 0x7f7fbc004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fbc005420 msgr2=0x7f7fbc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd5b1b700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fbc005420 0x7f7fbc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/3733609747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8054b20 con 0x7f7fbc003a20 2023-06-09T11:12:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd631c700 1 -- 172.21.15.78:0/3733609747 reap_dead start 2023-06-09T11:12:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 -- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381415c730 msgr2=0x7f3814157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381415c730 0x7f3814157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 -- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381406db60 msgr2=0x7f381415b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381406db60 0x7f381415b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 -- 172.21.15.78:0/3095928661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c009a70 con 0x7f3814069ed0 2023-06-09T11:12:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f09037fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f090406fc80 0x7f090408d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f09037fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f090406fc80 0x7f090408d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45678/0 (socket says 172.21.15.78:45678) 2023-06-09T11:12:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 -- start start 2023-06-09T11:12:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29f406aca0 0x7f29f4159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd5b1b700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fbc003e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c260 tx=0x7f7fbc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f180c1fcb2842cc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4070290 0x7f29f40b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f3818df7700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3814069ed0 0x7f381408cc30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3804001eb0 tx=0x7f380400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7fd0327fc700 1 --2- 172.21.15.78:0/1388489575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0340659f0 tx=0x7fd034061ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582e5371b218d601 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29f4158b60 0x7f29f41533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc007c10 con 0x7f7fbc003a20 2023-06-09T11:12:17.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f4159fc0 con 0x7f29f4070290 2023-06-09T11:12:17.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f0902ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09040c7cb0 0x7f0904160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f0902ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09040c7cb0 0x7f0904160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47902/0 (socket says 172.21.15.78:47902) 2023-06-09T11:12:17.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f09037fe700 1 -- 172.21.15.78:0/3595909719 learned_addr learned my addr 172.21.15.78:0/3595909719 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40b4180 con 0x7f29f406aca0 2023-06-09T11:12:17.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f0908f77700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f090415c880 0x7f09041fe3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.512+0000 7f29f9999700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c6580 con 0x7f29f4158b60 2023-06-09T11:12:17.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f38117fa700 1 -- 172.21.15.78:0/3095928661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804005d90 con 0x7f3814069ed0 2023-06-09T11:12:17.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f38117fa700 1 -- 172.21.15.78:0/3095928661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38040070d0 con 0x7f3814069ed0 2023-06-09T11:12:17.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f38117fa700 1 -- 172.21.15.78:0/3095928661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804007440 con 0x7f3814069ed0 2023-06-09T11:12:17.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09040ce810 con 0x7f09040c7cb0 2023-06-09T11:12:17.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090415db90 con 0x7f090415c880 2023-06-09T11:12:17.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f5f39d2d700 1 -- 172.21.15.78:0/3827108346 shutdown_connections 2023-06-09T11:12:17.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc00ce00 con 0x7f7fbc003a20 2023-06-09T11:12:17.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f7fd4b19700 1 -- 172.21.15.78:0/3733609747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc005ba0 con 0x7f7fbc003a20 2023-06-09T11:12:17.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090415de70 con 0x7f090406fc80 2023-06-09T11:12:17.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f5f39d2d700 1 -- 172.21.15.78:0/3827108346 wait complete. 2023-06-09T11:12:17.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38140d1050 con 0x7f3814069ed0 2023-06-09T11:12:17.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38140d0d70 con 0x7f3814069ed0 2023-06-09T11:12:17.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f0903fff700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f090415c880 0x7f09041fe3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29f406aca0 0x7f29f4159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29f406aca0 0x7f29f4159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37140/0 (socket says 172.21.15.78:37140) 2023-06-09T11:12:17.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 -- 172.21.15.78:0/2211454707 learned_addr learned my addr 172.21.15.78:0/2211454707 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f37fe700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29f4158b60 0x7f29f41533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f27fc700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4070290 0x7f29f40b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f49f4ff9700 1 Processor -- start 2023-06-09T11:12:17.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/3733609747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 msgr2=0x7f7fbc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fbc003e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c260 tx=0x7f7fbc0058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f09037fe700 1 -- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f090415c880 msgr2=0x7f09041fe3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f09037fe700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f090415c880 0x7f09041fe3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f09037fe700 1 -- 172.21.15.78:0/3595909719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09040c7cb0 msgr2=0x7f0904160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f09037fe700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09040c7cb0 0x7f0904160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f09037fe700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8009570 con 0x7f090406fc80 2023-06-09T11:12:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 -- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29f4158b60 msgr2=0x7f29f41533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29f4158b60 0x7f29f41533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 -- 172.21.15.78:0/2211454707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4070290 msgr2=0x7f29f40b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4070290 0x7f29f40b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 -- 172.21.15.78:0/2211454707 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e400a650 con 0x7f29f406aca0 2023-06-09T11:12:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f27fc700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4070290 0x7f29f40b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/3733609747 shutdown_connections 2023-06-09T11:12:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/3733609747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fbc003e30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/3733609747 >> 172.21.15.78:0/3733609747 conn(0x7f7fc8051a80 msgr2=0x7f7fc8051e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f09037fe700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f090406fc80 0x7f090408d910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c4d0 tx=0x7f08f400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd031ffb700 1 -- 172.21.15.78:0/1388489575 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03406f410 con 0x7fd02c0512b0 2023-06-09T11:12:17.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd031ffb700 1 -- 172.21.15.78:0/1388489575 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03408d070 con 0x7fd02c0512b0 2023-06-09T11:12:17.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd031ffb700 1 -- 172.21.15.78:0/1388489575 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03406f570 con 0x7fd02c0512b0 2023-06-09T11:12:17.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f2ffd700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29f406aca0 0x7f29f4159a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29e4000c00 tx=0x7f29e4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f4005310 con 0x7f3814069ed0 2023-06-09T11:12:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29dbfff700 1 -- 172.21.15.78:0/2211454707 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e401c040 con 0x7f29f406aca0 2023-06-09T11:12:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 -- 172.21.15.78:0/1388489575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 msgr2=0x7fd02c036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 --2- 172.21.15.78:0/1388489575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c036770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0340659f0 tx=0x7fd034061ae0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f40c3f00 con 0x7f29f406aca0 2023-06-09T11:12:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f40cd550 con 0x7f29f406aca0 2023-06-09T11:12:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f08ebfff700 1 -- 172.21.15.78:0/3595909719 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40054e0 con 0x7f090406fc80 2023-06-09T11:12:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f08ebfff700 1 -- 172.21.15.78:0/3595909719 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f40036a0 con 0x7f090406fc80 2023-06-09T11:12:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f08ebfff700 1 -- 172.21.15.78:0/3595909719 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4003a50 con 0x7f090406fc80 2023-06-09T11:12:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090406e490 con 0x7f090406fc80 2023-06-09T11:12:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090406a350 con 0x7f090406fc80 2023-06-09T11:12:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f5f39d2d700 1 Processor -- start 2023-06-09T11:12:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29dbfff700 1 -- 172.21.15.78:0/2211454707 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e40038d0 con 0x7f29f406aca0 2023-06-09T11:12:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f29dbfff700 1 -- 172.21.15.78:0/2211454707 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4003c80 con 0x7f29f406aca0 2023-06-09T11:12:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f49f4ff9700 1 -- start start 2023-06-09T11:12:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f49f4ff9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49e81783e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f49f4ff9700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49e8178920 0x7f49e8030390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7f49f4ff9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e80308d0 0x7f49e80520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 -- 172.21.15.78:0/1388489575 shutdown_connections 2023-06-09T11:12:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 --2- 172.21.15.78:0/1388489575 >> v2:172.21.15.187:3300/0 conn(0x7fd02c036cb0 0x7fd02c0060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 --2- 172.21.15.78:0/1388489575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c036770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 --2- 172.21.15.78:0/1388489575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c0e6e60 0x7fd02c04f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 -- 172.21.15.78:0/1388489575 >> 172.21.15.78:0/1388489575 conn(0x7fd02c051770 msgr2=0x7fd02c051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 -- 172.21.15.78:0/1388489575 shutdown_connections 2023-06-09T11:12:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.516+0000 7fd033fff700 1 -- 172.21.15.78:0/1388489575 wait complete. 2023-06-09T11:12:17.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e80308d0 0x7f49e80520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49edd9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49e8178920 0x7f49e8030390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49edd9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49e8178920 0x7f49e8030390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45692/0 (socket says 172.21.15.78:45692) 2023-06-09T11:12:17.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d4005310 con 0x7f29f406aca0 2023-06-09T11:12:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e80308d0 0x7f49e80520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47916/0 (socket says 172.21.15.78:47916) 2023-06-09T11:12:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/3733609747 shutdown_connections 2023-06-09T11:12:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49edd9b700 1 -- 172.21.15.78:0/4039139814 learned_addr learned my addr 172.21.15.78:0/4039139814 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8030e30 con 0x7f49e80308d0 2023-06-09T11:12:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e817b410 con 0x7f49d8005110 2023-06-09T11:12:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e817b6f0 con 0x7f49e8178920 2023-06-09T11:12:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f38117fa700 1 -- 172.21.15.78:0/3095928661 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38040075a0 con 0x7f3814069ed0 2023-06-09T11:12:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/3733609747 wait complete. 2023-06-09T11:12:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49ee59c700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49e81783e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 -- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49e8178920 msgr2=0x7f49e8030390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7fd033fff700 1 Processor -- start 2023-06-09T11:12:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49e8178920 0x7f49e8030390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 -- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 msgr2=0x7f49e81783e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49e81783e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8007b40 con 0x7f49e80308d0 2023-06-09T11:12:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f38117fa700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38000663f0 0x7f38000688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f38117fa700 1 -- 172.21.15.78:0/3095928661 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3804083450 con 0x7f3814069ed0 2023-06-09T11:12:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7fd033fff700 1 -- start start 2023-06-09T11:12:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f49eed9d700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e80308d0 0x7f49e80520b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49f00693e0 tx=0x7f49f0067c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f5f39d2d700 1 -- start start 2023-06-09T11:12:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f5f39d2d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f5f39d2d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f340add80 0x7f5f34146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09040cf240 con 0x7f090406fc80 2023-06-09T11:12:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f5f39d2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f34160120 0x7f5f340a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f5f39d2d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340c8100 con 0x7f5f34160120 2023-06-09T11:12:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f5f39d2d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340c89a0 con 0x7f5f340add80 2023-06-09T11:12:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f5f39d2d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340cab90 con 0x7f5f3406ff60 2023-06-09T11:12:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c036cb0 0x7fd02c03a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c0dd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 Processor -- start 2023-06-09T11:12:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c0dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c0dd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47920/0 (socket says 172.21.15.78:47920) 2023-06-09T11:12:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 -- 172.21.15.78:0/2895323196 learned_addr learned my addr 172.21.15.78:0/2895323196 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd02c0e6e60 0x7fd02c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd032ffd700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c036cb0 0x7fd02c03a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0e9b60 con 0x7fd02c0512b0 2023-06-09T11:12:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0cfcc0 con 0x7fd02c0e6e60 2023-06-09T11:12:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0e8c90 con 0x7fd02c036cb0 2023-06-09T11:12:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0337fe700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd02c0e6e60 0x7fd02c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f29dbfff700 1 -- 172.21.15.78:0/2211454707 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29e402b440 con 0x7f29f406aca0 2023-06-09T11:12:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 -- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c036cb0 msgr2=0x7fd02c03a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c036cb0 0x7fd02c03a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 -- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd02c0e6e60 msgr2=0x7fd02c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd02c0e6e60 0x7fd02c0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034066b50 con 0x7fd02c0512b0 2023-06-09T11:12:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd0327fc700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c0dd070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd034073e30 tx=0x7fd034068e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f3813fff700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38000663f0 0x7f38000688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f38117fa700 1 -- 172.21.15.78:0/3095928661 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38040509f0 con 0x7f3814069ed0 2023-06-09T11:12:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.520+0000 7f08ebfff700 1 -- 172.21.15.78:0/3595909719 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08f4003bb0 con 0x7f090406fc80 2023-06-09T11:12:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f08ebfff700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08f00663c0 0x7f08f0068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f08ebfff700 1 -- 172.21.15.78:0/3595909719 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08f40831c0 con 0x7f090406fc80 2023-06-09T11:12:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f0902ffd700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08f00663c0 0x7f08f0068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f49deffd700 1 -- 172.21.15.78:0/4039139814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f006f3d0 con 0x7f49e80308d0 2023-06-09T11:12:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f49deffd700 1 -- 172.21.15.78:0/4039139814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f006f530 con 0x7f49e80308d0 2023-06-09T11:12:17.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f49deffd700 1 -- 172.21.15.78:0/4039139814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0070c00 con 0x7f49e80308d0 2023-06-09T11:12:17.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e8058130 con 0x7f49e80308d0 2023-06-09T11:12:17.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80e2bf0 con 0x7f49e80308d0 2023-06-09T11:12:17.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 -- start start 2023-06-09T11:12:17.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fc817d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd01b7fe700 1 -- 172.21.15.78:0/2895323196 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034067100 con 0x7fd02c0512b0 2023-06-09T11:12:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd01b7fe700 1 -- 172.21.15.78:0/2895323196 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034067260 con 0x7fd02c0512b0 2023-06-09T11:12:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd01b7fe700 1 -- 172.21.15.78:0/2895323196 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034072070 con 0x7fd02c0512b0 2023-06-09T11:12:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f337fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f34160120 0x7f5f340a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f34160120 0x7f5f340a9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47932/0 (socket says 172.21.15.78:47932) 2023-06-09T11:12:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f33fff700 1 -- 172.21.15.78:0/2788673909 learned_addr learned my addr 172.21.15.78:0/2788673909 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc8006d00 0x7f7fc80db1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f33fff700 1 -- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 msgr2=0x7f5f340ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f33fff700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f29dbfff700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f29e00662f0 0x7f29e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f29dbfff700 1 -- 172.21.15.78:0/2211454707 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29e4085200 con 0x7f29f406aca0 2023-06-09T11:12:17.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f33fff700 1 -- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f340add80 msgr2=0x7f5f34146690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T11:12:17.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc803a270 0x7f7fc803a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc803ac20 con 0x7f7fbc003a20 2023-06-09T11:12:17.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f29f27fc700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f29e00662f0 0x7f29e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80db960 con 0x7f7fc8006d00 2023-06-09T11:12:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f32ffd700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f340add80 0x7f5f34146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd7d7f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80dbc00 con 0x7f7fc803a270 2023-06-09T11:12:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02c034320 con 0x7fd02c0512b0 2023-06-09T11:12:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd5b1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fc817d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f0902ffd700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08f00663c0 0x7f08f0068870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009910 tx=0x7f08f8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7fd033fff700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02c034040 con 0x7fd02c0512b0 2023-06-09T11:12:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd5b1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fc817d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47944/0 (socket says 172.21.15.78:47944) 2023-06-09T11:12:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/166954511 learned_addr learned my addr 172.21.15.78:0/166954511 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f3813fff700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38000663f0 0x7f38000688a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38140b2870 tx=0x7f3808009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.524+0000 7f5f33fff700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f340add80 0x7f5f34146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f33fff700 1 -- 172.21.15.78:0/2788673909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009b30 con 0x7f5f34160120 2023-06-09T11:12:17.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f32ffd700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f340add80 0x7f5f34146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:17.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f33fff700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f34160120 0x7f5f340a9300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c780 tx=0x7f5f2400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc803a270 msgr2=0x7f7fc803a6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T11:12:17.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fd5b1b700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc803a270 0x7f7fc803a6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc8006d00 msgr2=0x7f7fc80db1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fd5b1b700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc8006d00 0x7f7fc80db1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fd5b1b700 1 -- 172.21.15.78:0/166954511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8007660 con 0x7f7fbc003a20 2023-06-09T11:12:17.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fd5b1b700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fc817d890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c290 tx=0x7f7fcc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f29f27fc700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f29e00662f0 0x7f29e00687a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29f40ae3f0 tx=0x7f29e8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80053f0 con 0x7f49e80308d0 2023-06-09T11:12:17.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f08ebfff700 1 -- 172.21.15.78:0/3595909719 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f08f4050620 con 0x7f090406fc80 2023-06-09T11:12:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f2bfff700 1 -- 172.21.15.78:0/2788673909 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240054e0 con 0x7f5f34160120 2023-06-09T11:12:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3406df50 con 0x7f5f34160120 2023-06-09T11:12:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3406dc70 con 0x7f5f34160120 2023-06-09T11:12:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f2bfff700 1 -- 172.21.15.78:0/2788673909 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f240036a0 con 0x7f5f34160120 2023-06-09T11:12:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f2bfff700 1 -- 172.21.15.78:0/2788673909 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24003a50 con 0x7f5f34160120 2023-06-09T11:12:17.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3406e230 con 0x7f5f34160120 2023-06-09T11:12:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f29dbfff700 1 -- 172.21.15.78:0/2211454707 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f29e40529c0 con 0x7f29f406aca0 2023-06-09T11:12:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f49deffd700 1 -- 172.21.15.78:0/4039139814 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49f0072070 con 0x7f49e80308d0 2023-06-09T11:12:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f49deffd700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f49d00663f0 0x7f49d00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f49deffd700 1 -- 172.21.15.78:0/4039139814 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49f00fef10 con 0x7f49e80308d0 2023-06-09T11:12:17.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f49ee59c700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f49d00663f0 0x7f49d00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f49ee59c700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f49d00663f0 0x7f49d00688a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49e817b1d0 tx=0x7f49e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fc67fc700 1 -- 172.21.15.78:0/166954511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0070d0 con 0x7f7fbc003a20 2023-06-09T11:12:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7f7fc67fc700 1 -- 172.21.15.78:0/166954511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc007230 con 0x7f7fbc003a20 2023-06-09T11:12:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc80ea9e0 con 0x7f7fbc003a20 2023-06-09T11:12:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc8051200 con 0x7f7fbc003a20 2023-06-09T11:12:17.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f7fc67fc700 1 -- 172.21.15.78:0/166954511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0075e0 con 0x7f7fbc003a20 2023-06-09T11:12:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc80053f0 con 0x7f7fbc003a20 2023-06-09T11:12:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.528+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02c0528c0 con 0x7fd02c0512b0 2023-06-09T11:12:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7fd01b7fe700 1 -- 172.21.15.78:0/2895323196 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0340721d0 con 0x7fd02c0512b0 2023-06-09T11:12:17.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7fd01b7fe700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd020066340 0x7fd0200687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.532+0000 7fd01b7fe700 1 -- 172.21.15.78:0/2895323196 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0340ff210 con 0x7fd02c0512b0 2023-06-09T11:12:17.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.536+0000 7fd032ffd700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd020066340 0x7fd0200687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.536+0000 7fd032ffd700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd020066340 0x7fd0200687f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd02c038050 tx=0x7fd028008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.536+0000 7f49deffd700 1 -- 172.21.15.78:0/4039139814 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f49f00cfe90 con 0x7f49e80308d0 2023-06-09T11:12:17.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.544+0000 7fd01b7fe700 1 -- 172.21.15.78:0/2895323196 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd0340cc820 con 0x7fd02c0512b0 2023-06-09T11:12:17.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.544+0000 7f5f2bfff700 1 -- 172.21.15.78:0/2788673909 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f24003bb0 con 0x7f5f34160120 2023-06-09T11:12:17.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f5f2bfff700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5f140662f0 0x7f5f140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f5f2bfff700 1 -- 172.21.15.78:0/2788673909 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f240836c0 con 0x7f5f34160120 2023-06-09T11:12:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f7fc67fc700 1 -- 172.21.15.78:0/166954511 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fcc030430 con 0x7f7fbc003a20 2023-06-09T11:12:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f5f337fe700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5f140662f0 0x7f5f140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f7fc67fc700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb40663c0 0x7f7fb4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:17.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f7fc67fc700 1 -- 172.21.15.78:0/166954511 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fcc085710 con 0x7f7fbc003a20 2023-06-09T11:12:17.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f5f337fe700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5f140662f0 0x7f5f140687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00b370 tx=0x7f5f2c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.548+0000 7f7fd531a700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb40663c0 0x7f7fb4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:17.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.552+0000 7f7fd531a700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb40663c0 0x7f7fb4068870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7fc804d230 tx=0x7f7fc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:17.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.552+0000 7f5f2bfff700 1 -- 172.21.15.78:0/2788673909 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5f24050c60 con 0x7f5f34160120 2023-06-09T11:12:17.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.556+0000 7f7fc67fc700 1 -- 172.21.15.78:0/166954511 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7fcc052d20 con 0x7f7fbc003a20 2023-06-09T11:12:17.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.796+0000 7f3682282700 1 -- 172.21.15.78:0/3972186230 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f367c156570 con 0x7f367c1561a0 2023-06-09T11:12:17.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.800+0000 7f3678ff9700 1 -- 172.21.15.78:0/3972186230 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f367401a090 con 0x7f367c1561a0 2023-06-09T11:12:17.806 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-09T11:12:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.800+0000 7f366a7fc700 1 -- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3664066470 msgr2=0x7f3664068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.800+0000 7f366a7fc700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3664066470 0x7f3664068920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f367c06ee80 tx=0x7f366c008030 comp rx=0 tx=0).stop 2023-06-09T11:12:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.800+0000 7f366a7fc700 1 -- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f367c1561a0 msgr2=0x7f367c1fe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.800+0000 7f366a7fc700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f367c1561a0 0x7f367c1fe5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f367400d2b0 tx=0x7f367400d5c0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 -- 172.21.15.78:0/3972186230 shutdown_connections 2023-06-09T11:12:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3664066470 0x7f3664068920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f367c15ce60 0x7f367c06b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f367c158c30 0x7f367c06b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 --2- 172.21.15.78:0/3972186230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f367c1561a0 0x7f367c1fe5c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 -- 172.21.15.78:0/3972186230 >> 172.21.15.78:0/3972186230 conn(0x7f367c0cb460 msgr2=0x7f367c159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 -- 172.21.15.78:0/3972186230 shutdown_connections 2023-06-09T11:12:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.804+0000 7f366a7fc700 1 -- 172.21.15.78:0/3972186230 wait complete. 2023-06-09T11:12:17.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-06-09T11:12:17.835 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.836+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37f4005890 con 0x7f3814069ed0 2023-06-09T11:12:17.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.836+0000 7f38117fa700 1 -- 172.21.15.78:0/3095928661 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3804054010 con 0x7f3814069ed0 2023-06-09T11:12:17.846 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-09T11:12:17.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f090406e280 con 0x7f090406fc80 2023-06-09T11:12:17.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f08ebfff700 1 -- 172.21.15.78:0/3595909719 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08f4003e60 con 0x7f090406fc80 2023-06-09T11:12:17.848 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-09T11:12:17.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38000663f0 msgr2=0x7f38000688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38000663f0 0x7f38000688a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38140b2870 tx=0x7f3808009240 comp rx=0 tx=0).stop 2023-06-09T11:12:17.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3814069ed0 msgr2=0x7f381408cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3814069ed0 0x7f381408cc30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3804001eb0 tx=0x7f380400c7b0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 shutdown_connections 2023-06-09T11:12:17.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38000663f0 0x7f38000688a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f381415c730 0x7f3814157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381406db60 0x7f381415b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 --2- 172.21.15.78:0/3095928661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3814069ed0 0x7f381408cc30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.840+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 >> 172.21.15.78:0/3095928661 conn(0x7f38140d2e70 msgr2=0x7f38140d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 shutdown_connections 2023-06-09T11:12:17.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f3819df9700 1 -- 172.21.15.78:0/3095928661 wait complete. 2023-06-09T11:12:17.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08f00663c0 msgr2=0x7f08f0068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08f00663c0 0x7f08f0068870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009910 tx=0x7f08f8008030 comp rx=0 tx=0).stop 2023-06-09T11:12:17.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f090406fc80 msgr2=0x7f090408d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f090406fc80 0x7f090408d910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c4d0 tx=0x7f08f400c7e0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 shutdown_connections 2023-06-09T11:12:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08f00663c0 0x7f08f0068870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f090415c880 0x7f09041fe3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09040c7cb0 0x7f0904160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 --2- 172.21.15.78:0/3595909719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f090406fc80 0x7f090408d910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 >> 172.21.15.78:0/3595909719 conn(0x7f09040cf870 msgr2=0x7f09040cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 shutdown_connections 2023-06-09T11:12:17.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.844+0000 7f0908f77700 1 -- 172.21.15.78:0/3595909719 wait complete. 2023-06-09T11:12:17.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f29d4005890 con 0x7f29f406aca0 2023-06-09T11:12:17.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f29dbfff700 1 -- 172.21.15.78:0/2211454707 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29e4055fe0 con 0x7f29f406aca0 2023-06-09T11:12:17.859 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-09T11:12:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f340708f0 con 0x7f5f34160120 2023-06-09T11:12:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f5f2bfff700 1 -- 172.21.15.78:0/2788673909 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f24017020 con 0x7f5f34160120 2023-06-09T11:12:17.861 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f29e00662f0 msgr2=0x7f29e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f29f9999700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f29e00662f0 0x7f29e00687a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29f40ae3f0 tx=0x7f29e8009240 comp rx=0 tx=0).stop 2023-06-09T11:12:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29f406aca0 msgr2=0x7f29f4159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.852+0000 7f29f9999700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29f406aca0 0x7f29f4159a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29e4000c00 tx=0x7f29e4004770 comp rx=0 tx=0).stop 2023-06-09T11:12:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 shutdown_connections 2023-06-09T11:12:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f29e00662f0 0x7f29e00687a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29f4158b60 0x7f29f41533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29f4070290 0x7f29f40b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 --2- 172.21.15.78:0/2211454707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29f406aca0 0x7f29f4159a80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 >> 172.21.15.78:0/2211454707 conn(0x7f29f40cf670 msgr2=0x7f29f406d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 shutdown_connections 2023-06-09T11:12:17.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f29f9999700 1 -- 172.21.15.78:0/2211454707 wait complete. 2023-06-09T11:12:17.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5f140662f0 msgr2=0x7f5f140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5f140662f0 0x7f5f140687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00b370 tx=0x7f5f2c009000 comp rx=0 tx=0).stop 2023-06-09T11:12:17.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f34160120 msgr2=0x7f5f340a9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f34160120 0x7f5f340a9300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f2400c780 tx=0x7f5f2400ca90 comp rx=0 tx=0).stop 2023-06-09T11:12:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 shutdown_connections 2023-06-09T11:12:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5f140662f0 0x7f5f140687a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f34160120 0x7f5f340a9300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f340add80 0x7f5f34146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 --2- 172.21.15.78:0/2788673909 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3406ff60 0x7f5f340ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.856+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 >> 172.21.15.78:0/2788673909 conn(0x7f5f340cb460 msgr2=0x7f5f340af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.860+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 shutdown_connections 2023-06-09T11:12:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.860+0000 7f5f39d2d700 1 -- 172.21.15.78:0/2788673909 wait complete. 2023-06-09T11:12:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.860+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f49e80e20b0 con 0x7f49e80308d0 2023-06-09T11:12:17.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.860+0000 7f49deffd700 1 -- 172.21.15.78:0/4039139814 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49f00cfa20 con 0x7f49e80308d0 2023-06-09T11:12:17.868 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.860+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd02c17f790 con 0x7fd02c0512b0 2023-06-09T11:12:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.864+0000 7fd01b7fe700 1 -- 172.21.15.78:0/2895323196 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd034098090 con 0x7fd02c0512b0 2023-06-09T11:12:17.870 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-09T11:12:17.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.864+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd020066340 msgr2=0x7fd0200687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.864+0000 7fd0197fa700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd020066340 0x7fd0200687f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd02c038050 tx=0x7fd028008040 comp rx=0 tx=0).stop 2023-06-09T11:12:17.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.864+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 msgr2=0x7fd02c0dd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.864+0000 7fd0197fa700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c0dd070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd034073e30 tx=0x7fd034068e80 comp rx=0 tx=0).stop 2023-06-09T11:12:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 shutdown_connections 2023-06-09T11:12:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd020066340 0x7fd0200687f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd02c0e6e60 0x7fd02c0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c0512b0 0x7fd02c0dd070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 --2- 172.21.15.78:0/2895323196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd02c036cb0 0x7fd02c03a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 >> 172.21.15.78:0/2895323196 conn(0x7fd02c051770 msgr2=0x7fd02c036460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 shutdown_connections 2023-06-09T11:12:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7fd0197fa700 1 -- 172.21.15.78:0/2895323196 wait complete. 2023-06-09T11:12:17.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-06-09T11:12:17.877 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f49d00663f0 msgr2=0x7f49d00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f49d00663f0 0x7f49d00688a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49e817b1d0 tx=0x7f49e4008040 comp rx=0 tx=0).stop 2023-06-09T11:12:17.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e80308d0 msgr2=0x7f49e80520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e80308d0 0x7f49e80520b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49f00693e0 tx=0x7f49f0067c80 comp rx=0 tx=0).stop 2023-06-09T11:12:17.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 shutdown_connections 2023-06-09T11:12:17.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f49d00663f0 0x7f49d00688a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e80308d0 0x7f49e80520b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49e8178920 0x7f49e8030390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 --2- 172.21.15.78:0/4039139814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49d8005110 0x7f49e81783e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 >> 172.21.15.78:0/4039139814 conn(0x7f49e8059060 msgr2=0x7f49e80e13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 shutdown_connections 2023-06-09T11:12:17.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.868+0000 7f49f4ff9700 1 -- 172.21.15.78:0/4039139814 wait complete. 2023-06-09T11:12:17.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-06-09T11:12:17.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.872+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7fc80e10c0 con 0x7f7fbc003a20 2023-06-09T11:12:17.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.872+0000 7f7fc67fc700 1 -- 172.21.15.78:0/166954511 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fcc017020 con 0x7f7fbc003a20 2023-06-09T11:12:17.882 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.882 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-09T11:12:17.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb40663c0 msgr2=0x7f7fb4068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb40663c0 0x7f7fb4068870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7fc804d230 tx=0x7f7fc0009040 comp rx=0 tx=0).stop 2023-06-09T11:12:17.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 msgr2=0x7f7fc817d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:17.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fc817d890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c290 tx=0x7f7fcc000fe0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 shutdown_connections 2023-06-09T11:12:17.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb40663c0 0x7f7fb4068870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc803a270 0x7f7fc803a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc8006d00 0x7f7fc80db1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 --2- 172.21.15.78:0/166954511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fbc003a20 0x7f7fc817d890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:17.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 >> 172.21.15.78:0/166954511 conn(0x7f7fc8051a80 msgr2=0x7f7fc80dd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:17.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 shutdown_connections 2023-06-09T11:12:17.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:17.876+0000 7f7fd7d7f700 1 -- 172.21.15.78:0/166954511 wait complete. 2023-06-09T11:12:17.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-06-09T11:12:17.887 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-06-09T11:12:17.888 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-06-09T11:12:17.901 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-06-09T11:12:17.902 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-06-09T11:12:17.903 DEBUG:teuthology.parallel:result is None 2023-06-09T11:12:17.903 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-09T11:12:17.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:12:18.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.108+0000 7f99baf81700 1 Processor -- start 2023-06-09T11:12:18.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.108+0000 7f99baf81700 1 -- start start 2023-06-09T11:12:18.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99baf81700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a4b0 0x7f99b415a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99baf81700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99b406e8f0 0x7f99b406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99baf81700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b4071160 con 0x7f99b406abc0 2023-06-09T11:12:18.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99baf81700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b4069ed0 con 0x7f99b406e8f0 2023-06-09T11:12:18.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99baf81700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40b47a0 con 0x7f99b415a4b0 2023-06-09T11:12:18.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99b8d1d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a4b0 0x7f99b415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99abfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99b406e8f0 0x7f99b406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99b8d1d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a4b0 0x7f99b415a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45722/0 (socket says 172.21.15.78:45722) 2023-06-09T11:12:18.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.112+0000 7f99b8d1d700 1 -- 172.21.15.78:0/2623259034 learned_addr learned my addr 172.21.15.78:0/2623259034 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:18.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99abfff700 1 -- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a4b0 msgr2=0x7f99b415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:18.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99abfff700 1 --2- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a4b0 0x7f99b415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99abfff700 1 -- 172.21.15.78:0/2623259034 >> v1:172.21.15.187:6789/0 conn(0x7f99b406abc0 legacy=0x7f99b415e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99abfff700 1 -- 172.21.15.78:0/2623259034 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b406a0e0 con 0x7f99b406e8f0 2023-06-09T11:12:18.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99b8d1d700 1 --2- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a4b0 0x7f99b415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:18.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99ab7fe700 1 -- 172.21.15.78:0/2623259034 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768299628 0 0) 0x7f99b4071160 con 0x7f99b406abc0 2023-06-09T11:12:18.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99abfff700 1 --2- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b406e8f0 0x7f99b406d8d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009850 tx=0x7f99a4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e336955a9fc0ef server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99ab7fe700 1 -- 172.21.15.78:0/2623259034 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011830 con 0x7f99b406e8f0 2023-06-09T11:12:18.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99ab7fe700 1 -- 172.21.15.78:0/2623259034 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a4011990 con 0x7f99b406e8f0 2023-06-09T11:12:18.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99ab7fe700 1 -- 172.21.15.78:0/2623259034 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011d40 con 0x7f99b406e8f0 2023-06-09T11:12:18.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 -- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b406e8f0 msgr2=0x7f99b406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 --2- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b406e8f0 0x7f99b406d8d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009850 tx=0x7f99a4009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:18.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 -- 172.21.15.78:0/2623259034 shutdown_connections 2023-06-09T11:12:18.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 --2- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b406e8f0 0x7f99b406d8d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 --2- 172.21.15.78:0/2623259034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b415a4b0 0x7f99b415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 -- 172.21.15.78:0/2623259034 >> 172.21.15.78:0/2623259034 conn(0x7f99b40b1480 msgr2=0x7f99b40cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:18.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 -- 172.21.15.78:0/2623259034 shutdown_connections 2023-06-09T11:12:18.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.116+0000 7f99baf81700 1 -- 172.21.15.78:0/2623259034 wait complete. 2023-06-09T11:12:18.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.120+0000 7f99baf81700 1 Processor -- start 2023-06-09T11:12:18.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.120+0000 7f99baf81700 1 -- start start 2023-06-09T11:12:18.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.120+0000 7f99baf81700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b406abc0 0x7f99b40c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406e8f0 0x7f99b40c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b415a4b0 0x7f99b40c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4154e80 con 0x7f99b406abc0 2023-06-09T11:12:18.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c3140 con 0x7f99b415a4b0 2023-06-09T11:12:18.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c3420 con 0x7f99b406e8f0 2023-06-09T11:12:18.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b406abc0 0x7f99b40c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b406abc0 0x7f99b40c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47960/0 (socket says 172.21.15.78:47960) 2023-06-09T11:12:18.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 -- 172.21.15.78:0/1115269354 learned_addr learned my addr 172.21.15.78:0/1115269354 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 -- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406e8f0 msgr2=0x7f99b40c25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406e8f0 0x7f99b40c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 -- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b415a4b0 msgr2=0x7f99b40c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b415a4b0 0x7f99b40c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 -- 172.21.15.78:0/1115269354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009b30 con 0x7f99b406abc0 2023-06-09T11:12:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99b8d1d700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b406abc0 0x7f99b40c7230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99b000efc0 tx=0x7f99b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99a97fa700 1 -- 172.21.15.78:0/1115269354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000cc70 con 0x7f99b406abc0 2023-06-09T11:12:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99a97fa700 1 -- 172.21.15.78:0/1115269354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000f040 con 0x7f99b406abc0 2023-06-09T11:12:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a40094b0 con 0x7f99b406abc0 2023-06-09T11:12:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99a97fa700 1 -- 172.21.15.78:0/1115269354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0014480 con 0x7f99b406abc0 2023-06-09T11:12:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b406a6a0 con 0x7f99b406abc0 2023-06-09T11:12:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.124+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b406a3c0 con 0x7f99b406abc0 2023-06-09T11:12:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.128+0000 7f99a97fa700 1 -- 172.21.15.78:0/1115269354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99b00145e0 con 0x7f99b406abc0 2023-06-09T11:12:18.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.128+0000 7f99a97fa700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f99a00662f0 0x7f99a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.128+0000 7f99a97fa700 1 -- 172.21.15.78:0/1115269354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99b0084370 con 0x7f99b406abc0 2023-06-09T11:12:18.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.128+0000 7f99abfff700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f99a00662f0 0x7f99a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.132+0000 7f99abfff700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f99a00662f0 0x7f99a00687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f99b40c6f70 tx=0x7f99a4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.136+0000 7f99a97fa700 1 -- 172.21.15.78:0/1115269354 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f99b00517e0 con 0x7f99b406abc0 2023-06-09T11:12:18.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.292+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99b40b40b0 con 0x7f99a00662f0 2023-06-09T11:12:18.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.312+0000 7f99a97fa700 1 -- 172.21.15.78:0/1115269354 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286483 (secure 0 0 0) 0x7f99b40b40b0 con 0x7f99a00662f0 2023-06-09T11:12:18.323 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:18.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f99a00662f0 msgr2=0x7f99a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f99a00662f0 0x7f99a00687a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f99b40c6f70 tx=0x7f99a4010000 comp rx=0 tx=0).stop 2023-06-09T11:12:18.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b406abc0 msgr2=0x7f99b40c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b406abc0 0x7f99b40c7230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99b000efc0 tx=0x7f99b000c3a0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 shutdown_connections 2023-06-09T11:12:18.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f99a00662f0 0x7f99a00687a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b415a4b0 0x7f99b40c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b406e8f0 0x7f99b40c25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 --2- 172.21.15.78:0/1115269354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b406abc0 0x7f99b40c7230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 >> 172.21.15.78:0/1115269354 conn(0x7f99b40b1480 msgr2=0x7f99b40afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:18.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 shutdown_connections 2023-06-09T11:12:18.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.316+0000 7f99baf81700 1 -- 172.21.15.78:0/1115269354 wait complete. 2023-06-09T11:12:18.327 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:12:18.347 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-06-09T11:12:17.607543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66276,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908444,"statfs":{"total":773094113280,"available":773026246656,"internally_reserved":0,"allocated":3182592,"data_stored":1901233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.801061"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838710+0000","last_change":"2023-06-09T11:12:08.821394+0000","last_active":"2023-06-09T11:12:09.838710+0000","last_peered":"2023-06-09T11:12:09.838710+0000","last_clean":"2023-06-09T11:12:09.838710+0000","last_became_active":"2023-06-09T11:12:08.821006+0000","last_became_peered":"2023-06-09T11:12:08.821006+0000","last_unstale":"2023-06-09T11:12:09.838710+0000","last_undegraded":"2023-06-09T11:12:09.838710+0000","last_fullsized":"2023-06-09T11:12:09.838710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823540+0000","last_change":"2023-06-09T11:12:08.838303+0000","last_active":"2023-06-09T11:12:09.823540+0000","last_peered":"2023-06-09T11:12:09.823540+0000","last_clean":"2023-06-09T11:12:09.823540+0000","last_became_active":"2023-06-09T11:12:08.837991+0000","last_became_peered":"2023-06-09T11:12:08.837991+0000","last_unstale":"2023-06-09T11:12:09.823540+0000","last_undegraded":"2023-06-09T11:12:09.823540+0000","last_fullsized":"2023-06-09T11:12:09.823540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824004+0000","last_change":"2023-06-09T11:12:08.839761+0000","last_active":"2023-06-09T11:12:09.824004+0000","last_peered":"2023-06-09T11:12:09.824004+0000","last_clean":"2023-06-09T11:12:09.824004+0000","last_became_active":"2023-06-09T11:12:08.839497+0000","last_became_peered":"2023-06-09T11:12:08.839497+0000","last_unstale":"2023-06-09T11:12:09.824004+0000","last_undegraded":"2023-06-09T11:12:09.824004+0000","last_fullsized":"2023-06-09T11:12:09.824004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.834239+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.833880+0000","last_became_peered":"2023-06-09T11:12:08.833880+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:26:19.609527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140805+0000","last_change":"2023-06-09T11:12:08.820882+0000","last_active":"2023-06-09T11:12:10.140805+0000","last_peered":"2023-06-09T11:12:10.140805+0000","last_clean":"2023-06-09T11:12:10.140805+0000","last_became_active":"2023-06-09T11:12:08.820612+0000","last_became_peered":"2023-06-09T11:12:08.820612+0000","last_unstale":"2023-06-09T11:12:10.140805+0000","last_undegraded":"2023-06-09T11:12:10.140805+0000","last_fullsized":"2023-06-09T11:12:10.140805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822230+0000","last_change":"2023-06-09T11:12:08.827114+0000","last_active":"2023-06-09T11:12:09.822230+0000","last_peered":"2023-06-09T11:12:09.822230+0000","last_clean":"2023-06-09T11:12:09.822230+0000","last_became_active":"2023-06-09T11:12:08.826824+0000","last_became_peered":"2023-06-09T11:12:08.826824+0000","last_unstale":"2023-06-09T11:12:09.822230+0000","last_undegraded":"2023-06-09T11:12:09.822230+0000","last_fullsized":"2023-06-09T11:12:09.822230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845630+0000","last_change":"2023-06-09T11:12:08.843112+0000","last_active":"2023-06-09T11:12:09.845630+0000","last_peered":"2023-06-09T11:12:09.845630+0000","last_clean":"2023-06-09T11:12:09.845630+0000","last_became_active":"2023-06-09T11:12:08.842858+0000","last_became_peered":"2023-06-09T11:12:08.842858+0000","last_unstale":"2023-06-09T11:12:09.845630+0000","last_undegraded":"2023-06-09T11:12:09.845630+0000","last_fullsized":"2023-06-09T11:12:09.845630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822656+0000","last_change":"2023-06-09T11:12:08.830501+0000","last_active":"2023-06-09T11:12:09.822656+0000","last_peered":"2023-06-09T11:12:09.822656+0000","last_clean":"2023-06-09T11:12:09.822656+0000","last_became_active":"2023-06-09T11:12:08.830202+0000","last_became_peered":"2023-06-09T11:12:08.830202+0000","last_unstale":"2023-06-09T11:12:09.822656+0000","last_undegraded":"2023-06-09T11:12:09.822656+0000","last_fullsized":"2023-06-09T11:12:09.822656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140886+0000","last_change":"2023-06-09T11:12:08.828605+0000","last_active":"2023-06-09T11:12:10.140886+0000","last_peered":"2023-06-09T11:12:10.140886+0000","last_clean":"2023-06-09T11:12:10.140886+0000","last_became_active":"2023-06-09T11:12:08.828346+0000","last_became_peered":"2023-06-09T11:12:08.828346+0000","last_unstale":"2023-06-09T11:12:10.140886+0000","last_undegraded":"2023-06-09T11:12:10.140886+0000","last_fullsized":"2023-06-09T11:12:10.140886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823788+0000","last_change":"2023-06-09T11:12:08.838779+0000","last_active":"2023-06-09T11:12:09.823788+0000","last_peered":"2023-06-09T11:12:09.823788+0000","last_clean":"2023-06-09T11:12:09.823788+0000","last_became_active":"2023-06-09T11:12:08.838506+0000","last_became_peered":"2023-06-09T11:12:08.838506+0000","last_unstale":"2023-06-09T11:12:09.823788+0000","last_undegraded":"2023-06-09T11:12:09.823788+0000","last_fullsized":"2023-06-09T11:12:09.823788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824155+0000","last_change":"2023-06-09T11:12:08.827743+0000","last_active":"2023-06-09T11:12:09.824155+0000","last_peered":"2023-06-09T11:12:09.824155+0000","last_clean":"2023-06-09T11:12:09.824155+0000","last_became_active":"2023-06-09T11:12:08.827468+0000","last_became_peered":"2023-06-09T11:12:08.827468+0000","last_unstale":"2023-06-09T11:12:09.824155+0000","last_undegraded":"2023-06-09T11:12:09.824155+0000","last_fullsized":"2023-06-09T11:12:09.824155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:55.115525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.829351+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.829053+0000","last_became_peered":"2023-06-09T11:12:08.829053+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838528+0000","last_change":"2023-06-09T11:12:08.820511+0000","last_active":"2023-06-09T11:12:09.838528+0000","last_peered":"2023-06-09T11:12:09.838528+0000","last_clean":"2023-06-09T11:12:09.838528+0000","last_became_active":"2023-06-09T11:12:08.820231+0000","last_became_peered":"2023-06-09T11:12:08.820231+0000","last_unstale":"2023-06-09T11:12:09.838528+0000","last_undegraded":"2023-06-09T11:12:09.838528+0000","last_fullsized":"2023-06-09T11:12:09.838528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:54:22.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822794+0000","last_change":"2023-06-09T11:12:08.822849+0000","last_active":"2023-06-09T11:12:09.822794+0000","last_peered":"2023-06-09T11:12:09.822794+0000","last_clean":"2023-06-09T11:12:09.822794+0000","last_became_active":"2023-06-09T11:12:08.822563+0000","last_became_peered":"2023-06-09T11:12:08.822563+0000","last_unstale":"2023-06-09T11:12:09.822794+0000","last_undegraded":"2023-06-09T11:12:09.822794+0000","last_fullsized":"2023-06-09T11:12:09.822794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845781+0000","last_change":"2023-06-09T11:12:08.843310+0000","last_active":"2023-06-09T11:12:09.845781+0000","last_peered":"2023-06-09T11:12:09.845781+0000","last_clean":"2023-06-09T11:12:09.845781+0000","last_became_active":"2023-06-09T11:12:08.842999+0000","last_became_peered":"2023-06-09T11:12:08.842999+0000","last_unstale":"2023-06-09T11:12:09.845781+0000","last_undegraded":"2023-06-09T11:12:09.845781+0000","last_fullsized":"2023-06-09T11:12:09.845781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821865+0000","last_change":"2023-06-09T11:12:08.827890+0000","last_active":"2023-06-09T11:12:09.821865+0000","last_peered":"2023-06-09T11:12:09.821865+0000","last_clean":"2023-06-09T11:12:09.821865+0000","last_became_active":"2023-06-09T11:12:08.827592+0000","last_became_peered":"2023-06-09T11:12:08.827592+0000","last_unstale":"2023-06-09T11:12:09.821865+0000","last_undegraded":"2023-06-09T11:12:09.821865+0000","last_fullsized":"2023-06-09T11:12:09.821865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141045+0000","last_change":"2023-06-09T11:12:08.830805+0000","last_active":"2023-06-09T11:12:10.141045+0000","last_peered":"2023-06-09T11:12:10.141045+0000","last_clean":"2023-06-09T11:12:10.141045+0000","last_became_active":"2023-06-09T11:12:08.830542+0000","last_became_peered":"2023-06-09T11:12:08.830542+0000","last_unstale":"2023-06-09T11:12:10.141045+0000","last_undegraded":"2023-06-09T11:12:10.141045+0000","last_fullsized":"2023-06-09T11:12:10.141045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823971+0000","last_change":"2023-06-09T11:12:08.829977+0000","last_active":"2023-06-09T11:12:09.823971+0000","last_peered":"2023-06-09T11:12:09.823971+0000","last_clean":"2023-06-09T11:12:09.823971+0000","last_became_active":"2023-06-09T11:12:08.829646+0000","last_became_peered":"2023-06-09T11:12:08.829646+0000","last_unstale":"2023-06-09T11:12:09.823971+0000","last_undegraded":"2023-06-09T11:12:09.823971+0000","last_fullsized":"2023-06-09T11:12:09.823971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838592+0000","last_change":"2023-06-09T11:12:08.835400+0000","last_active":"2023-06-09T11:12:09.838592+0000","last_peered":"2023-06-09T11:12:09.838592+0000","last_clean":"2023-06-09T11:12:09.838592+0000","last_became_active":"2023-06-09T11:12:08.835057+0000","last_became_peered":"2023-06-09T11:12:08.835057+0000","last_unstale":"2023-06-09T11:12:09.838592+0000","last_undegraded":"2023-06-09T11:12:09.838592+0000","last_fullsized":"2023-06-09T11:12:09.838592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:31:06.835160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823882+0000","last_change":"2023-06-09T11:12:08.834281+0000","last_active":"2023-06-09T11:12:09.823882+0000","last_peered":"2023-06-09T11:12:09.823882+0000","last_clean":"2023-06-09T11:12:09.823882+0000","last_became_active":"2023-06-09T11:12:08.833982+0000","last_became_peered":"2023-06-09T11:12:08.833982+0000","last_unstale":"2023-06-09T11:12:09.823882+0000","last_undegraded":"2023-06-09T11:12:09.823882+0000","last_fullsized":"2023-06-09T11:12:09.823882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846062+0000","last_change":"2023-06-09T11:12:08.844527+0000","last_active":"2023-06-09T11:12:09.846062+0000","last_peered":"2023-06-09T11:12:09.846062+0000","last_clean":"2023-06-09T11:12:09.846062+0000","last_became_active":"2023-06-09T11:12:08.843678+0000","last_became_peered":"2023-06-09T11:12:08.843678+0000","last_unstale":"2023-06-09T11:12:09.846062+0000","last_undegraded":"2023-06-09T11:12:09.846062+0000","last_fullsized":"2023-06-09T11:12:09.846062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140195+0000","last_change":"2023-06-09T11:12:08.838192+0000","last_active":"2023-06-09T11:12:10.140195+0000","last_peered":"2023-06-09T11:12:10.140195+0000","last_clean":"2023-06-09T11:12:10.140195+0000","last_became_active":"2023-06-09T11:12:08.837602+0000","last_became_peered":"2023-06-09T11:12:08.837602+0000","last_unstale":"2023-06-09T11:12:10.140195+0000","last_undegraded":"2023-06-09T11:12:10.140195+0000","last_fullsized":"2023-06-09T11:12:10.140195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819267+0000","last_change":"2023-06-09T11:12:08.827140+0000","last_active":"2023-06-09T11:12:09.819267+0000","last_peered":"2023-06-09T11:12:09.819267+0000","last_clean":"2023-06-09T11:12:09.819267+0000","last_became_active":"2023-06-09T11:12:08.826856+0000","last_became_peered":"2023-06-09T11:12:08.826856+0000","last_unstale":"2023-06-09T11:12:09.819267+0000","last_undegraded":"2023-06-09T11:12:09.819267+0000","last_fullsized":"2023-06-09T11:12:09.819267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846005+0000","last_change":"2023-06-09T11:12:08.845240+0000","last_active":"2023-06-09T11:12:09.846005+0000","last_peered":"2023-06-09T11:12:09.846005+0000","last_clean":"2023-06-09T11:12:09.846005+0000","last_became_active":"2023-06-09T11:12:08.844410+0000","last_became_peered":"2023-06-09T11:12:08.844410+0000","last_unstale":"2023-06-09T11:12:09.846005+0000","last_undegraded":"2023-06-09T11:12:09.846005+0000","last_fullsized":"2023-06-09T11:12:09.846005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849751+0000","last_change":"2023-06-09T11:12:08.837911+0000","last_active":"2023-06-09T11:12:09.849751+0000","last_peered":"2023-06-09T11:12:09.849751+0000","last_clean":"2023-06-09T11:12:09.849751+0000","last_became_active":"2023-06-09T11:12:08.837627+0000","last_became_peered":"2023-06-09T11:12:08.837627+0000","last_unstale":"2023-06-09T11:12:09.849751+0000","last_undegraded":"2023-06-09T11:12:09.849751+0000","last_fullsized":"2023-06-09T11:12:09.849751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849808+0000","last_change":"2023-06-09T11:12:08.834539+0000","last_active":"2023-06-09T11:12:09.849808+0000","last_peered":"2023-06-09T11:12:09.849808+0000","last_clean":"2023-06-09T11:12:09.849808+0000","last_became_active":"2023-06-09T11:12:08.834197+0000","last_became_peered":"2023-06-09T11:12:08.834197+0000","last_unstale":"2023-06-09T11:12:09.849808+0000","last_undegraded":"2023-06-09T11:12:09.849808+0000","last_fullsized":"2023-06-09T11:12:09.849808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823239+0000","last_change":"2023-06-09T11:12:08.839682+0000","last_active":"2023-06-09T11:12:09.823239+0000","last_peered":"2023-06-09T11:12:09.823239+0000","last_clean":"2023-06-09T11:12:09.823239+0000","last_became_active":"2023-06-09T11:12:08.838961+0000","last_became_peered":"2023-06-09T11:12:08.838961+0000","last_unstale":"2023-06-09T11:12:09.823239+0000","last_undegraded":"2023-06-09T11:12:09.823239+0000","last_fullsized":"2023-06-09T11:12:09.823239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849236+0000","last_change":"2023-06-09T11:12:08.846811+0000","last_active":"2023-06-09T11:12:09.849236+0000","last_peered":"2023-06-09T11:12:09.849236+0000","last_clean":"2023-06-09T11:12:09.849236+0000","last_became_active":"2023-06-09T11:12:08.846391+0000","last_became_peered":"2023-06-09T11:12:08.846391+0000","last_unstale":"2023-06-09T11:12:09.849236+0000","last_undegraded":"2023-06-09T11:12:09.849236+0000","last_fullsized":"2023-06-09T11:12:09.849236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819649+0000","last_change":"2023-06-09T11:12:08.838865+0000","last_active":"2023-06-09T11:12:09.819649+0000","last_peered":"2023-06-09T11:12:09.819649+0000","last_clean":"2023-06-09T11:12:09.819649+0000","last_became_active":"2023-06-09T11:12:08.838587+0000","last_became_peered":"2023-06-09T11:12:08.838587+0000","last_unstale":"2023-06-09T11:12:09.819649+0000","last_undegraded":"2023-06-09T11:12:09.819649+0000","last_fullsized":"2023-06-09T11:12:09.819649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822571+0000","last_change":"2023-06-09T11:12:08.832860+0000","last_active":"2023-06-09T11:12:09.822571+0000","last_peered":"2023-06-09T11:12:09.822571+0000","last_clean":"2023-06-09T11:12:09.822571+0000","last_became_active":"2023-06-09T11:12:08.832580+0000","last_became_peered":"2023-06-09T11:12:08.832580+0000","last_unstale":"2023-06-09T11:12:09.822571+0000","last_undegraded":"2023-06-09T11:12:09.822571+0000","last_fullsized":"2023-06-09T11:12:09.822571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819165+0000","last_change":"2023-06-09T11:12:08.839816+0000","last_active":"2023-06-09T11:12:09.819165+0000","last_peered":"2023-06-09T11:12:09.819165+0000","last_clean":"2023-06-09T11:12:09.819165+0000","last_became_active":"2023-06-09T11:12:08.839381+0000","last_became_peered":"2023-06-09T11:12:08.839381+0000","last_unstale":"2023-06-09T11:12:09.819165+0000","last_undegraded":"2023-06-09T11:12:09.819165+0000","last_fullsized":"2023-06-09T11:12:09.819165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138744+0000","last_change":"2023-06-09T11:12:08.833196+0000","last_active":"2023-06-09T11:12:10.138744+0000","last_peered":"2023-06-09T11:12:10.138744+0000","last_clean":"2023-06-09T11:12:10.138744+0000","last_became_active":"2023-06-09T11:12:08.832913+0000","last_became_peered":"2023-06-09T11:12:08.832913+0000","last_unstale":"2023-06-09T11:12:10.138744+0000","last_undegraded":"2023-06-09T11:12:10.138744+0000","last_fullsized":"2023-06-09T11:12:10.138744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820004+0000","last_change":"2023-06-09T11:12:08.839962+0000","last_active":"2023-06-09T11:12:09.820004+0000","last_peered":"2023-06-09T11:12:09.820004+0000","last_clean":"2023-06-09T11:12:09.820004+0000","last_became_active":"2023-06-09T11:12:08.839675+0000","last_became_peered":"2023-06-09T11:12:08.839675+0000","last_unstale":"2023-06-09T11:12:09.820004+0000","last_undegraded":"2023-06-09T11:12:09.820004+0000","last_fullsized":"2023-06-09T11:12:09.820004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846303+0000","last_change":"2023-06-09T11:12:08.283296+0000","last_active":"2023-06-09T11:12:09.846303+0000","last_peered":"2023-06-09T11:12:09.846303+0000","last_clean":"2023-06-09T11:12:09.846303+0000","last_became_active":"2023-06-09T11:12:08.282947+0000","last_became_peered":"2023-06-09T11:12:08.282947+0000","last_unstale":"2023-06-09T11:12:09.846303+0000","last_undegraded":"2023-06-09T11:12:09.846303+0000","last_fullsized":"2023-06-09T11:12:09.846303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823280+0000","last_change":"2023-06-09T11:12:08.839863+0000","last_active":"2023-06-09T11:12:09.823280+0000","last_peered":"2023-06-09T11:12:09.823280+0000","last_clean":"2023-06-09T11:12:09.823280+0000","last_became_active":"2023-06-09T11:12:08.839412+0000","last_became_peered":"2023-06-09T11:12:08.839412+0000","last_unstale":"2023-06-09T11:12:09.823280+0000","last_undegraded":"2023-06-09T11:12:09.823280+0000","last_fullsized":"2023-06-09T11:12:09.823280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140262+0000","last_change":"2023-06-09T11:12:08.282887+0000","last_active":"2023-06-09T11:12:10.140262+0000","last_peered":"2023-06-09T11:12:10.140262+0000","last_clean":"2023-06-09T11:12:10.140262+0000","last_became_active":"2023-06-09T11:12:08.282019+0000","last_became_peered":"2023-06-09T11:12:08.282019+0000","last_unstale":"2023-06-09T11:12:10.140262+0000","last_undegraded":"2023-06-09T11:12:10.140262+0000","last_fullsized":"2023-06-09T11:12:10.140262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141115+0000","last_change":"2023-06-09T11:12:08.826851+0000","last_active":"2023-06-09T11:12:10.141115+0000","last_peered":"2023-06-09T11:12:10.141115+0000","last_clean":"2023-06-09T11:12:10.141115+0000","last_became_active":"2023-06-09T11:12:08.826485+0000","last_became_peered":"2023-06-09T11:12:08.826485+0000","last_unstale":"2023-06-09T11:12:10.141115+0000","last_undegraded":"2023-06-09T11:12:10.141115+0000","last_fullsized":"2023-06-09T11:12:10.141115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845892+0000","last_change":"2023-06-09T11:12:08.287775+0000","last_active":"2023-06-09T11:12:09.845892+0000","last_peered":"2023-06-09T11:12:09.845892+0000","last_clean":"2023-06-09T11:12:09.845892+0000","last_became_active":"2023-06-09T11:12:08.287415+0000","last_became_peered":"2023-06-09T11:12:08.287415+0000","last_unstale":"2023-06-09T11:12:09.845892+0000","last_undegraded":"2023-06-09T11:12:09.845892+0000","last_fullsized":"2023-06-09T11:12:09.845892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819886+0000","last_change":"2023-06-09T11:12:08.845899+0000","last_active":"2023-06-09T11:12:09.819886+0000","last_peered":"2023-06-09T11:12:09.819886+0000","last_clean":"2023-06-09T11:12:09.819886+0000","last_became_active":"2023-06-09T11:12:08.845497+0000","last_became_peered":"2023-06-09T11:12:08.845497+0000","last_unstale":"2023-06-09T11:12:09.819886+0000","last_undegraded":"2023-06-09T11:12:09.819886+0000","last_fullsized":"2023-06-09T11:12:09.819886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139028+0000","last_change":"2023-06-09T11:12:08.283802+0000","last_active":"2023-06-09T11:12:10.139028+0000","last_peered":"2023-06-09T11:12:10.139028+0000","last_clean":"2023-06-09T11:12:10.139028+0000","last_became_active":"2023-06-09T11:12:08.283417+0000","last_became_peered":"2023-06-09T11:12:08.283417+0000","last_unstale":"2023-06-09T11:12:10.139028+0000","last_undegraded":"2023-06-09T11:12:10.139028+0000","last_fullsized":"2023-06-09T11:12:10.139028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:56.322140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846310+0000","last_change":"2023-06-09T11:12:08.287954+0000","last_active":"2023-06-09T11:12:09.846310+0000","last_peered":"2023-06-09T11:12:09.846310+0000","last_clean":"2023-06-09T11:12:09.846310+0000","last_became_active":"2023-06-09T11:12:08.287641+0000","last_became_peered":"2023-06-09T11:12:08.287641+0000","last_unstale":"2023-06-09T11:12:09.846310+0000","last_undegraded":"2023-06-09T11:12:09.846310+0000","last_fullsized":"2023-06-09T11:12:09.846310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:52.398335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822883+0000","last_change":"2023-06-09T11:12:08.838149+0000","last_active":"2023-06-09T11:12:09.822883+0000","last_peered":"2023-06-09T11:12:09.822883+0000","last_clean":"2023-06-09T11:12:09.822883+0000","last_became_active":"2023-06-09T11:12:08.837839+0000","last_became_peered":"2023-06-09T11:12:08.837839+0000","last_unstale":"2023-06-09T11:12:09.822883+0000","last_undegraded":"2023-06-09T11:12:09.822883+0000","last_fullsized":"2023-06-09T11:12:09.822883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846359+0000","last_change":"2023-06-09T11:12:08.287833+0000","last_active":"2023-06-09T11:12:09.846359+0000","last_peered":"2023-06-09T11:12:09.846359+0000","last_clean":"2023-06-09T11:12:09.846359+0000","last_became_active":"2023-06-09T11:12:08.287474+0000","last_became_peered":"2023-06-09T11:12:08.287474+0000","last_unstale":"2023-06-09T11:12:09.846359+0000","last_undegraded":"2023-06-09T11:12:09.846359+0000","last_fullsized":"2023-06-09T11:12:09.846359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:54.101444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821934+0000","last_change":"2023-06-09T11:12:08.840471+0000","last_active":"2023-06-09T11:12:09.821934+0000","last_peered":"2023-06-09T11:12:09.821934+0000","last_clean":"2023-06-09T11:12:09.821934+0000","last_became_active":"2023-06-09T11:12:08.840152+0000","last_became_peered":"2023-06-09T11:12:08.840152+0000","last_unstale":"2023-06-09T11:12:09.821934+0000","last_undegraded":"2023-06-09T11:12:09.821934+0000","last_fullsized":"2023-06-09T11:12:09.821934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846498+0000","last_change":"2023-06-09T11:12:08.280882+0000","last_active":"2023-06-09T11:12:09.846498+0000","last_peered":"2023-06-09T11:12:09.846498+0000","last_clean":"2023-06-09T11:12:09.846498+0000","last_became_active":"2023-06-09T11:12:08.280608+0000","last_became_peered":"2023-06-09T11:12:08.280608+0000","last_unstale":"2023-06-09T11:12:09.846498+0000","last_undegraded":"2023-06-09T11:12:09.846498+0000","last_fullsized":"2023-06-09T11:12:09.846498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:45:50.994443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138982+0000","last_change":"2023-06-09T11:12:08.835473+0000","last_active":"2023-06-09T11:12:10.138982+0000","last_peered":"2023-06-09T11:12:10.138982+0000","last_clean":"2023-06-09T11:12:10.138982+0000","last_became_active":"2023-06-09T11:12:08.835014+0000","last_became_peered":"2023-06-09T11:12:08.835014+0000","last_unstale":"2023-06-09T11:12:10.138982+0000","last_undegraded":"2023-06-09T11:12:10.138982+0000","last_fullsized":"2023-06-09T11:12:10.138982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823071+0000","last_change":"2023-06-09T11:12:08.286293+0000","last_active":"2023-06-09T11:12:09.823071+0000","last_peered":"2023-06-09T11:12:09.823071+0000","last_clean":"2023-06-09T11:12:09.823071+0000","last_became_active":"2023-06-09T11:12:08.283192+0000","last_became_peered":"2023-06-09T11:12:08.283192+0000","last_unstale":"2023-06-09T11:12:09.823071+0000","last_undegraded":"2023-06-09T11:12:09.823071+0000","last_fullsized":"2023-06-09T11:12:09.823071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140609+0000","last_change":"2023-06-09T11:12:08.831394+0000","last_active":"2023-06-09T11:12:10.140609+0000","last_peered":"2023-06-09T11:12:10.140609+0000","last_clean":"2023-06-09T11:12:10.140609+0000","last_became_active":"2023-06-09T11:12:08.829941+0000","last_became_peered":"2023-06-09T11:12:08.829941+0000","last_unstale":"2023-06-09T11:12:10.140609+0000","last_undegraded":"2023-06-09T11:12:10.140609+0000","last_fullsized":"2023-06-09T11:12:10.140609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819914+0000","last_change":"2023-06-09T11:12:08.288840+0000","last_active":"2023-06-09T11:12:09.819914+0000","last_peered":"2023-06-09T11:12:09.819914+0000","last_clean":"2023-06-09T11:12:09.819914+0000","last_became_active":"2023-06-09T11:12:08.287719+0000","last_became_peered":"2023-06-09T11:12:08.287719+0000","last_unstale":"2023-06-09T11:12:09.819914+0000","last_undegraded":"2023-06-09T11:12:09.819914+0000","last_fullsized":"2023-06-09T11:12:09.819914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823893+0000","last_change":"2023-06-09T11:12:08.828760+0000","last_active":"2023-06-09T11:12:09.823893+0000","last_peered":"2023-06-09T11:12:09.823893+0000","last_clean":"2023-06-09T11:12:09.823893+0000","last_became_active":"2023-06-09T11:12:08.828324+0000","last_became_peered":"2023-06-09T11:12:08.828324+0000","last_unstale":"2023-06-09T11:12:09.823893+0000","last_undegraded":"2023-06-09T11:12:09.823893+0000","last_fullsized":"2023-06-09T11:12:09.823893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:05.017896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139097+0000","last_change":"2023-06-09T11:12:08.283200+0000","last_active":"2023-06-09T11:12:10.139097+0000","last_peered":"2023-06-09T11:12:10.139097+0000","last_clean":"2023-06-09T11:12:10.139097+0000","last_became_active":"2023-06-09T11:12:08.282863+0000","last_became_peered":"2023-06-09T11:12:08.282863+0000","last_unstale":"2023-06-09T11:12:10.139097+0000","last_undegraded":"2023-06-09T11:12:10.139097+0000","last_fullsized":"2023-06-09T11:12:10.139097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:41:59.540044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824104+0000","last_change":"2023-06-09T11:12:08.828410+0000","last_active":"2023-06-09T11:12:09.824104+0000","last_peered":"2023-06-09T11:12:09.824104+0000","last_clean":"2023-06-09T11:12:09.824104+0000","last_became_active":"2023-06-09T11:12:08.828040+0000","last_became_peered":"2023-06-09T11:12:08.828040+0000","last_unstale":"2023-06-09T11:12:09.824104+0000","last_undegraded":"2023-06-09T11:12:09.824104+0000","last_fullsized":"2023-06-09T11:12:09.824104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:53.412417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822247+0000","last_change":"2023-06-09T11:12:08.268559+0000","last_active":"2023-06-09T11:12:09.822247+0000","last_peered":"2023-06-09T11:12:09.822247+0000","last_clean":"2023-06-09T11:12:09.822247+0000","last_became_active":"2023-06-09T11:12:08.268123+0000","last_became_peered":"2023-06-09T11:12:08.268123+0000","last_unstale":"2023-06-09T11:12:09.822247+0000","last_undegraded":"2023-06-09T11:12:09.822247+0000","last_fullsized":"2023-06-09T11:12:09.822247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824133+0000","last_change":"2023-06-09T11:12:08.829627+0000","last_active":"2023-06-09T11:12:09.824133+0000","last_peered":"2023-06-09T11:12:09.824133+0000","last_clean":"2023-06-09T11:12:09.824133+0000","last_became_active":"2023-06-09T11:12:08.829295+0000","last_became_peered":"2023-06-09T11:12:08.829295+0000","last_unstale":"2023-06-09T11:12:09.824133+0000","last_undegraded":"2023-06-09T11:12:09.824133+0000","last_fullsized":"2023-06-09T11:12:09.824133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:59.109592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819581+0000","last_change":"2023-06-09T11:12:08.286883+0000","last_active":"2023-06-09T11:12:09.819581+0000","last_peered":"2023-06-09T11:12:09.819581+0000","last_clean":"2023-06-09T11:12:09.819581+0000","last_became_active":"2023-06-09T11:12:08.283053+0000","last_became_peered":"2023-06-09T11:12:08.283053+0000","last_unstale":"2023-06-09T11:12:09.819581+0000","last_undegraded":"2023-06-09T11:12:09.819581+0000","last_fullsized":"2023-06-09T11:12:09.819581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849756+0000","last_change":"2023-06-09T11:12:08.840789+0000","last_active":"2023-06-09T11:12:09.849756+0000","last_peered":"2023-06-09T11:12:09.849756+0000","last_clean":"2023-06-09T11:12:09.849756+0000","last_became_active":"2023-06-09T11:12:08.840180+0000","last_became_peered":"2023-06-09T11:12:08.840180+0000","last_unstale":"2023-06-09T11:12:09.849756+0000","last_undegraded":"2023-06-09T11:12:09.849756+0000","last_fullsized":"2023-06-09T11:12:09.849756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845858+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:12:09.845858+0000","last_peered":"2023-06-09T11:12:09.845858+0000","last_clean":"2023-06-09T11:12:09.845858+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:12:09.845858+0000","last_undegraded":"2023-06-09T11:12:09.845858+0000","last_fullsized":"2023-06-09T11:12:09.845858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:26.915763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823010+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:12:09.823010+0000","last_peered":"2023-06-09T11:12:09.823010+0000","last_clean":"2023-06-09T11:12:09.823010+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:12:09.823010+0000","last_undegraded":"2023-06-09T11:12:09.823010+0000","last_fullsized":"2023-06-09T11:12:09.823010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:07.747592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820178+0000","last_change":"2023-06-09T11:12:08.274664+0000","last_active":"2023-06-09T11:12:09.820178+0000","last_peered":"2023-06-09T11:12:09.820178+0000","last_clean":"2023-06-09T11:12:09.820178+0000","last_became_active":"2023-06-09T11:12:08.274254+0000","last_became_peered":"2023-06-09T11:12:08.274254+0000","last_unstale":"2023-06-09T11:12:09.820178+0000","last_undegraded":"2023-06-09T11:12:09.820178+0000","last_fullsized":"2023-06-09T11:12:09.820178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:38.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139313+0000","last_change":"2023-06-09T11:12:08.833072+0000","last_active":"2023-06-09T11:12:10.139313+0000","last_peered":"2023-06-09T11:12:10.139313+0000","last_clean":"2023-06-09T11:12:10.139313+0000","last_became_active":"2023-06-09T11:12:08.832494+0000","last_became_peered":"2023-06-09T11:12:08.832494+0000","last_unstale":"2023-06-09T11:12:10.139313+0000","last_undegraded":"2023-06-09T11:12:10.139313+0000","last_fullsized":"2023-06-09T11:12:10.139313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:49.564145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845511+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:12:09.845511+0000","last_peered":"2023-06-09T11:12:09.845511+0000","last_clean":"2023-06-09T11:12:09.845511+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:12:09.845511+0000","last_undegraded":"2023-06-09T11:12:09.845511+0000","last_fullsized":"2023-06-09T11:12:09.845511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:16.600288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140167+0000","last_change":"2023-06-09T11:12:08.288683+0000","last_active":"2023-06-09T11:12:10.140167+0000","last_peered":"2023-06-09T11:12:10.140167+0000","last_clean":"2023-06-09T11:12:10.140167+0000","last_became_active":"2023-06-09T11:12:08.288403+0000","last_became_peered":"2023-06-09T11:12:08.288403+0000","last_unstale":"2023-06-09T11:12:10.140167+0000","last_undegraded":"2023-06-09T11:12:10.140167+0000","last_fullsized":"2023-06-09T11:12:10.140167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:48.550064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140943+0000","last_change":"2023-06-09T11:12:08.835534+0000","last_active":"2023-06-09T11:12:10.140943+0000","last_peered":"2023-06-09T11:12:10.140943+0000","last_clean":"2023-06-09T11:12:10.140943+0000","last_became_active":"2023-06-09T11:12:08.835265+0000","last_became_peered":"2023-06-09T11:12:08.835265+0000","last_unstale":"2023-06-09T11:12:10.140943+0000","last_undegraded":"2023-06-09T11:12:10.140943+0000","last_fullsized":"2023-06-09T11:12:10.140943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838427+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:12:09.838427+0000","last_peered":"2023-06-09T11:12:09.838427+0000","last_clean":"2023-06-09T11:12:09.838427+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:12:09.838427+0000","last_undegraded":"2023-06-09T11:12:09.838427+0000","last_fullsized":"2023-06-09T11:12:09.838427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:17:15.668229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848689+0000","last_change":"2023-06-09T11:12:08.284371+0000","last_active":"2023-06-09T11:12:09.848689+0000","last_peered":"2023-06-09T11:12:09.848689+0000","last_clean":"2023-06-09T11:12:09.848689+0000","last_became_active":"2023-06-09T11:12:08.284025+0000","last_became_peered":"2023-06-09T11:12:08.284025+0000","last_unstale":"2023-06-09T11:12:09.848689+0000","last_undegraded":"2023-06-09T11:12:09.848689+0000","last_fullsized":"2023-06-09T11:12:09.848689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:17.551253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849884+0000","last_change":"2023-06-09T11:12:08.843683+0000","last_active":"2023-06-09T11:12:09.849884+0000","last_peered":"2023-06-09T11:12:09.849884+0000","last_clean":"2023-06-09T11:12:09.849884+0000","last_became_active":"2023-06-09T11:12:08.843390+0000","last_became_peered":"2023-06-09T11:12:08.843390+0000","last_unstale":"2023-06-09T11:12:09.849884+0000","last_undegraded":"2023-06-09T11:12:09.849884+0000","last_fullsized":"2023-06-09T11:12:09.849884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822778+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:12:09.822778+0000","last_peered":"2023-06-09T11:12:09.822778+0000","last_clean":"2023-06-09T11:12:09.822778+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:12:09.822778+0000","last_undegraded":"2023-06-09T11:12:09.822778+0000","last_fullsized":"2023-06-09T11:12:09.822778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:21.222898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823463+0000","last_change":"2023-06-09T11:12:08.285595+0000","last_active":"2023-06-09T11:12:09.823463+0000","last_peered":"2023-06-09T11:12:09.823463+0000","last_clean":"2023-06-09T11:12:09.823463+0000","last_became_active":"2023-06-09T11:12:08.285164+0000","last_became_peered":"2023-06-09T11:12:08.285164+0000","last_unstale":"2023-06-09T11:12:09.823463+0000","last_undegraded":"2023-06-09T11:12:09.823463+0000","last_fullsized":"2023-06-09T11:12:09.823463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849103+0000","last_change":"2023-06-09T11:12:08.834527+0000","last_active":"2023-06-09T11:12:09.849103+0000","last_peered":"2023-06-09T11:12:09.849103+0000","last_clean":"2023-06-09T11:12:09.849103+0000","last_became_active":"2023-06-09T11:12:08.834243+0000","last_became_peered":"2023-06-09T11:12:08.834243+0000","last_unstale":"2023-06-09T11:12:09.849103+0000","last_undegraded":"2023-06-09T11:12:09.849103+0000","last_fullsized":"2023-06-09T11:12:09.849103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823400+0000","last_change":"2023-06-09T11:12:08.286284+0000","last_active":"2023-06-09T11:12:09.823400+0000","last_peered":"2023-06-09T11:12:09.823400+0000","last_clean":"2023-06-09T11:12:09.823400+0000","last_became_active":"2023-06-09T11:12:08.282889+0000","last_became_peered":"2023-06-09T11:12:08.282889+0000","last_unstale":"2023-06-09T11:12:09.823400+0000","last_undegraded":"2023-06-09T11:12:09.823400+0000","last_fullsized":"2023-06-09T11:12:09.823400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849294+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:12:09.849294+0000","last_peered":"2023-06-09T11:12:09.849294+0000","last_clean":"2023-06-09T11:12:09.849294+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:12:09.849294+0000","last_undegraded":"2023-06-09T11:12:09.849294+0000","last_fullsized":"2023-06-09T11:12:09.849294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:38.034603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848923+0000","last_change":"2023-06-09T11:12:08.843701+0000","last_active":"2023-06-09T11:12:09.848923+0000","last_peered":"2023-06-09T11:12:09.848923+0000","last_clean":"2023-06-09T11:12:09.848923+0000","last_became_active":"2023-06-09T11:12:08.843450+0000","last_became_peered":"2023-06-09T11:12:08.843450+0000","last_unstale":"2023-06-09T11:12:09.848923+0000","last_undegraded":"2023-06-09T11:12:09.848923+0000","last_fullsized":"2023-06-09T11:12:09.848923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849032+0000","last_change":"2023-06-09T11:12:08.284028+0000","last_active":"2023-06-09T11:12:09.849032+0000","last_peered":"2023-06-09T11:12:09.849032+0000","last_clean":"2023-06-09T11:12:09.849032+0000","last_became_active":"2023-06-09T11:12:08.283697+0000","last_became_peered":"2023-06-09T11:12:08.283697+0000","last_unstale":"2023-06-09T11:12:09.849032+0000","last_undegraded":"2023-06-09T11:12:09.849032+0000","last_fullsized":"2023-06-09T11:12:09.849032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846609+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:12:09.846609+0000","last_peered":"2023-06-09T11:12:09.846609+0000","last_clean":"2023-06-09T11:12:09.846609+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:12:09.846609+0000","last_undegraded":"2023-06-09T11:12:09.846609+0000","last_fullsized":"2023-06-09T11:12:09.846609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:02.343312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140533+0000","last_change":"2023-06-09T11:12:08.840903+0000","last_active":"2023-06-09T11:12:10.140533+0000","last_peered":"2023-06-09T11:12:10.140533+0000","last_clean":"2023-06-09T11:12:10.140533+0000","last_became_active":"2023-06-09T11:12:08.840625+0000","last_became_peered":"2023-06-09T11:12:08.840625+0000","last_unstale":"2023-06-09T11:12:10.140533+0000","last_undegraded":"2023-06-09T11:12:10.140533+0000","last_fullsized":"2023-06-09T11:12:10.140533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820155+0000","last_change":"2023-06-09T11:12:08.282096+0000","last_active":"2023-06-09T11:12:09.820155+0000","last_peered":"2023-06-09T11:12:09.820155+0000","last_clean":"2023-06-09T11:12:09.820155+0000","last_became_active":"2023-06-09T11:12:08.281746+0000","last_became_peered":"2023-06-09T11:12:08.281746+0000","last_unstale":"2023-06-09T11:12:09.820155+0000","last_undegraded":"2023-06-09T11:12:09.820155+0000","last_fullsized":"2023-06-09T11:12:09.820155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849748+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:12:09.849748+0000","last_peered":"2023-06-09T11:12:09.849748+0000","last_clean":"2023-06-09T11:12:09.849748+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:12:09.849748+0000","last_undegraded":"2023-06-09T11:12:09.849748+0000","last_fullsized":"2023-06-09T11:12:09.849748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:50:58.945136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819086+0000","last_change":"2023-06-09T11:12:08.838416+0000","last_active":"2023-06-09T11:12:09.819086+0000","last_peered":"2023-06-09T11:12:09.819086+0000","last_clean":"2023-06-09T11:12:09.819086+0000","last_became_active":"2023-06-09T11:12:08.838099+0000","last_became_peered":"2023-06-09T11:12:08.838099+0000","last_unstale":"2023-06-09T11:12:09.819086+0000","last_undegraded":"2023-06-09T11:12:09.819086+0000","last_fullsized":"2023-06-09T11:12:09.819086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:18.012644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.659542+0000","last_change":"2023-06-09T11:12:08.284961+0000","last_active":"2023-06-09T11:12:10.659542+0000","last_peered":"2023-06-09T11:12:10.659542+0000","last_clean":"2023-06-09T11:12:10.659542+0000","last_became_active":"2023-06-09T11:12:08.281299+0000","last_became_peered":"2023-06-09T11:12:08.281299+0000","last_unstale":"2023-06-09T11:12:10.659542+0000","last_undegraded":"2023-06-09T11:12:10.659542+0000","last_fullsized":"2023-06-09T11:12:10.659542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:21.658968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139133+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:12:10.139133+0000","last_peered":"2023-06-09T11:12:10.139133+0000","last_clean":"2023-06-09T11:12:10.139133+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:12:10.139133+0000","last_undegraded":"2023-06-09T11:12:10.139133+0000","last_fullsized":"2023-06-09T11:12:10.139133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:39:06.854929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822149+0000","last_change":"2023-06-09T11:12:08.839244+0000","last_active":"2023-06-09T11:12:09.822149+0000","last_peered":"2023-06-09T11:12:09.822149+0000","last_clean":"2023-06-09T11:12:09.822149+0000","last_became_active":"2023-06-09T11:12:08.838923+0000","last_became_peered":"2023-06-09T11:12:08.838923+0000","last_unstale":"2023-06-09T11:12:09.822149+0000","last_undegraded":"2023-06-09T11:12:09.822149+0000","last_fullsized":"2023-06-09T11:12:09.822149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823299+0000","last_change":"2023-06-09T11:12:08.833132+0000","last_active":"2023-06-09T11:12:09.823299+0000","last_peered":"2023-06-09T11:12:09.823299+0000","last_clean":"2023-06-09T11:12:09.823299+0000","last_became_active":"2023-06-09T11:12:08.832882+0000","last_became_peered":"2023-06-09T11:12:08.832882+0000","last_unstale":"2023-06-09T11:12:09.823299+0000","last_undegraded":"2023-06-09T11:12:09.823299+0000","last_fullsized":"2023-06-09T11:12:09.823299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824098+0000","last_change":"2023-06-09T11:12:08.275292+0000","last_active":"2023-06-09T11:12:09.824098+0000","last_peered":"2023-06-09T11:12:09.824098+0000","last_clean":"2023-06-09T11:12:09.824098+0000","last_became_active":"2023-06-09T11:12:08.274936+0000","last_became_peered":"2023-06-09T11:12:08.274936+0000","last_unstale":"2023-06-09T11:12:09.824098+0000","last_undegraded":"2023-06-09T11:12:09.824098+0000","last_fullsized":"2023-06-09T11:12:09.824098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848668+0000","last_change":"2023-06-09T11:12:08.835600+0000","last_active":"2023-06-09T11:12:09.848668+0000","last_peered":"2023-06-09T11:12:09.848668+0000","last_clean":"2023-06-09T11:12:09.848668+0000","last_became_active":"2023-06-09T11:12:08.835304+0000","last_became_peered":"2023-06-09T11:12:08.835304+0000","last_unstale":"2023-06-09T11:12:09.848668+0000","last_undegraded":"2023-06-09T11:12:09.848668+0000","last_fullsized":"2023-06-09T11:12:09.848668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846324+0000","last_change":"2023-06-09T11:12:08.288784+0000","last_active":"2023-06-09T11:12:09.846324+0000","last_peered":"2023-06-09T11:12:09.846324+0000","last_clean":"2023-06-09T11:12:09.846324+0000","last_became_active":"2023-06-09T11:12:08.288524+0000","last_became_peered":"2023-06-09T11:12:08.288524+0000","last_unstale":"2023-06-09T11:12:09.846324+0000","last_undegraded":"2023-06-09T11:12:09.846324+0000","last_fullsized":"2023-06-09T11:12:09.846324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:58.095511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823908+0000","last_change":"2023-06-09T11:12:08.279785+0000","last_active":"2023-06-09T11:12:09.823908+0000","last_peered":"2023-06-09T11:12:09.823908+0000","last_clean":"2023-06-09T11:12:09.823908+0000","last_became_active":"2023-06-09T11:12:08.279392+0000","last_became_peered":"2023-06-09T11:12:08.279392+0000","last_unstale":"2023-06-09T11:12:09.823908+0000","last_undegraded":"2023-06-09T11:12:09.823908+0000","last_fullsized":"2023-06-09T11:12:09.823908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:44.593553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819358+0000","last_change":"2023-06-09T11:12:08.845707+0000","last_active":"2023-06-09T11:12:09.819358+0000","last_peered":"2023-06-09T11:12:09.819358+0000","last_clean":"2023-06-09T11:12:09.819358+0000","last_became_active":"2023-06-09T11:12:08.845389+0000","last_became_peered":"2023-06-09T11:12:08.845389+0000","last_unstale":"2023-06-09T11:12:09.819358+0000","last_undegraded":"2023-06-09T11:12:09.819358+0000","last_fullsized":"2023-06-09T11:12:09.819358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141311+0000","last_change":"2023-06-09T11:12:08.281454+0000","last_active":"2023-06-09T11:12:10.141311+0000","last_peered":"2023-06-09T11:12:10.141311+0000","last_clean":"2023-06-09T11:12:10.141311+0000","last_became_active":"2023-06-09T11:12:08.280712+0000","last_became_peered":"2023-06-09T11:12:08.280712+0000","last_unstale":"2023-06-09T11:12:10.141311+0000","last_undegraded":"2023-06-09T11:12:10.141311+0000","last_fullsized":"2023-06-09T11:12:10.141311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819053+0000","last_change":"2023-06-09T11:12:08.840190+0000","last_active":"2023-06-09T11:12:09.819053+0000","last_peered":"2023-06-09T11:12:09.819053+0000","last_clean":"2023-06-09T11:12:09.819053+0000","last_became_active":"2023-06-09T11:12:08.839207+0000","last_became_peered":"2023-06-09T11:12:08.839207+0000","last_unstale":"2023-06-09T11:12:09.819053+0000","last_undegraded":"2023-06-09T11:12:09.819053+0000","last_fullsized":"2023-06-09T11:12:09.819053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.842234+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.841945+0000","last_became_peered":"2023-06-09T11:12:08.841945+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:45.639089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819318+0000","last_change":"2023-06-09T11:12:08.287948+0000","last_active":"2023-06-09T11:12:09.819318+0000","last_peered":"2023-06-09T11:12:09.819318+0000","last_clean":"2023-06-09T11:12:09.819318+0000","last_became_active":"2023-06-09T11:12:08.287279+0000","last_became_peered":"2023-06-09T11:12:08.287279+0000","last_unstale":"2023-06-09T11:12:09.819318+0000","last_undegraded":"2023-06-09T11:12:09.819318+0000","last_fullsized":"2023-06-09T11:12:09.819318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:52.750567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140755+0000","last_change":"2023-06-09T11:12:08.846000+0000","last_active":"2023-06-09T11:12:10.140755+0000","last_peered":"2023-06-09T11:12:10.140755+0000","last_clean":"2023-06-09T11:12:10.140755+0000","last_became_active":"2023-06-09T11:12:08.845741+0000","last_became_peered":"2023-06-09T11:12:08.845741+0000","last_unstale":"2023-06-09T11:12:10.140755+0000","last_undegraded":"2023-06-09T11:12:10.140755+0000","last_fullsized":"2023-06-09T11:12:10.140755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848766+0000","last_change":"2023-06-09T11:12:08.283831+0000","last_active":"2023-06-09T11:12:09.848766+0000","last_peered":"2023-06-09T11:12:09.848766+0000","last_clean":"2023-06-09T11:12:09.848766+0000","last_became_active":"2023-06-09T11:12:08.283264+0000","last_became_peered":"2023-06-09T11:12:08.283264+0000","last_unstale":"2023-06-09T11:12:09.848766+0000","last_undegraded":"2023-06-09T11:12:09.848766+0000","last_fullsized":"2023-06-09T11:12:09.848766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819930+0000","last_change":"2023-06-09T11:12:08.834819+0000","last_active":"2023-06-09T11:12:09.819930+0000","last_peered":"2023-06-09T11:12:09.819930+0000","last_clean":"2023-06-09T11:12:09.819930+0000","last_became_active":"2023-06-09T11:12:08.834508+0000","last_became_peered":"2023-06-09T11:12:08.834508+0000","last_unstale":"2023-06-09T11:12:09.819930+0000","last_undegraded":"2023-06-09T11:12:09.819930+0000","last_fullsized":"2023-06-09T11:12:09.819930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822732+0000","last_change":"2023-06-09T11:12:08.280846+0000","last_active":"2023-06-09T11:12:09.822732+0000","last_peered":"2023-06-09T11:12:09.822732+0000","last_clean":"2023-06-09T11:12:09.822732+0000","last_became_active":"2023-06-09T11:12:08.280236+0000","last_became_peered":"2023-06-09T11:12:08.280236+0000","last_unstale":"2023-06-09T11:12:09.822732+0000","last_undegraded":"2023-06-09T11:12:09.822732+0000","last_fullsized":"2023-06-09T11:12:09.822732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.835695+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.835460+0000","last_became_peered":"2023-06-09T11:12:08.835460+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:57.336221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140920+0000","last_change":"2023-06-09T11:12:08.285330+0000","last_active":"2023-06-09T11:12:10.140920+0000","last_peered":"2023-06-09T11:12:10.140920+0000","last_clean":"2023-06-09T11:12:10.140920+0000","last_became_active":"2023-06-09T11:12:08.285034+0000","last_became_peered":"2023-06-09T11:12:08.285034+0000","last_unstale":"2023-06-09T11:12:10.140920+0000","last_undegraded":"2023-06-09T11:12:10.140920+0000","last_fullsized":"2023-06-09T11:12:10.140920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823127+0000","last_change":"2023-06-09T11:12:08.827779+0000","last_active":"2023-06-09T11:12:09.823127+0000","last_peered":"2023-06-09T11:12:09.823127+0000","last_clean":"2023-06-09T11:12:09.823127+0000","last_became_active":"2023-06-09T11:12:08.827529+0000","last_became_peered":"2023-06-09T11:12:08.827529+0000","last_unstale":"2023-06-09T11:12:09.823127+0000","last_undegraded":"2023-06-09T11:12:09.823127+0000","last_fullsized":"2023-06-09T11:12:09.823127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822947+0000","last_change":"2023-06-09T11:12:08.278445+0000","last_active":"2023-06-09T11:12:09.822947+0000","last_peered":"2023-06-09T11:12:09.822947+0000","last_clean":"2023-06-09T11:12:09.822947+0000","last_became_active":"2023-06-09T11:12:08.276493+0000","last_became_peered":"2023-06-09T11:12:08.276493+0000","last_unstale":"2023-06-09T11:12:09.822947+0000","last_undegraded":"2023-06-09T11:12:09.822947+0000","last_fullsized":"2023-06-09T11:12:09.822947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822406+0000","last_change":"2023-06-09T11:12:08.825777+0000","last_active":"2023-06-09T11:12:09.822406+0000","last_peered":"2023-06-09T11:12:09.822406+0000","last_clean":"2023-06-09T11:12:09.822406+0000","last_became_active":"2023-06-09T11:12:08.825486+0000","last_became_peered":"2023-06-09T11:12:08.825486+0000","last_unstale":"2023-06-09T11:12:09.822406+0000","last_undegraded":"2023-06-09T11:12:09.822406+0000","last_fullsized":"2023-06-09T11:12:09.822406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823362+0000","last_change":"2023-06-09T11:12:08.279306+0000","last_active":"2023-06-09T11:12:09.823362+0000","last_peered":"2023-06-09T11:12:09.823362+0000","last_clean":"2023-06-09T11:12:09.823362+0000","last_became_active":"2023-06-09T11:12:08.278839+0000","last_became_peered":"2023-06-09T11:12:08.278839+0000","last_unstale":"2023-06-09T11:12:09.823362+0000","last_undegraded":"2023-06-09T11:12:09.823362+0000","last_fullsized":"2023-06-09T11:12:09.823362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819796+0000","last_change":"2023-06-09T11:12:08.826596+0000","last_active":"2023-06-09T11:12:09.819796+0000","last_peered":"2023-06-09T11:12:09.819796+0000","last_clean":"2023-06-09T11:12:09.819796+0000","last_became_active":"2023-06-09T11:12:08.826297+0000","last_became_peered":"2023-06-09T11:12:08.826297+0000","last_unstale":"2023-06-09T11:12:09.819796+0000","last_undegraded":"2023-06-09T11:12:09.819796+0000","last_fullsized":"2023-06-09T11:12:09.819796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819593+0000","last_change":"2023-06-09T11:12:08.275890+0000","last_active":"2023-06-09T11:12:09.819593+0000","last_peered":"2023-06-09T11:12:09.819593+0000","last_clean":"2023-06-09T11:12:09.819593+0000","last_became_active":"2023-06-09T11:12:08.275473+0000","last_became_peered":"2023-06-09T11:12:08.275473+0000","last_unstale":"2023-06-09T11:12:09.819593+0000","last_undegraded":"2023-06-09T11:12:09.819593+0000","last_fullsized":"2023-06-09T11:12:09.819593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821857+0000","last_change":"2023-06-09T11:12:08.838762+0000","last_active":"2023-06-09T11:12:09.821857+0000","last_peered":"2023-06-09T11:12:09.821857+0000","last_clean":"2023-06-09T11:12:09.821857+0000","last_became_active":"2023-06-09T11:12:08.834883+0000","last_became_peered":"2023-06-09T11:12:08.834883+0000","last_unstale":"2023-06-09T11:12:09.821857+0000","last_undegraded":"2023-06-09T11:12:09.821857+0000","last_fullsized":"2023-06-09T11:12:09.821857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141101+0000","last_change":"2023-06-09T11:12:08.282540+0000","last_active":"2023-06-09T11:12:10.141101+0000","last_peered":"2023-06-09T11:12:10.141101+0000","last_clean":"2023-06-09T11:12:10.141101+0000","last_became_active":"2023-06-09T11:12:08.281150+0000","last_became_peered":"2023-06-09T11:12:08.281150+0000","last_unstale":"2023-06-09T11:12:10.141101+0000","last_undegraded":"2023-06-09T11:12:10.141101+0000","last_fullsized":"2023-06-09T11:12:10.141101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9039999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9080,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362760,"statfs":{"total":96636764160,"available":96627466240,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:12:18.355 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:12:18.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0635d69700 1 Processor -- start 2023-06-09T11:12:18.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0635d69700 1 -- start start 2023-06-09T11:12:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0635d69700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015a3e0 0x7f063006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0635d69700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06300ce470 0x7f063006f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0635d69700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300cc8e0 con 0x7f063015df60 2023-06-09T11:12:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0635d69700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063015a7b0 con 0x7f06300ce470 2023-06-09T11:12:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0635d69700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300ccb80 con 0x7f063015a3e0 2023-06-09T11:12:18.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0627fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06300ce470 0x7f063006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0627fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06300ce470 0x7f063006f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47968/0 (socket says 172.21.15.78:47968) 2023-06-09T11:12:18.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0627fff700 1 -- 172.21.15.78:0/369369009 learned_addr learned my addr 172.21.15.78:0/369369009 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:18.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0634d67700 1 --2- 172.21.15.78:0/369369009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015a3e0 0x7f063006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.540+0000 7f0627fff700 1 -- 172.21.15.78:0/369369009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015a3e0 msgr2=0x7f063006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:18.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0627fff700 1 --2- 172.21.15.78:0/369369009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015a3e0 0x7f063006e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0627fff700 1 -- 172.21.15.78:0/369369009 >> v1:172.21.15.187:6789/0 conn(0x7f063015df60 legacy=0x7f0630070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0627fff700 1 -- 172.21.15.78:0/369369009 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063006b470 con 0x7f06300ce470 2023-06-09T11:12:18.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0634d67700 1 --2- 172.21.15.78:0/369369009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015a3e0 0x7f063006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:18.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0627fff700 1 --2- 172.21.15.78:0/369369009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300ce470 0x7f063006f090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0620009910 tx=0x7f0620009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792fc17cf7d2a9af server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f06277fe700 1 -- 172.21.15.78:0/369369009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000ba60 con 0x7f06300ce470 2023-06-09T11:12:18.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f06277fe700 1 -- 172.21.15.78:0/369369009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000bbc0 con 0x7f06300ce470 2023-06-09T11:12:18.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f06277fe700 1 -- 172.21.15.78:0/369369009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620009e60 con 0x7f06300ce470 2023-06-09T11:12:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 -- 172.21.15.78:0/369369009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300ce470 msgr2=0x7f063006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 --2- 172.21.15.78:0/369369009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300ce470 0x7f063006f090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0620009910 tx=0x7f0620009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 -- 172.21.15.78:0/369369009 shutdown_connections 2023-06-09T11:12:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 --2- 172.21.15.78:0/369369009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06300ce470 0x7f063006f090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 --2- 172.21.15.78:0/369369009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063015a3e0 0x7f063006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 -- 172.21.15.78:0/369369009 >> 172.21.15.78:0/369369009 conn(0x7f06300cf670 msgr2=0x7f06300cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 -- 172.21.15.78:0/369369009 shutdown_connections 2023-06-09T11:12:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.544+0000 7f0635d69700 1 -- 172.21.15.78:0/369369009 wait complete. 2023-06-09T11:12:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 Processor -- start 2023-06-09T11:12:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 -- start start 2023-06-09T11:12:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06300ce470 0x7f06301568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063015a3e0 0x7f06300b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063015df60 0x7f063014b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630158050 con 0x7f063015a3e0 2023-06-09T11:12:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630156fb0 con 0x7f063015df60 2023-06-09T11:12:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635d69700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0630157290 con 0x7f06300ce470 2023-06-09T11:12:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063015a3e0 0x7f06300b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063015a3e0 0x7f06300b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47974/0 (socket says 172.21.15.78:47974) 2023-06-09T11:12:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 -- 172.21.15.78:0/3169322119 learned_addr learned my addr 172.21.15.78:0/3169322119 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0635568700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063015df60 0x7f063014b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0634d67700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06300ce470 0x7f06301568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 -- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06300ce470 msgr2=0x7f06301568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06300ce470 0x7f06301568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 -- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063015df60 msgr2=0x7f063014b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063015df60 0x7f063014b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 -- 172.21.15.78:0/3169322119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620009570 con 0x7f063015a3e0 2023-06-09T11:12:18.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f0627fff700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063015a3e0 0x7f06300b0840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f0620004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f06257fa700 1 -- 172.21.15.78:0/3169322119 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620004590 con 0x7f063015a3e0 2023-06-09T11:12:18.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.548+0000 7f06257fa700 1 -- 172.21.15.78:0/3169322119 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06200036c0 con 0x7f063015a3e0 2023-06-09T11:12:18.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.552+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063015e3e0 con 0x7f063015a3e0 2023-06-09T11:12:18.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.552+0000 7f06257fa700 1 -- 172.21.15.78:0/3169322119 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620003a70 con 0x7f063015a3e0 2023-06-09T11:12:18.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.552+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063006b750 con 0x7f063015a3e0 2023-06-09T11:12:18.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.552+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063015e570 con 0x7f063015a3e0 2023-06-09T11:12:18.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.552+0000 7f06257fa700 1 -- 172.21.15.78:0/3169322119 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0620003bd0 con 0x7f063015a3e0 2023-06-09T11:12:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.556+0000 7f06257fa700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f061c066320 0x7f061c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.556+0000 7f06257fa700 1 -- 172.21.15.78:0/3169322119 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0620084f70 con 0x7f063015a3e0 2023-06-09T11:12:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.556+0000 7f0634d67700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f061c066320 0x7f061c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.556+0000 7f0634d67700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f061c066320 0x7f061c0687d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f062c003780 tx=0x7f062c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.560+0000 7f06257fa700 1 -- 172.21.15.78:0/3169322119 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f06200523e0 con 0x7f063015a3e0 2023-06-09T11:12:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.724+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06300741c0 con 0x7f061c066320 2023-06-09T11:12:18.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.740+0000 7f06257fa700 1 -- 172.21.15.78:0/3169322119 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286483 (secure 0 0 0) 0x7f06300741c0 con 0x7f061c066320 2023-06-09T11:12:18.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f061c066320 msgr2=0x7f061c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f061c066320 0x7f061c0687d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f062c003780 tx=0x7f062c008040 comp rx=0 tx=0).stop 2023-06-09T11:12:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063015a3e0 msgr2=0x7f06300b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063015a3e0 0x7f06300b0840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f0620004770 comp rx=0 tx=0).stop 2023-06-09T11:12:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 shutdown_connections 2023-06-09T11:12:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f061c066320 0x7f061c0687d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063015df60 0x7f063014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063015a3e0 0x7f06300b0840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 --2- 172.21.15.78:0/3169322119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06300ce470 0x7f06301568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 >> 172.21.15.78:0/3169322119 conn(0x7f06300cf670 msgr2=0x7f06300b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 shutdown_connections 2023-06-09T11:12:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.752+0000 7f0635d69700 1 -- 172.21.15.78:0/3169322119 wait complete. 2023-06-09T11:12:18.761 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:12:18.779 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-06-09T11:12:17.607543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66276,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908444,"statfs":{"total":773094113280,"available":773026246656,"internally_reserved":0,"allocated":3182592,"data_stored":1901233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.801061"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838710+0000","last_change":"2023-06-09T11:12:08.821394+0000","last_active":"2023-06-09T11:12:09.838710+0000","last_peered":"2023-06-09T11:12:09.838710+0000","last_clean":"2023-06-09T11:12:09.838710+0000","last_became_active":"2023-06-09T11:12:08.821006+0000","last_became_peered":"2023-06-09T11:12:08.821006+0000","last_unstale":"2023-06-09T11:12:09.838710+0000","last_undegraded":"2023-06-09T11:12:09.838710+0000","last_fullsized":"2023-06-09T11:12:09.838710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823540+0000","last_change":"2023-06-09T11:12:08.838303+0000","last_active":"2023-06-09T11:12:09.823540+0000","last_peered":"2023-06-09T11:12:09.823540+0000","last_clean":"2023-06-09T11:12:09.823540+0000","last_became_active":"2023-06-09T11:12:08.837991+0000","last_became_peered":"2023-06-09T11:12:08.837991+0000","last_unstale":"2023-06-09T11:12:09.823540+0000","last_undegraded":"2023-06-09T11:12:09.823540+0000","last_fullsized":"2023-06-09T11:12:09.823540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824004+0000","last_change":"2023-06-09T11:12:08.839761+0000","last_active":"2023-06-09T11:12:09.824004+0000","last_peered":"2023-06-09T11:12:09.824004+0000","last_clean":"2023-06-09T11:12:09.824004+0000","last_became_active":"2023-06-09T11:12:08.839497+0000","last_became_peered":"2023-06-09T11:12:08.839497+0000","last_unstale":"2023-06-09T11:12:09.824004+0000","last_undegraded":"2023-06-09T11:12:09.824004+0000","last_fullsized":"2023-06-09T11:12:09.824004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.834239+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.833880+0000","last_became_peered":"2023-06-09T11:12:08.833880+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:26:19.609527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140805+0000","last_change":"2023-06-09T11:12:08.820882+0000","last_active":"2023-06-09T11:12:10.140805+0000","last_peered":"2023-06-09T11:12:10.140805+0000","last_clean":"2023-06-09T11:12:10.140805+0000","last_became_active":"2023-06-09T11:12:08.820612+0000","last_became_peered":"2023-06-09T11:12:08.820612+0000","last_unstale":"2023-06-09T11:12:10.140805+0000","last_undegraded":"2023-06-09T11:12:10.140805+0000","last_fullsized":"2023-06-09T11:12:10.140805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822230+0000","last_change":"2023-06-09T11:12:08.827114+0000","last_active":"2023-06-09T11:12:09.822230+0000","last_peered":"2023-06-09T11:12:09.822230+0000","last_clean":"2023-06-09T11:12:09.822230+0000","last_became_active":"2023-06-09T11:12:08.826824+0000","last_became_peered":"2023-06-09T11:12:08.826824+0000","last_unstale":"2023-06-09T11:12:09.822230+0000","last_undegraded":"2023-06-09T11:12:09.822230+0000","last_fullsized":"2023-06-09T11:12:09.822230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845630+0000","last_change":"2023-06-09T11:12:08.843112+0000","last_active":"2023-06-09T11:12:09.845630+0000","last_peered":"2023-06-09T11:12:09.845630+0000","last_clean":"2023-06-09T11:12:09.845630+0000","last_became_active":"2023-06-09T11:12:08.842858+0000","last_became_peered":"2023-06-09T11:12:08.842858+0000","last_unstale":"2023-06-09T11:12:09.845630+0000","last_undegraded":"2023-06-09T11:12:09.845630+0000","last_fullsized":"2023-06-09T11:12:09.845630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822656+0000","last_change":"2023-06-09T11:12:08.830501+0000","last_active":"2023-06-09T11:12:09.822656+0000","last_peered":"2023-06-09T11:12:09.822656+0000","last_clean":"2023-06-09T11:12:09.822656+0000","last_became_active":"2023-06-09T11:12:08.830202+0000","last_became_peered":"2023-06-09T11:12:08.830202+0000","last_unstale":"2023-06-09T11:12:09.822656+0000","last_undegraded":"2023-06-09T11:12:09.822656+0000","last_fullsized":"2023-06-09T11:12:09.822656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140886+0000","last_change":"2023-06-09T11:12:08.828605+0000","last_active":"2023-06-09T11:12:10.140886+0000","last_peered":"2023-06-09T11:12:10.140886+0000","last_clean":"2023-06-09T11:12:10.140886+0000","last_became_active":"2023-06-09T11:12:08.828346+0000","last_became_peered":"2023-06-09T11:12:08.828346+0000","last_unstale":"2023-06-09T11:12:10.140886+0000","last_undegraded":"2023-06-09T11:12:10.140886+0000","last_fullsized":"2023-06-09T11:12:10.140886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:27.295659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823788+0000","last_change":"2023-06-09T11:12:08.838779+0000","last_active":"2023-06-09T11:12:09.823788+0000","last_peered":"2023-06-09T11:12:09.823788+0000","last_clean":"2023-06-09T11:12:09.823788+0000","last_became_active":"2023-06-09T11:12:08.838506+0000","last_became_peered":"2023-06-09T11:12:08.838506+0000","last_unstale":"2023-06-09T11:12:09.823788+0000","last_undegraded":"2023-06-09T11:12:09.823788+0000","last_fullsized":"2023-06-09T11:12:09.823788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824155+0000","last_change":"2023-06-09T11:12:08.827743+0000","last_active":"2023-06-09T11:12:09.824155+0000","last_peered":"2023-06-09T11:12:09.824155+0000","last_clean":"2023-06-09T11:12:09.824155+0000","last_became_active":"2023-06-09T11:12:08.827468+0000","last_became_peered":"2023-06-09T11:12:08.827468+0000","last_unstale":"2023-06-09T11:12:09.824155+0000","last_undegraded":"2023-06-09T11:12:09.824155+0000","last_fullsized":"2023-06-09T11:12:09.824155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:55.115525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.829351+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.829053+0000","last_became_peered":"2023-06-09T11:12:08.829053+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838528+0000","last_change":"2023-06-09T11:12:08.820511+0000","last_active":"2023-06-09T11:12:09.838528+0000","last_peered":"2023-06-09T11:12:09.838528+0000","last_clean":"2023-06-09T11:12:09.838528+0000","last_became_active":"2023-06-09T11:12:08.820231+0000","last_became_peered":"2023-06-09T11:12:08.820231+0000","last_unstale":"2023-06-09T11:12:09.838528+0000","last_undegraded":"2023-06-09T11:12:09.838528+0000","last_fullsized":"2023-06-09T11:12:09.838528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:54:22.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822794+0000","last_change":"2023-06-09T11:12:08.822849+0000","last_active":"2023-06-09T11:12:09.822794+0000","last_peered":"2023-06-09T11:12:09.822794+0000","last_clean":"2023-06-09T11:12:09.822794+0000","last_became_active":"2023-06-09T11:12:08.822563+0000","last_became_peered":"2023-06-09T11:12:08.822563+0000","last_unstale":"2023-06-09T11:12:09.822794+0000","last_undegraded":"2023-06-09T11:12:09.822794+0000","last_fullsized":"2023-06-09T11:12:09.822794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845781+0000","last_change":"2023-06-09T11:12:08.843310+0000","last_active":"2023-06-09T11:12:09.845781+0000","last_peered":"2023-06-09T11:12:09.845781+0000","last_clean":"2023-06-09T11:12:09.845781+0000","last_became_active":"2023-06-09T11:12:08.842999+0000","last_became_peered":"2023-06-09T11:12:08.842999+0000","last_unstale":"2023-06-09T11:12:09.845781+0000","last_undegraded":"2023-06-09T11:12:09.845781+0000","last_fullsized":"2023-06-09T11:12:09.845781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821865+0000","last_change":"2023-06-09T11:12:08.827890+0000","last_active":"2023-06-09T11:12:09.821865+0000","last_peered":"2023-06-09T11:12:09.821865+0000","last_clean":"2023-06-09T11:12:09.821865+0000","last_became_active":"2023-06-09T11:12:08.827592+0000","last_became_peered":"2023-06-09T11:12:08.827592+0000","last_unstale":"2023-06-09T11:12:09.821865+0000","last_undegraded":"2023-06-09T11:12:09.821865+0000","last_fullsized":"2023-06-09T11:12:09.821865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141045+0000","last_change":"2023-06-09T11:12:08.830805+0000","last_active":"2023-06-09T11:12:10.141045+0000","last_peered":"2023-06-09T11:12:10.141045+0000","last_clean":"2023-06-09T11:12:10.141045+0000","last_became_active":"2023-06-09T11:12:08.830542+0000","last_became_peered":"2023-06-09T11:12:08.830542+0000","last_unstale":"2023-06-09T11:12:10.141045+0000","last_undegraded":"2023-06-09T11:12:10.141045+0000","last_fullsized":"2023-06-09T11:12:10.141045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823971+0000","last_change":"2023-06-09T11:12:08.829977+0000","last_active":"2023-06-09T11:12:09.823971+0000","last_peered":"2023-06-09T11:12:09.823971+0000","last_clean":"2023-06-09T11:12:09.823971+0000","last_became_active":"2023-06-09T11:12:08.829646+0000","last_became_peered":"2023-06-09T11:12:08.829646+0000","last_unstale":"2023-06-09T11:12:09.823971+0000","last_undegraded":"2023-06-09T11:12:09.823971+0000","last_fullsized":"2023-06-09T11:12:09.823971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838592+0000","last_change":"2023-06-09T11:12:08.835400+0000","last_active":"2023-06-09T11:12:09.838592+0000","last_peered":"2023-06-09T11:12:09.838592+0000","last_clean":"2023-06-09T11:12:09.838592+0000","last_became_active":"2023-06-09T11:12:08.835057+0000","last_became_peered":"2023-06-09T11:12:08.835057+0000","last_unstale":"2023-06-09T11:12:09.838592+0000","last_undegraded":"2023-06-09T11:12:09.838592+0000","last_fullsized":"2023-06-09T11:12:09.838592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:31:06.835160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823882+0000","last_change":"2023-06-09T11:12:08.834281+0000","last_active":"2023-06-09T11:12:09.823882+0000","last_peered":"2023-06-09T11:12:09.823882+0000","last_clean":"2023-06-09T11:12:09.823882+0000","last_became_active":"2023-06-09T11:12:08.833982+0000","last_became_peered":"2023-06-09T11:12:08.833982+0000","last_unstale":"2023-06-09T11:12:09.823882+0000","last_undegraded":"2023-06-09T11:12:09.823882+0000","last_fullsized":"2023-06-09T11:12:09.823882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846062+0000","last_change":"2023-06-09T11:12:08.844527+0000","last_active":"2023-06-09T11:12:09.846062+0000","last_peered":"2023-06-09T11:12:09.846062+0000","last_clean":"2023-06-09T11:12:09.846062+0000","last_became_active":"2023-06-09T11:12:08.843678+0000","last_became_peered":"2023-06-09T11:12:08.843678+0000","last_unstale":"2023-06-09T11:12:09.846062+0000","last_undegraded":"2023-06-09T11:12:09.846062+0000","last_fullsized":"2023-06-09T11:12:09.846062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:45.607634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140195+0000","last_change":"2023-06-09T11:12:08.838192+0000","last_active":"2023-06-09T11:12:10.140195+0000","last_peered":"2023-06-09T11:12:10.140195+0000","last_clean":"2023-06-09T11:12:10.140195+0000","last_became_active":"2023-06-09T11:12:08.837602+0000","last_became_peered":"2023-06-09T11:12:08.837602+0000","last_unstale":"2023-06-09T11:12:10.140195+0000","last_undegraded":"2023-06-09T11:12:10.140195+0000","last_fullsized":"2023-06-09T11:12:10.140195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819267+0000","last_change":"2023-06-09T11:12:08.827140+0000","last_active":"2023-06-09T11:12:09.819267+0000","last_peered":"2023-06-09T11:12:09.819267+0000","last_clean":"2023-06-09T11:12:09.819267+0000","last_became_active":"2023-06-09T11:12:08.826856+0000","last_became_peered":"2023-06-09T11:12:08.826856+0000","last_unstale":"2023-06-09T11:12:09.819267+0000","last_undegraded":"2023-06-09T11:12:09.819267+0000","last_fullsized":"2023-06-09T11:12:09.819267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846005+0000","last_change":"2023-06-09T11:12:08.845240+0000","last_active":"2023-06-09T11:12:09.846005+0000","last_peered":"2023-06-09T11:12:09.846005+0000","last_clean":"2023-06-09T11:12:09.846005+0000","last_became_active":"2023-06-09T11:12:08.844410+0000","last_became_peered":"2023-06-09T11:12:08.844410+0000","last_unstale":"2023-06-09T11:12:09.846005+0000","last_undegraded":"2023-06-09T11:12:09.846005+0000","last_fullsized":"2023-06-09T11:12:09.846005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849751+0000","last_change":"2023-06-09T11:12:08.837911+0000","last_active":"2023-06-09T11:12:09.849751+0000","last_peered":"2023-06-09T11:12:09.849751+0000","last_clean":"2023-06-09T11:12:09.849751+0000","last_became_active":"2023-06-09T11:12:08.837627+0000","last_became_peered":"2023-06-09T11:12:08.837627+0000","last_unstale":"2023-06-09T11:12:09.849751+0000","last_undegraded":"2023-06-09T11:12:09.849751+0000","last_fullsized":"2023-06-09T11:12:09.849751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849808+0000","last_change":"2023-06-09T11:12:08.834539+0000","last_active":"2023-06-09T11:12:09.849808+0000","last_peered":"2023-06-09T11:12:09.849808+0000","last_clean":"2023-06-09T11:12:09.849808+0000","last_became_active":"2023-06-09T11:12:08.834197+0000","last_became_peered":"2023-06-09T11:12:08.834197+0000","last_unstale":"2023-06-09T11:12:09.849808+0000","last_undegraded":"2023-06-09T11:12:09.849808+0000","last_fullsized":"2023-06-09T11:12:09.849808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:39.150567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823239+0000","last_change":"2023-06-09T11:12:08.839682+0000","last_active":"2023-06-09T11:12:09.823239+0000","last_peered":"2023-06-09T11:12:09.823239+0000","last_clean":"2023-06-09T11:12:09.823239+0000","last_became_active":"2023-06-09T11:12:08.838961+0000","last_became_peered":"2023-06-09T11:12:08.838961+0000","last_unstale":"2023-06-09T11:12:09.823239+0000","last_undegraded":"2023-06-09T11:12:09.823239+0000","last_fullsized":"2023-06-09T11:12:09.823239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849236+0000","last_change":"2023-06-09T11:12:08.846811+0000","last_active":"2023-06-09T11:12:09.849236+0000","last_peered":"2023-06-09T11:12:09.849236+0000","last_clean":"2023-06-09T11:12:09.849236+0000","last_became_active":"2023-06-09T11:12:08.846391+0000","last_became_peered":"2023-06-09T11:12:08.846391+0000","last_unstale":"2023-06-09T11:12:09.849236+0000","last_undegraded":"2023-06-09T11:12:09.849236+0000","last_fullsized":"2023-06-09T11:12:09.849236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819649+0000","last_change":"2023-06-09T11:12:08.838865+0000","last_active":"2023-06-09T11:12:09.819649+0000","last_peered":"2023-06-09T11:12:09.819649+0000","last_clean":"2023-06-09T11:12:09.819649+0000","last_became_active":"2023-06-09T11:12:08.838587+0000","last_became_peered":"2023-06-09T11:12:08.838587+0000","last_unstale":"2023-06-09T11:12:09.819649+0000","last_undegraded":"2023-06-09T11:12:09.819649+0000","last_fullsized":"2023-06-09T11:12:09.819649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822571+0000","last_change":"2023-06-09T11:12:08.832860+0000","last_active":"2023-06-09T11:12:09.822571+0000","last_peered":"2023-06-09T11:12:09.822571+0000","last_clean":"2023-06-09T11:12:09.822571+0000","last_became_active":"2023-06-09T11:12:08.832580+0000","last_became_peered":"2023-06-09T11:12:08.832580+0000","last_unstale":"2023-06-09T11:12:09.822571+0000","last_undegraded":"2023-06-09T11:12:09.822571+0000","last_fullsized":"2023-06-09T11:12:09.822571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819165+0000","last_change":"2023-06-09T11:12:08.839816+0000","last_active":"2023-06-09T11:12:09.819165+0000","last_peered":"2023-06-09T11:12:09.819165+0000","last_clean":"2023-06-09T11:12:09.819165+0000","last_became_active":"2023-06-09T11:12:08.839381+0000","last_became_peered":"2023-06-09T11:12:08.839381+0000","last_unstale":"2023-06-09T11:12:09.819165+0000","last_undegraded":"2023-06-09T11:12:09.819165+0000","last_fullsized":"2023-06-09T11:12:09.819165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138744+0000","last_change":"2023-06-09T11:12:08.833196+0000","last_active":"2023-06-09T11:12:10.138744+0000","last_peered":"2023-06-09T11:12:10.138744+0000","last_clean":"2023-06-09T11:12:10.138744+0000","last_became_active":"2023-06-09T11:12:08.832913+0000","last_became_peered":"2023-06-09T11:12:08.832913+0000","last_unstale":"2023-06-09T11:12:10.138744+0000","last_undegraded":"2023-06-09T11:12:10.138744+0000","last_fullsized":"2023-06-09T11:12:10.138744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:17.545512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820004+0000","last_change":"2023-06-09T11:12:08.839962+0000","last_active":"2023-06-09T11:12:09.820004+0000","last_peered":"2023-06-09T11:12:09.820004+0000","last_clean":"2023-06-09T11:12:09.820004+0000","last_became_active":"2023-06-09T11:12:08.839675+0000","last_became_peered":"2023-06-09T11:12:08.839675+0000","last_unstale":"2023-06-09T11:12:09.820004+0000","last_undegraded":"2023-06-09T11:12:09.820004+0000","last_fullsized":"2023-06-09T11:12:09.820004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846303+0000","last_change":"2023-06-09T11:12:08.283296+0000","last_active":"2023-06-09T11:12:09.846303+0000","last_peered":"2023-06-09T11:12:09.846303+0000","last_clean":"2023-06-09T11:12:09.846303+0000","last_became_active":"2023-06-09T11:12:08.282947+0000","last_became_peered":"2023-06-09T11:12:08.282947+0000","last_unstale":"2023-06-09T11:12:09.846303+0000","last_undegraded":"2023-06-09T11:12:09.846303+0000","last_fullsized":"2023-06-09T11:12:09.846303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823280+0000","last_change":"2023-06-09T11:12:08.839863+0000","last_active":"2023-06-09T11:12:09.823280+0000","last_peered":"2023-06-09T11:12:09.823280+0000","last_clean":"2023-06-09T11:12:09.823280+0000","last_became_active":"2023-06-09T11:12:08.839412+0000","last_became_peered":"2023-06-09T11:12:08.839412+0000","last_unstale":"2023-06-09T11:12:09.823280+0000","last_undegraded":"2023-06-09T11:12:09.823280+0000","last_fullsized":"2023-06-09T11:12:09.823280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140262+0000","last_change":"2023-06-09T11:12:08.282887+0000","last_active":"2023-06-09T11:12:10.140262+0000","last_peered":"2023-06-09T11:12:10.140262+0000","last_clean":"2023-06-09T11:12:10.140262+0000","last_became_active":"2023-06-09T11:12:08.282019+0000","last_became_peered":"2023-06-09T11:12:08.282019+0000","last_unstale":"2023-06-09T11:12:10.140262+0000","last_undegraded":"2023-06-09T11:12:10.140262+0000","last_fullsized":"2023-06-09T11:12:10.140262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:16.998562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141115+0000","last_change":"2023-06-09T11:12:08.826851+0000","last_active":"2023-06-09T11:12:10.141115+0000","last_peered":"2023-06-09T11:12:10.141115+0000","last_clean":"2023-06-09T11:12:10.141115+0000","last_became_active":"2023-06-09T11:12:08.826485+0000","last_became_peered":"2023-06-09T11:12:08.826485+0000","last_unstale":"2023-06-09T11:12:10.141115+0000","last_undegraded":"2023-06-09T11:12:10.141115+0000","last_fullsized":"2023-06-09T11:12:10.141115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845892+0000","last_change":"2023-06-09T11:12:08.287775+0000","last_active":"2023-06-09T11:12:09.845892+0000","last_peered":"2023-06-09T11:12:09.845892+0000","last_clean":"2023-06-09T11:12:09.845892+0000","last_became_active":"2023-06-09T11:12:08.287415+0000","last_became_peered":"2023-06-09T11:12:08.287415+0000","last_unstale":"2023-06-09T11:12:09.845892+0000","last_undegraded":"2023-06-09T11:12:09.845892+0000","last_fullsized":"2023-06-09T11:12:09.845892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819886+0000","last_change":"2023-06-09T11:12:08.845899+0000","last_active":"2023-06-09T11:12:09.819886+0000","last_peered":"2023-06-09T11:12:09.819886+0000","last_clean":"2023-06-09T11:12:09.819886+0000","last_became_active":"2023-06-09T11:12:08.845497+0000","last_became_peered":"2023-06-09T11:12:08.845497+0000","last_unstale":"2023-06-09T11:12:09.819886+0000","last_undegraded":"2023-06-09T11:12:09.819886+0000","last_fullsized":"2023-06-09T11:12:09.819886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:17.073440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139028+0000","last_change":"2023-06-09T11:12:08.283802+0000","last_active":"2023-06-09T11:12:10.139028+0000","last_peered":"2023-06-09T11:12:10.139028+0000","last_clean":"2023-06-09T11:12:10.139028+0000","last_became_active":"2023-06-09T11:12:08.283417+0000","last_became_peered":"2023-06-09T11:12:08.283417+0000","last_unstale":"2023-06-09T11:12:10.139028+0000","last_undegraded":"2023-06-09T11:12:10.139028+0000","last_fullsized":"2023-06-09T11:12:10.139028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:56.322140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846310+0000","last_change":"2023-06-09T11:12:08.287954+0000","last_active":"2023-06-09T11:12:09.846310+0000","last_peered":"2023-06-09T11:12:09.846310+0000","last_clean":"2023-06-09T11:12:09.846310+0000","last_became_active":"2023-06-09T11:12:08.287641+0000","last_became_peered":"2023-06-09T11:12:08.287641+0000","last_unstale":"2023-06-09T11:12:09.846310+0000","last_undegraded":"2023-06-09T11:12:09.846310+0000","last_fullsized":"2023-06-09T11:12:09.846310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:52.398335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822883+0000","last_change":"2023-06-09T11:12:08.838149+0000","last_active":"2023-06-09T11:12:09.822883+0000","last_peered":"2023-06-09T11:12:09.822883+0000","last_clean":"2023-06-09T11:12:09.822883+0000","last_became_active":"2023-06-09T11:12:08.837839+0000","last_became_peered":"2023-06-09T11:12:08.837839+0000","last_unstale":"2023-06-09T11:12:09.822883+0000","last_undegraded":"2023-06-09T11:12:09.822883+0000","last_fullsized":"2023-06-09T11:12:09.822883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846359+0000","last_change":"2023-06-09T11:12:08.287833+0000","last_active":"2023-06-09T11:12:09.846359+0000","last_peered":"2023-06-09T11:12:09.846359+0000","last_clean":"2023-06-09T11:12:09.846359+0000","last_became_active":"2023-06-09T11:12:08.287474+0000","last_became_peered":"2023-06-09T11:12:08.287474+0000","last_unstale":"2023-06-09T11:12:09.846359+0000","last_undegraded":"2023-06-09T11:12:09.846359+0000","last_fullsized":"2023-06-09T11:12:09.846359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:12:54.101444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821934+0000","last_change":"2023-06-09T11:12:08.840471+0000","last_active":"2023-06-09T11:12:09.821934+0000","last_peered":"2023-06-09T11:12:09.821934+0000","last_clean":"2023-06-09T11:12:09.821934+0000","last_became_active":"2023-06-09T11:12:08.840152+0000","last_became_peered":"2023-06-09T11:12:08.840152+0000","last_unstale":"2023-06-09T11:12:09.821934+0000","last_undegraded":"2023-06-09T11:12:09.821934+0000","last_fullsized":"2023-06-09T11:12:09.821934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846498+0000","last_change":"2023-06-09T11:12:08.280882+0000","last_active":"2023-06-09T11:12:09.846498+0000","last_peered":"2023-06-09T11:12:09.846498+0000","last_clean":"2023-06-09T11:12:09.846498+0000","last_became_active":"2023-06-09T11:12:08.280608+0000","last_became_peered":"2023-06-09T11:12:08.280608+0000","last_unstale":"2023-06-09T11:12:09.846498+0000","last_undegraded":"2023-06-09T11:12:09.846498+0000","last_fullsized":"2023-06-09T11:12:09.846498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:45:50.994443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.138982+0000","last_change":"2023-06-09T11:12:08.835473+0000","last_active":"2023-06-09T11:12:10.138982+0000","last_peered":"2023-06-09T11:12:10.138982+0000","last_clean":"2023-06-09T11:12:10.138982+0000","last_became_active":"2023-06-09T11:12:08.835014+0000","last_became_peered":"2023-06-09T11:12:08.835014+0000","last_unstale":"2023-06-09T11:12:10.138982+0000","last_undegraded":"2023-06-09T11:12:10.138982+0000","last_fullsized":"2023-06-09T11:12:10.138982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:48:37.613601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823071+0000","last_change":"2023-06-09T11:12:08.286293+0000","last_active":"2023-06-09T11:12:09.823071+0000","last_peered":"2023-06-09T11:12:09.823071+0000","last_clean":"2023-06-09T11:12:09.823071+0000","last_became_active":"2023-06-09T11:12:08.283192+0000","last_became_peered":"2023-06-09T11:12:08.283192+0000","last_unstale":"2023-06-09T11:12:09.823071+0000","last_undegraded":"2023-06-09T11:12:09.823071+0000","last_fullsized":"2023-06-09T11:12:09.823071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140609+0000","last_change":"2023-06-09T11:12:08.831394+0000","last_active":"2023-06-09T11:12:10.140609+0000","last_peered":"2023-06-09T11:12:10.140609+0000","last_clean":"2023-06-09T11:12:10.140609+0000","last_became_active":"2023-06-09T11:12:08.829941+0000","last_became_peered":"2023-06-09T11:12:08.829941+0000","last_unstale":"2023-06-09T11:12:10.140609+0000","last_undegraded":"2023-06-09T11:12:10.140609+0000","last_fullsized":"2023-06-09T11:12:10.140609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819914+0000","last_change":"2023-06-09T11:12:08.288840+0000","last_active":"2023-06-09T11:12:09.819914+0000","last_peered":"2023-06-09T11:12:09.819914+0000","last_clean":"2023-06-09T11:12:09.819914+0000","last_became_active":"2023-06-09T11:12:08.287719+0000","last_became_peered":"2023-06-09T11:12:08.287719+0000","last_unstale":"2023-06-09T11:12:09.819914+0000","last_undegraded":"2023-06-09T11:12:09.819914+0000","last_fullsized":"2023-06-09T11:12:09.819914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823893+0000","last_change":"2023-06-09T11:12:08.828760+0000","last_active":"2023-06-09T11:12:09.823893+0000","last_peered":"2023-06-09T11:12:09.823893+0000","last_clean":"2023-06-09T11:12:09.823893+0000","last_became_active":"2023-06-09T11:12:08.828324+0000","last_became_peered":"2023-06-09T11:12:08.828324+0000","last_unstale":"2023-06-09T11:12:09.823893+0000","last_undegraded":"2023-06-09T11:12:09.823893+0000","last_fullsized":"2023-06-09T11:12:09.823893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:05.017896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139097+0000","last_change":"2023-06-09T11:12:08.283200+0000","last_active":"2023-06-09T11:12:10.139097+0000","last_peered":"2023-06-09T11:12:10.139097+0000","last_clean":"2023-06-09T11:12:10.139097+0000","last_became_active":"2023-06-09T11:12:08.282863+0000","last_became_peered":"2023-06-09T11:12:08.282863+0000","last_unstale":"2023-06-09T11:12:10.139097+0000","last_undegraded":"2023-06-09T11:12:10.139097+0000","last_fullsized":"2023-06-09T11:12:10.139097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:41:59.540044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824104+0000","last_change":"2023-06-09T11:12:08.828410+0000","last_active":"2023-06-09T11:12:09.824104+0000","last_peered":"2023-06-09T11:12:09.824104+0000","last_clean":"2023-06-09T11:12:09.824104+0000","last_became_active":"2023-06-09T11:12:08.828040+0000","last_became_peered":"2023-06-09T11:12:08.828040+0000","last_unstale":"2023-06-09T11:12:09.824104+0000","last_undegraded":"2023-06-09T11:12:09.824104+0000","last_fullsized":"2023-06-09T11:12:09.824104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:53.412417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822247+0000","last_change":"2023-06-09T11:12:08.268559+0000","last_active":"2023-06-09T11:12:09.822247+0000","last_peered":"2023-06-09T11:12:09.822247+0000","last_clean":"2023-06-09T11:12:09.822247+0000","last_became_active":"2023-06-09T11:12:08.268123+0000","last_became_peered":"2023-06-09T11:12:08.268123+0000","last_unstale":"2023-06-09T11:12:09.822247+0000","last_undegraded":"2023-06-09T11:12:09.822247+0000","last_fullsized":"2023-06-09T11:12:09.822247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824133+0000","last_change":"2023-06-09T11:12:08.829627+0000","last_active":"2023-06-09T11:12:09.824133+0000","last_peered":"2023-06-09T11:12:09.824133+0000","last_clean":"2023-06-09T11:12:09.824133+0000","last_became_active":"2023-06-09T11:12:08.829295+0000","last_became_peered":"2023-06-09T11:12:08.829295+0000","last_unstale":"2023-06-09T11:12:09.824133+0000","last_undegraded":"2023-06-09T11:12:09.824133+0000","last_fullsized":"2023-06-09T11:12:09.824133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:59.109592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819581+0000","last_change":"2023-06-09T11:12:08.286883+0000","last_active":"2023-06-09T11:12:09.819581+0000","last_peered":"2023-06-09T11:12:09.819581+0000","last_clean":"2023-06-09T11:12:09.819581+0000","last_became_active":"2023-06-09T11:12:08.283053+0000","last_became_peered":"2023-06-09T11:12:08.283053+0000","last_unstale":"2023-06-09T11:12:09.819581+0000","last_undegraded":"2023-06-09T11:12:09.819581+0000","last_fullsized":"2023-06-09T11:12:09.819581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849756+0000","last_change":"2023-06-09T11:12:08.840789+0000","last_active":"2023-06-09T11:12:09.849756+0000","last_peered":"2023-06-09T11:12:09.849756+0000","last_clean":"2023-06-09T11:12:09.849756+0000","last_became_active":"2023-06-09T11:12:08.840180+0000","last_became_peered":"2023-06-09T11:12:08.840180+0000","last_unstale":"2023-06-09T11:12:09.849756+0000","last_undegraded":"2023-06-09T11:12:09.849756+0000","last_fullsized":"2023-06-09T11:12:09.849756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:07.801989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845858+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:12:09.845858+0000","last_peered":"2023-06-09T11:12:09.845858+0000","last_clean":"2023-06-09T11:12:09.845858+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:12:09.845858+0000","last_undegraded":"2023-06-09T11:12:09.845858+0000","last_fullsized":"2023-06-09T11:12:09.845858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:26.915763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823010+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:12:09.823010+0000","last_peered":"2023-06-09T11:12:09.823010+0000","last_clean":"2023-06-09T11:12:09.823010+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:12:09.823010+0000","last_undegraded":"2023-06-09T11:12:09.823010+0000","last_fullsized":"2023-06-09T11:12:09.823010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:07.747592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820178+0000","last_change":"2023-06-09T11:12:08.274664+0000","last_active":"2023-06-09T11:12:09.820178+0000","last_peered":"2023-06-09T11:12:09.820178+0000","last_clean":"2023-06-09T11:12:09.820178+0000","last_became_active":"2023-06-09T11:12:08.274254+0000","last_became_peered":"2023-06-09T11:12:08.274254+0000","last_unstale":"2023-06-09T11:12:09.820178+0000","last_undegraded":"2023-06-09T11:12:09.820178+0000","last_fullsized":"2023-06-09T11:12:09.820178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:55:38.136486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139313+0000","last_change":"2023-06-09T11:12:08.833072+0000","last_active":"2023-06-09T11:12:10.139313+0000","last_peered":"2023-06-09T11:12:10.139313+0000","last_clean":"2023-06-09T11:12:10.139313+0000","last_became_active":"2023-06-09T11:12:08.832494+0000","last_became_peered":"2023-06-09T11:12:08.832494+0000","last_unstale":"2023-06-09T11:12:10.139313+0000","last_undegraded":"2023-06-09T11:12:10.139313+0000","last_fullsized":"2023-06-09T11:12:10.139313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:49.564145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.845511+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:12:09.845511+0000","last_peered":"2023-06-09T11:12:09.845511+0000","last_clean":"2023-06-09T11:12:09.845511+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:12:09.845511+0000","last_undegraded":"2023-06-09T11:12:09.845511+0000","last_fullsized":"2023-06-09T11:12:09.845511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:16.600288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140167+0000","last_change":"2023-06-09T11:12:08.288683+0000","last_active":"2023-06-09T11:12:10.140167+0000","last_peered":"2023-06-09T11:12:10.140167+0000","last_clean":"2023-06-09T11:12:10.140167+0000","last_became_active":"2023-06-09T11:12:08.288403+0000","last_became_peered":"2023-06-09T11:12:08.288403+0000","last_unstale":"2023-06-09T11:12:10.140167+0000","last_undegraded":"2023-06-09T11:12:10.140167+0000","last_fullsized":"2023-06-09T11:12:10.140167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:48.550064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140943+0000","last_change":"2023-06-09T11:12:08.835534+0000","last_active":"2023-06-09T11:12:10.140943+0000","last_peered":"2023-06-09T11:12:10.140943+0000","last_clean":"2023-06-09T11:12:10.140943+0000","last_became_active":"2023-06-09T11:12:08.835265+0000","last_became_peered":"2023-06-09T11:12:08.835265+0000","last_unstale":"2023-06-09T11:12:10.140943+0000","last_undegraded":"2023-06-09T11:12:10.140943+0000","last_fullsized":"2023-06-09T11:12:10.140943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838427+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:12:09.838427+0000","last_peered":"2023-06-09T11:12:09.838427+0000","last_clean":"2023-06-09T11:12:09.838427+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:12:09.838427+0000","last_undegraded":"2023-06-09T11:12:09.838427+0000","last_fullsized":"2023-06-09T11:12:09.838427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:17:15.668229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848689+0000","last_change":"2023-06-09T11:12:08.284371+0000","last_active":"2023-06-09T11:12:09.848689+0000","last_peered":"2023-06-09T11:12:09.848689+0000","last_clean":"2023-06-09T11:12:09.848689+0000","last_became_active":"2023-06-09T11:12:08.284025+0000","last_became_peered":"2023-06-09T11:12:08.284025+0000","last_unstale":"2023-06-09T11:12:09.848689+0000","last_undegraded":"2023-06-09T11:12:09.848689+0000","last_fullsized":"2023-06-09T11:12:09.848689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:17.551253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849884+0000","last_change":"2023-06-09T11:12:08.843683+0000","last_active":"2023-06-09T11:12:09.849884+0000","last_peered":"2023-06-09T11:12:09.849884+0000","last_clean":"2023-06-09T11:12:09.849884+0000","last_became_active":"2023-06-09T11:12:08.843390+0000","last_became_peered":"2023-06-09T11:12:08.843390+0000","last_unstale":"2023-06-09T11:12:09.849884+0000","last_undegraded":"2023-06-09T11:12:09.849884+0000","last_fullsized":"2023-06-09T11:12:09.849884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:05.411450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822778+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:12:09.822778+0000","last_peered":"2023-06-09T11:12:09.822778+0000","last_clean":"2023-06-09T11:12:09.822778+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:12:09.822778+0000","last_undegraded":"2023-06-09T11:12:09.822778+0000","last_fullsized":"2023-06-09T11:12:09.822778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:21.222898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823463+0000","last_change":"2023-06-09T11:12:08.285595+0000","last_active":"2023-06-09T11:12:09.823463+0000","last_peered":"2023-06-09T11:12:09.823463+0000","last_clean":"2023-06-09T11:12:09.823463+0000","last_became_active":"2023-06-09T11:12:08.285164+0000","last_became_peered":"2023-06-09T11:12:08.285164+0000","last_unstale":"2023-06-09T11:12:09.823463+0000","last_undegraded":"2023-06-09T11:12:09.823463+0000","last_fullsized":"2023-06-09T11:12:09.823463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849103+0000","last_change":"2023-06-09T11:12:08.834527+0000","last_active":"2023-06-09T11:12:09.849103+0000","last_peered":"2023-06-09T11:12:09.849103+0000","last_clean":"2023-06-09T11:12:09.849103+0000","last_became_active":"2023-06-09T11:12:08.834243+0000","last_became_peered":"2023-06-09T11:12:08.834243+0000","last_unstale":"2023-06-09T11:12:09.849103+0000","last_undegraded":"2023-06-09T11:12:09.849103+0000","last_fullsized":"2023-06-09T11:12:09.849103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823400+0000","last_change":"2023-06-09T11:12:08.286284+0000","last_active":"2023-06-09T11:12:09.823400+0000","last_peered":"2023-06-09T11:12:09.823400+0000","last_clean":"2023-06-09T11:12:09.823400+0000","last_became_active":"2023-06-09T11:12:08.282889+0000","last_became_peered":"2023-06-09T11:12:08.282889+0000","last_unstale":"2023-06-09T11:12:09.823400+0000","last_undegraded":"2023-06-09T11:12:09.823400+0000","last_fullsized":"2023-06-09T11:12:09.823400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849294+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:12:09.849294+0000","last_peered":"2023-06-09T11:12:09.849294+0000","last_clean":"2023-06-09T11:12:09.849294+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:12:09.849294+0000","last_undegraded":"2023-06-09T11:12:09.849294+0000","last_fullsized":"2023-06-09T11:12:09.849294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:38.034603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848923+0000","last_change":"2023-06-09T11:12:08.843701+0000","last_active":"2023-06-09T11:12:09.848923+0000","last_peered":"2023-06-09T11:12:09.848923+0000","last_clean":"2023-06-09T11:12:09.848923+0000","last_became_active":"2023-06-09T11:12:08.843450+0000","last_became_peered":"2023-06-09T11:12:08.843450+0000","last_unstale":"2023-06-09T11:12:09.848923+0000","last_undegraded":"2023-06-09T11:12:09.848923+0000","last_fullsized":"2023-06-09T11:12:09.848923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:04.736006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849032+0000","last_change":"2023-06-09T11:12:08.284028+0000","last_active":"2023-06-09T11:12:09.849032+0000","last_peered":"2023-06-09T11:12:09.849032+0000","last_clean":"2023-06-09T11:12:09.849032+0000","last_became_active":"2023-06-09T11:12:08.283697+0000","last_became_peered":"2023-06-09T11:12:08.283697+0000","last_unstale":"2023-06-09T11:12:09.849032+0000","last_undegraded":"2023-06-09T11:12:09.849032+0000","last_fullsized":"2023-06-09T11:12:09.849032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846609+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:12:09.846609+0000","last_peered":"2023-06-09T11:12:09.846609+0000","last_clean":"2023-06-09T11:12:09.846609+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:12:09.846609+0000","last_undegraded":"2023-06-09T11:12:09.846609+0000","last_fullsized":"2023-06-09T11:12:09.846609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:25:02.343312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140533+0000","last_change":"2023-06-09T11:12:08.840903+0000","last_active":"2023-06-09T11:12:10.140533+0000","last_peered":"2023-06-09T11:12:10.140533+0000","last_clean":"2023-06-09T11:12:10.140533+0000","last_became_active":"2023-06-09T11:12:08.840625+0000","last_became_peered":"2023-06-09T11:12:08.840625+0000","last_unstale":"2023-06-09T11:12:10.140533+0000","last_undegraded":"2023-06-09T11:12:10.140533+0000","last_fullsized":"2023-06-09T11:12:10.140533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:35:08.856685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.820155+0000","last_change":"2023-06-09T11:12:08.282096+0000","last_active":"2023-06-09T11:12:09.820155+0000","last_peered":"2023-06-09T11:12:09.820155+0000","last_clean":"2023-06-09T11:12:09.820155+0000","last_became_active":"2023-06-09T11:12:08.281746+0000","last_became_peered":"2023-06-09T11:12:08.281746+0000","last_unstale":"2023-06-09T11:12:09.820155+0000","last_undegraded":"2023-06-09T11:12:09.820155+0000","last_fullsized":"2023-06-09T11:12:09.820155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:51:04.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.849748+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:12:09.849748+0000","last_peered":"2023-06-09T11:12:09.849748+0000","last_clean":"2023-06-09T11:12:09.849748+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:12:09.849748+0000","last_undegraded":"2023-06-09T11:12:09.849748+0000","last_fullsized":"2023-06-09T11:12:09.849748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:50:58.945136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819086+0000","last_change":"2023-06-09T11:12:08.838416+0000","last_active":"2023-06-09T11:12:09.819086+0000","last_peered":"2023-06-09T11:12:09.819086+0000","last_clean":"2023-06-09T11:12:09.819086+0000","last_became_active":"2023-06-09T11:12:08.838099+0000","last_became_peered":"2023-06-09T11:12:08.838099+0000","last_unstale":"2023-06-09T11:12:09.819086+0000","last_undegraded":"2023-06-09T11:12:09.819086+0000","last_fullsized":"2023-06-09T11:12:09.819086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:35:18.012644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.659542+0000","last_change":"2023-06-09T11:12:08.284961+0000","last_active":"2023-06-09T11:12:10.659542+0000","last_peered":"2023-06-09T11:12:10.659542+0000","last_clean":"2023-06-09T11:12:10.659542+0000","last_became_active":"2023-06-09T11:12:08.281299+0000","last_became_peered":"2023-06-09T11:12:08.281299+0000","last_unstale":"2023-06-09T11:12:10.659542+0000","last_undegraded":"2023-06-09T11:12:10.659542+0000","last_fullsized":"2023-06-09T11:12:10.659542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:21.658968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139133+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:12:10.139133+0000","last_peered":"2023-06-09T11:12:10.139133+0000","last_clean":"2023-06-09T11:12:10.139133+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:12:10.139133+0000","last_undegraded":"2023-06-09T11:12:10.139133+0000","last_fullsized":"2023-06-09T11:12:10.139133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:39:06.854929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822149+0000","last_change":"2023-06-09T11:12:08.839244+0000","last_active":"2023-06-09T11:12:09.822149+0000","last_peered":"2023-06-09T11:12:09.822149+0000","last_clean":"2023-06-09T11:12:09.822149+0000","last_became_active":"2023-06-09T11:12:08.838923+0000","last_became_peered":"2023-06-09T11:12:08.838923+0000","last_unstale":"2023-06-09T11:12:09.822149+0000","last_undegraded":"2023-06-09T11:12:09.822149+0000","last_fullsized":"2023-06-09T11:12:09.822149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823299+0000","last_change":"2023-06-09T11:12:08.833132+0000","last_active":"2023-06-09T11:12:09.823299+0000","last_peered":"2023-06-09T11:12:09.823299+0000","last_clean":"2023-06-09T11:12:09.823299+0000","last_became_active":"2023-06-09T11:12:08.832882+0000","last_became_peered":"2023-06-09T11:12:08.832882+0000","last_unstale":"2023-06-09T11:12:09.823299+0000","last_undegraded":"2023-06-09T11:12:09.823299+0000","last_fullsized":"2023-06-09T11:12:09.823299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.824098+0000","last_change":"2023-06-09T11:12:08.275292+0000","last_active":"2023-06-09T11:12:09.824098+0000","last_peered":"2023-06-09T11:12:09.824098+0000","last_clean":"2023-06-09T11:12:09.824098+0000","last_became_active":"2023-06-09T11:12:08.274936+0000","last_became_peered":"2023-06-09T11:12:08.274936+0000","last_unstale":"2023-06-09T11:12:09.824098+0000","last_undegraded":"2023-06-09T11:12:09.824098+0000","last_fullsized":"2023-06-09T11:12:09.824098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:30:39.864965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848668+0000","last_change":"2023-06-09T11:12:08.835600+0000","last_active":"2023-06-09T11:12:09.848668+0000","last_peered":"2023-06-09T11:12:09.848668+0000","last_clean":"2023-06-09T11:12:09.848668+0000","last_became_active":"2023-06-09T11:12:08.835304+0000","last_became_peered":"2023-06-09T11:12:08.835304+0000","last_unstale":"2023-06-09T11:12:09.848668+0000","last_undegraded":"2023-06-09T11:12:09.848668+0000","last_fullsized":"2023-06-09T11:12:09.848668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.846324+0000","last_change":"2023-06-09T11:12:08.288784+0000","last_active":"2023-06-09T11:12:09.846324+0000","last_peered":"2023-06-09T11:12:09.846324+0000","last_clean":"2023-06-09T11:12:09.846324+0000","last_became_active":"2023-06-09T11:12:08.288524+0000","last_became_peered":"2023-06-09T11:12:08.288524+0000","last_unstale":"2023-06-09T11:12:09.846324+0000","last_undegraded":"2023-06-09T11:12:09.846324+0000","last_fullsized":"2023-06-09T11:12:09.846324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:58.095511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823908+0000","last_change":"2023-06-09T11:12:08.279785+0000","last_active":"2023-06-09T11:12:09.823908+0000","last_peered":"2023-06-09T11:12:09.823908+0000","last_clean":"2023-06-09T11:12:09.823908+0000","last_became_active":"2023-06-09T11:12:08.279392+0000","last_became_peered":"2023-06-09T11:12:08.279392+0000","last_unstale":"2023-06-09T11:12:09.823908+0000","last_undegraded":"2023-06-09T11:12:09.823908+0000","last_fullsized":"2023-06-09T11:12:09.823908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:16:44.593553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819358+0000","last_change":"2023-06-09T11:12:08.845707+0000","last_active":"2023-06-09T11:12:09.819358+0000","last_peered":"2023-06-09T11:12:09.819358+0000","last_clean":"2023-06-09T11:12:09.819358+0000","last_became_active":"2023-06-09T11:12:08.845389+0000","last_became_peered":"2023-06-09T11:12:08.845389+0000","last_unstale":"2023-06-09T11:12:09.819358+0000","last_undegraded":"2023-06-09T11:12:09.819358+0000","last_fullsized":"2023-06-09T11:12:09.819358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:18.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141311+0000","last_change":"2023-06-09T11:12:08.281454+0000","last_active":"2023-06-09T11:12:10.141311+0000","last_peered":"2023-06-09T11:12:10.141311+0000","last_clean":"2023-06-09T11:12:10.141311+0000","last_became_active":"2023-06-09T11:12:08.280712+0000","last_became_peered":"2023-06-09T11:12:08.280712+0000","last_unstale":"2023-06-09T11:12:10.141311+0000","last_undegraded":"2023-06-09T11:12:10.141311+0000","last_fullsized":"2023-06-09T11:12:10.141311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819053+0000","last_change":"2023-06-09T11:12:08.840190+0000","last_active":"2023-06-09T11:12:09.819053+0000","last_peered":"2023-06-09T11:12:09.819053+0000","last_clean":"2023-06-09T11:12:09.819053+0000","last_became_active":"2023-06-09T11:12:08.839207+0000","last_became_peered":"2023-06-09T11:12:08.839207+0000","last_unstale":"2023-06-09T11:12:09.819053+0000","last_undegraded":"2023-06-09T11:12:09.819053+0000","last_fullsized":"2023-06-09T11:12:09.819053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:48.819180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.139117+0000","last_change":"2023-06-09T11:12:08.842234+0000","last_active":"2023-06-09T11:12:10.139117+0000","last_peered":"2023-06-09T11:12:10.139117+0000","last_clean":"2023-06-09T11:12:10.139117+0000","last_became_active":"2023-06-09T11:12:08.841945+0000","last_became_peered":"2023-06-09T11:12:08.841945+0000","last_unstale":"2023-06-09T11:12:10.139117+0000","last_undegraded":"2023-06-09T11:12:10.139117+0000","last_fullsized":"2023-06-09T11:12:10.139117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:45.639089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819318+0000","last_change":"2023-06-09T11:12:08.287948+0000","last_active":"2023-06-09T11:12:09.819318+0000","last_peered":"2023-06-09T11:12:09.819318+0000","last_clean":"2023-06-09T11:12:09.819318+0000","last_became_active":"2023-06-09T11:12:08.287279+0000","last_became_peered":"2023-06-09T11:12:08.287279+0000","last_unstale":"2023-06-09T11:12:09.819318+0000","last_undegraded":"2023-06-09T11:12:09.819318+0000","last_fullsized":"2023-06-09T11:12:09.819318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:52.750567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140755+0000","last_change":"2023-06-09T11:12:08.846000+0000","last_active":"2023-06-09T11:12:10.140755+0000","last_peered":"2023-06-09T11:12:10.140755+0000","last_clean":"2023-06-09T11:12:10.140755+0000","last_became_active":"2023-06-09T11:12:08.845741+0000","last_became_peered":"2023-06-09T11:12:08.845741+0000","last_unstale":"2023-06-09T11:12:10.140755+0000","last_undegraded":"2023-06-09T11:12:10.140755+0000","last_fullsized":"2023-06-09T11:12:10.140755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:14:53.764648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.848766+0000","last_change":"2023-06-09T11:12:08.283831+0000","last_active":"2023-06-09T11:12:09.848766+0000","last_peered":"2023-06-09T11:12:09.848766+0000","last_clean":"2023-06-09T11:12:09.848766+0000","last_became_active":"2023-06-09T11:12:08.283264+0000","last_became_peered":"2023-06-09T11:12:08.283264+0000","last_unstale":"2023-06-09T11:12:09.848766+0000","last_undegraded":"2023-06-09T11:12:09.848766+0000","last_fullsized":"2023-06-09T11:12:09.848766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:26.281577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819930+0000","last_change":"2023-06-09T11:12:08.834819+0000","last_active":"2023-06-09T11:12:09.819930+0000","last_peered":"2023-06-09T11:12:09.819930+0000","last_clean":"2023-06-09T11:12:09.819930+0000","last_became_active":"2023-06-09T11:12:08.834508+0000","last_became_peered":"2023-06-09T11:12:08.834508+0000","last_unstale":"2023-06-09T11:12:09.819930+0000","last_undegraded":"2023-06-09T11:12:09.819930+0000","last_fullsized":"2023-06-09T11:12:09.819930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:44:22.673049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822732+0000","last_change":"2023-06-09T11:12:08.280846+0000","last_active":"2023-06-09T11:12:09.822732+0000","last_peered":"2023-06-09T11:12:09.822732+0000","last_clean":"2023-06-09T11:12:09.822732+0000","last_became_active":"2023-06-09T11:12:08.280236+0000","last_became_peered":"2023-06-09T11:12:08.280236+0000","last_unstale":"2023-06-09T11:12:09.822732+0000","last_undegraded":"2023-06-09T11:12:09.822732+0000","last_fullsized":"2023-06-09T11:12:09.822732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:16.059358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.838929+0000","last_change":"2023-06-09T11:12:08.835695+0000","last_active":"2023-06-09T11:12:09.838929+0000","last_peered":"2023-06-09T11:12:09.838929+0000","last_clean":"2023-06-09T11:12:09.838929+0000","last_became_active":"2023-06-09T11:12:08.835460+0000","last_became_peered":"2023-06-09T11:12:08.835460+0000","last_unstale":"2023-06-09T11:12:09.838929+0000","last_undegraded":"2023-06-09T11:12:09.838929+0000","last_fullsized":"2023-06-09T11:12:09.838929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:57.336221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.140920+0000","last_change":"2023-06-09T11:12:08.285330+0000","last_active":"2023-06-09T11:12:10.140920+0000","last_peered":"2023-06-09T11:12:10.140920+0000","last_clean":"2023-06-09T11:12:10.140920+0000","last_became_active":"2023-06-09T11:12:08.285034+0000","last_became_peered":"2023-06-09T11:12:08.285034+0000","last_unstale":"2023-06-09T11:12:10.140920+0000","last_undegraded":"2023-06-09T11:12:10.140920+0000","last_fullsized":"2023-06-09T11:12:10.140920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823127+0000","last_change":"2023-06-09T11:12:08.827779+0000","last_active":"2023-06-09T11:12:09.823127+0000","last_peered":"2023-06-09T11:12:09.823127+0000","last_clean":"2023-06-09T11:12:09.823127+0000","last_became_active":"2023-06-09T11:12:08.827529+0000","last_became_peered":"2023-06-09T11:12:08.827529+0000","last_unstale":"2023-06-09T11:12:09.823127+0000","last_undegraded":"2023-06-09T11:12:09.823127+0000","last_fullsized":"2023-06-09T11:12:09.823127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:44.107364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822947+0000","last_change":"2023-06-09T11:12:08.278445+0000","last_active":"2023-06-09T11:12:09.822947+0000","last_peered":"2023-06-09T11:12:09.822947+0000","last_clean":"2023-06-09T11:12:09.822947+0000","last_became_active":"2023-06-09T11:12:08.276493+0000","last_became_peered":"2023-06-09T11:12:08.276493+0000","last_unstale":"2023-06-09T11:12:09.822947+0000","last_undegraded":"2023-06-09T11:12:09.822947+0000","last_fullsized":"2023-06-09T11:12:09.822947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:32.633190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.822406+0000","last_change":"2023-06-09T11:12:08.825777+0000","last_active":"2023-06-09T11:12:09.822406+0000","last_peered":"2023-06-09T11:12:09.822406+0000","last_clean":"2023-06-09T11:12:09.822406+0000","last_became_active":"2023-06-09T11:12:08.825486+0000","last_became_peered":"2023-06-09T11:12:08.825486+0000","last_unstale":"2023-06-09T11:12:09.822406+0000","last_undegraded":"2023-06-09T11:12:09.822406+0000","last_fullsized":"2023-06-09T11:12:09.822406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:33.647272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.823362+0000","last_change":"2023-06-09T11:12:08.279306+0000","last_active":"2023-06-09T11:12:09.823362+0000","last_peered":"2023-06-09T11:12:09.823362+0000","last_clean":"2023-06-09T11:12:09.823362+0000","last_became_active":"2023-06-09T11:12:08.278839+0000","last_became_peered":"2023-06-09T11:12:08.278839+0000","last_unstale":"2023-06-09T11:12:09.823362+0000","last_undegraded":"2023-06-09T11:12:09.823362+0000","last_fullsized":"2023-06-09T11:12:09.823362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:43:06.787907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819796+0000","last_change":"2023-06-09T11:12:08.826596+0000","last_active":"2023-06-09T11:12:09.819796+0000","last_peered":"2023-06-09T11:12:09.819796+0000","last_clean":"2023-06-09T11:12:09.819796+0000","last_became_active":"2023-06-09T11:12:08.826297+0000","last_became_peered":"2023-06-09T11:12:08.826297+0000","last_unstale":"2023-06-09T11:12:09.819796+0000","last_undegraded":"2023-06-09T11:12:09.819796+0000","last_fullsized":"2023-06-09T11:12:09.819796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:13.820353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.819593+0000","last_change":"2023-06-09T11:12:08.275890+0000","last_active":"2023-06-09T11:12:09.819593+0000","last_peered":"2023-06-09T11:12:09.819593+0000","last_clean":"2023-06-09T11:12:09.819593+0000","last_became_active":"2023-06-09T11:12:08.275473+0000","last_became_peered":"2023-06-09T11:12:08.275473+0000","last_unstale":"2023-06-09T11:12:09.819593+0000","last_undegraded":"2023-06-09T11:12:09.819593+0000","last_fullsized":"2023-06-09T11:12:09.819593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:42:03.721925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:09.821857+0000","last_change":"2023-06-09T11:12:08.838762+0000","last_active":"2023-06-09T11:12:09.821857+0000","last_peered":"2023-06-09T11:12:09.821857+0000","last_clean":"2023-06-09T11:12:09.821857+0000","last_became_active":"2023-06-09T11:12:08.834883+0000","last_became_peered":"2023-06-09T11:12:08.834883+0000","last_unstale":"2023-06-09T11:12:09.821857+0000","last_undegraded":"2023-06-09T11:12:09.821857+0000","last_fullsized":"2023-06-09T11:12:09.821857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:08.239032+0000","last_clean_scrub_stamp":"2023-06-09T11:12:08.239032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:34.569047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-09T11:12:10.141101+0000","last_change":"2023-06-09T11:12:08.282540+0000","last_active":"2023-06-09T11:12:10.141101+0000","last_peered":"2023-06-09T11:12:10.141101+0000","last_clean":"2023-06-09T11:12:10.141101+0000","last_became_active":"2023-06-09T11:12:08.281150+0000","last_became_peered":"2023-06-09T11:12:08.281150+0000","last_unstale":"2023-06-09T11:12:10.141101+0000","last_undegraded":"2023-06-09T11:12:10.141101+0000","last_fullsized":"2023-06-09T11:12:10.141101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:07.224951+0000","last_clean_scrub_stamp":"2023-06-09T11:12:07.224951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:43.093283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9039999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9080,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362760,"statfs":{"total":96636764160,"available":96627466240,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:12:18.785 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-09T11:12:18.786 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-09T11:12:18.786 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-09T11:12:18.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-09T11:12:18.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.968+0000 7f4df6f37700 1 Processor -- start 2023-06-09T11:12:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.968+0000 7f4df6f37700 1 -- start start 2023-06-09T11:12:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df6f37700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015a3e0 0x7f4df006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df6f37700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00cc8e0 con 0x7f4df015e670 2023-06-09T11:12:18.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df6f37700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df015a7b0 con 0x7f4df00ce470 2023-06-09T11:12:18.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df6f37700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00ccb80 con 0x7f4df015a3e0 2023-06-09T11:12:18.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df6736700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4df015e670 0x7f4df0070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37896/0 (socket says 172.21.15.78:37896) 2023-06-09T11:12:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df6736700 1 -- 172.21.15.78:0/225107891 learned_addr learned my addr 172.21.15.78:0/225107891 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df5f35700 1 --2- 172.21.15.78:0/225107891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015a3e0 0x7f4df006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df4f33700 1 -- 172.21.15.78:0/225107891 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715820052 0 0) 0x7f4df00cc8e0 con 0x7f4df015e670 2023-06-09T11:12:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df4f33700 1 -- 172.21.15.78:0/225107891 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ddc0035d0 con 0x7f4df015e670 2023-06-09T11:12:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df4f33700 1 -- 172.21.15.78:0/225107891 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899696159 0 0) 0x7f4df015a7b0 con 0x7f4df00ce470 2023-06-09T11:12:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df4f33700 1 -- 172.21.15.78:0/225107891 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df00cc8e0 con 0x7f4df00ce470 2023-06-09T11:12:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df5f35700 1 -- 172.21.15.78:0/225107891 >> v1:172.21.15.187:6789/0 conn(0x7f4df00ce470 legacy=0x7f4df015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df5f35700 1 -- 172.21.15.78:0/225107891 >> v1:172.21.15.78:6789/0 conn(0x7f4df015e670 legacy=0x7f4df0070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df5f35700 1 -- 172.21.15.78:0/225107891 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df006b470 con 0x7f4df015a3e0 2023-06-09T11:12:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df5f35700 1 --2- 172.21.15.78:0/225107891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015a3e0 0x7f4df006e960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4dec009880 tx=0x7f4dec009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fcf4e8007193766 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df4f33700 1 -- 172.21.15.78:0/225107891 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec011830 con 0x7f4df015a3e0 2023-06-09T11:12:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df4f33700 1 -- 172.21.15.78:0/225107891 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec011990 con 0x7f4df015a3e0 2023-06-09T11:12:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.972+0000 7f4df4f33700 1 -- 172.21.15.78:0/225107891 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec011d20 con 0x7f4df015a3e0 2023-06-09T11:12:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.976+0000 7f4df6f37700 1 -- 172.21.15.78:0/225107891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015a3e0 msgr2=0x7f4df006e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.976+0000 7f4df6f37700 1 --2- 172.21.15.78:0/225107891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015a3e0 0x7f4df006e960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4dec009880 tx=0x7f4dec009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.976+0000 7f4df6f37700 1 -- 172.21.15.78:0/225107891 shutdown_connections 2023-06-09T11:12:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.976+0000 7f4df6f37700 1 --2- 172.21.15.78:0/225107891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015a3e0 0x7f4df006e960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.976+0000 7f4df6f37700 1 -- 172.21.15.78:0/225107891 >> 172.21.15.78:0/225107891 conn(0x7f4df00cf670 msgr2=0x7f4df00cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:18.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.976+0000 7f4df6f37700 1 -- 172.21.15.78:0/225107891 shutdown_connections 2023-06-09T11:12:18.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.976+0000 7f4df6f37700 1 -- 172.21.15.78:0/225107891 wait complete. 2023-06-09T11:12:18.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 Processor -- start 2023-06-09T11:12:18.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 -- start start 2023-06-09T11:12:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df00ce470 0x7f4df01493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df015a3e0 0x7f4df0148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015e670 0x7f4df014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0149a80 con 0x7f4df015a3e0 2023-06-09T11:12:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00aef90 con 0x7f4df00ce470 2023-06-09T11:12:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6f37700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00af270 con 0x7f4df015e670 2023-06-09T11:12:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df015a3e0 0x7f4df0148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df015a3e0 0x7f4df0148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47990/0 (socket says 172.21.15.78:47990) 2023-06-09T11:12:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 -- 172.21.15.78:0/1995495305 learned_addr learned my addr 172.21.15.78:0/1995495305 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df6736700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015e670 0x7f4df014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5f35700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df00ce470 0x7f4df01493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 -- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015e670 msgr2=0x7f4df014d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015e670 0x7f4df014d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 -- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df00ce470 msgr2=0x7f4df01493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df00ce470 0x7f4df01493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 -- 172.21.15.78:0/1995495305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0094b0 con 0x7f4df015a3e0 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.980+0000 7f4df5734700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df015a3e0 0x7f4df0148ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4de000c490 tx=0x7f4de000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.984+0000 7f4de67fc700 1 -- 172.21.15.78:0/1995495305 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00052d0 con 0x7f4df015a3e0 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.984+0000 7f4de67fc700 1 -- 172.21.15.78:0/1995495305 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0005450 con 0x7f4df015a3e0 2023-06-09T11:12:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.984+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df006f090 con 0x7f4df015a3e0 2023-06-09T11:12:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.984+0000 7f4de67fc700 1 -- 172.21.15.78:0/1995495305 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00038e0 con 0x7f4df015a3e0 2023-06-09T11:12:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.984+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df006b750 con 0x7f4df015a3e0 2023-06-09T11:12:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.984+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df006f220 con 0x7f4df015a3e0 2023-06-09T11:12:18.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.984+0000 7f4de67fc700 1 -- 172.21.15.78:0/1995495305 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4de0003a40 con 0x7f4df015a3e0 2023-06-09T11:12:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.988+0000 7f4de67fc700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4dd40662f0 0x7f4dd40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.988+0000 7f4de67fc700 1 -- 172.21.15.78:0/1995495305 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4de0083280 con 0x7f4df015a3e0 2023-06-09T11:12:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.988+0000 7f4df5f35700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4dd40662f0 0x7f4dd40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:18.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.988+0000 7f4df5f35700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4dd40662f0 0x7f4dd40687a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0090b0 tx=0x7f4dec01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:18.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:18.992+0000 7f4de67fc700 1 -- 172.21.15.78:0/1995495305 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4de0050660 con 0x7f4df015a3e0 2023-06-09T11:12:19.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.176+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4df00741c0 con 0x7f4df015a3e0 2023-06-09T11:12:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.176+0000 7f4de67fc700 1 -- 172.21.15.78:0/1995495305 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4de0053c80 con 0x7f4df015a3e0 2023-06-09T11:12:19.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:19.186 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-09T11:12:19.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4dd40662f0 msgr2=0x7f4dd40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4dd40662f0 0x7f4dd40687a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0090b0 tx=0x7f4dec01c040 comp rx=0 tx=0).stop 2023-06-09T11:12:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df015a3e0 msgr2=0x7f4df0148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df015a3e0 0x7f4df0148ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4de000c490 tx=0x7f4de000c850 comp rx=0 tx=0).stop 2023-06-09T11:12:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 shutdown_connections 2023-06-09T11:12:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4dd40662f0 0x7f4dd40687a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4df015e670 0x7f4df014d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df015a3e0 0x7f4df0148ad0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 --2- 172.21.15.78:0/1995495305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4df00ce470 0x7f4df01493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 >> 172.21.15.78:0/1995495305 conn(0x7f4df00cf670 msgr2=0x7f4df00b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 shutdown_connections 2023-06-09T11:12:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.180+0000 7f4df6f37700 1 -- 172.21.15.78:0/1995495305 wait complete. 2023-06-09T11:12:19.206 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-09T11:12:19.207 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:19.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.364+0000 7f5771b64700 1 Processor -- start 2023-06-09T11:12:19.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.364+0000 7f5771b64700 1 -- start start 2023-06-09T11:12:19.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771b64700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f576c06fc80 0x7f576c070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771b64700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c0c7cb0 0x7f576c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771b64700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c0c87a0 con 0x7f576c15c880 2023-06-09T11:12:19.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771b64700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c06e660 con 0x7f576c06fc80 2023-06-09T11:12:19.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771b64700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c070590 con 0x7f576c0c7cb0 2023-06-09T11:12:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5770b62700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f576c06fc80 0x7f576c070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f576bfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f576c15c880 0x7f576c06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45800/0 (socket says 172.21.15.78:45800) 2023-06-09T11:12:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f576bfff700 1 -- 172.21.15.78:0/568064701 learned_addr learned my addr 172.21.15.78:0/568064701 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771363700 1 --2- 172.21.15.78:0/568064701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c0c7cb0 0x7f576c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f576b7fe700 1 -- 172.21.15.78:0/568064701 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485348283 0 0) 0x7f576c0c87a0 con 0x7f576c15c880 2023-06-09T11:12:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f576b7fe700 1 -- 172.21.15.78:0/568064701 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c0035d0 con 0x7f576c15c880 2023-06-09T11:12:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771363700 1 -- 172.21.15.78:0/568064701 >> v2:172.21.15.187:3300/0 conn(0x7f576c06fc80 msgr2=0x7f576c070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771363700 1 --2- 172.21.15.78:0/568064701 >> v2:172.21.15.187:3300/0 conn(0x7f576c06fc80 0x7f576c070050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771363700 1 -- 172.21.15.78:0/568064701 >> v1:172.21.15.187:6789/0 conn(0x7f576c15c880 legacy=0x7f576c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.368+0000 7f5771363700 1 -- 172.21.15.78:0/568064701 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0c81e0 con 0x7f576c0c7cb0 2023-06-09T11:12:19.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771363700 1 --2- 172.21.15.78:0/568064701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c0c7cb0 0x7f576c06a870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5764009dc0 tx=0x7f576400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6aa2f6483757cd2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:19.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f576b7fe700 1 -- 172.21.15.78:0/568064701 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400e070 con 0x7f576c0c7cb0 2023-06-09T11:12:19.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f576b7fe700 1 -- 172.21.15.78:0/568064701 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400bae0 con 0x7f576c0c7cb0 2023-06-09T11:12:19.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f576b7fe700 1 -- 172.21.15.78:0/568064701 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400be90 con 0x7f576c0c7cb0 2023-06-09T11:12:19.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 -- 172.21.15.78:0/568064701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c0c7cb0 msgr2=0x7f576c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 --2- 172.21.15.78:0/568064701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c0c7cb0 0x7f576c06a870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5764009dc0 tx=0x7f576400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:19.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 -- 172.21.15.78:0/568064701 shutdown_connections 2023-06-09T11:12:19.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 --2- 172.21.15.78:0/568064701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c0c7cb0 0x7f576c06a870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 --2- 172.21.15.78:0/568064701 >> v2:172.21.15.187:3300/0 conn(0x7f576c06fc80 0x7f576c070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 -- 172.21.15.78:0/568064701 >> 172.21.15.78:0/568064701 conn(0x7f576c0cf870 msgr2=0x7f576c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:19.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 -- 172.21.15.78:0/568064701 shutdown_connections 2023-06-09T11:12:19.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.372+0000 7f5771b64700 1 -- 172.21.15.78:0/568064701 wait complete. 2023-06-09T11:12:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.376+0000 7f5771b64700 1 Processor -- start 2023-06-09T11:12:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.376+0000 7f5771b64700 1 -- start start 2023-06-09T11:12:19.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f576c06fc80 0x7f576c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c0c7cb0 0x7f576c1479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c15c880 0x7f576c15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c149180 con 0x7f576c0c7cb0 2023-06-09T11:12:19.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c1482b0 con 0x7f576c06fc80 2023-06-09T11:12:19.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c15dbd0 con 0x7f576c15c880 2023-06-09T11:12:19.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f576bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c0c7cb0 0x7f576c1479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5770b62700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f576c06fc80 0x7f576c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5770b62700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f576c06fc80 0x7f576c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37244/0 (socket says 172.21.15.78:37244) 2023-06-09T11:12:19.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5770b62700 1 -- 172.21.15.78:0/3492414682 learned_addr learned my addr 172.21.15.78:0/3492414682 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:19.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771363700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c15c880 0x7f576c15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771363700 1 -- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f576c06fc80 msgr2=0x7f576c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771363700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f576c06fc80 0x7f576c15d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771363700 1 -- 172.21.15.78:0/3492414682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c0c7cb0 msgr2=0x7f576c1479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771363700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c0c7cb0 0x7f576c1479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771363700 1 -- 172.21.15.78:0/3492414682 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764009a70 con 0x7f576c15c880 2023-06-09T11:12:19.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f576bfff700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c0c7cb0 0x7f576c1479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:19.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771363700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c15c880 0x7f576c15e010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5764009d90 tx=0x7f5764004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:19.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f57697fa700 1 -- 172.21.15.78:0/3492414682 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764004550 con 0x7f576c15c880 2023-06-09T11:12:19.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f57697fa700 1 -- 172.21.15.78:0/3492414682 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764020070 con 0x7f576c15c880 2023-06-09T11:12:19.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c06a070 con 0x7f576c15c880 2023-06-09T11:12:19.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f57697fa700 1 -- 172.21.15.78:0/3492414682 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764004910 con 0x7f576c15c880 2023-06-09T11:12:19.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.380+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c0c84c0 con 0x7f576c15c880 2023-06-09T11:12:19.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.384+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c06a350 con 0x7f576c15c880 2023-06-09T11:12:19.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.384+0000 7f57697fa700 1 -- 172.21.15.78:0/3492414682 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5764012430 con 0x7f576c15c880 2023-06-09T11:12:19.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.388+0000 7f57697fa700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57500662f0 0x7f57500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.388+0000 7f57697fa700 1 -- 172.21.15.78:0/3492414682 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5764022070 con 0x7f576c15c880 2023-06-09T11:12:19.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.388+0000 7f5770b62700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57500662f0 0x7f57500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.388+0000 7f5770b62700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57500662f0 0x7f57500687a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5760009cb0 tx=0x7f5760009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.396+0000 7f57697fa700 1 -- 172.21.15.78:0/3492414682 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5764056720 con 0x7f576c15c880 2023-06-09T11:12:19.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.568+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f576c1492c0 con 0x7f576c15c880 2023-06-09T11:12:19.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.572+0000 7f57697fa700 1 -- 172.21.15.78:0/3492414682 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f576c1492c0 con 0x7f576c15c880 2023-06-09T11:12:19.581 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:19.581 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57500662f0 msgr2=0x7f57500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57500662f0 0x7f57500687a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5760009cb0 tx=0x7f5760009240 comp rx=0 tx=0).stop 2023-06-09T11:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c15c880 msgr2=0x7f576c15e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c15c880 0x7f576c15e010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5764009d90 tx=0x7f5764004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 shutdown_connections 2023-06-09T11:12:19.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f57500662f0 0x7f57500687a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576c15c880 0x7f576c15e010 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f576c0c7cb0 0x7f576c1479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 --2- 172.21.15.78:0/3492414682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f576c06fc80 0x7f576c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 >> 172.21.15.78:0/3492414682 conn(0x7f576c0cf870 msgr2=0x7f576c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:19.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 shutdown_connections 2023-06-09T11:12:19.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.576+0000 7f5771b64700 1 -- 172.21.15.78:0/3492414682 wait complete. 2023-06-09T11:12:19.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:19.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:19.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.764+0000 7f6c2f59e700 1 Processor -- start 2023-06-09T11:12:19.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.764+0000 7f6c2f59e700 1 -- start start 2023-06-09T11:12:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2f59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2f59e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6c30161610 0x7f6c3006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2f59e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3006a070 con 0x7f6c3006b6e0 2023-06-09T11:12:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2f59e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3006a310 con 0x7f6c30161610 2023-06-09T11:12:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2f59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3006a5f0 con 0x7f6c30146c50 2023-06-09T11:12:19.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2e59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2dd9b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f6c3006b6e0 0x7f6c30160f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45812/0 (socket says 172.21.15.78:45812) 2023-06-09T11:12:19.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2dd9b700 1 -- 172.21.15.78:0/4017118351 learned_addr learned my addr 172.21.15.78:0/4017118351 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:19.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2ed9d700 1 --2- 172.21.15.78:0/4017118351 >> v2:172.21.15.187:3300/0 conn(0x7f6c30161610 0x7f6c3006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2d59a700 1 -- 172.21.15.78:0/4017118351 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291244648 0 0) 0x7f6c3006a070 con 0x7f6c3006b6e0 2023-06-09T11:12:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2d59a700 1 -- 172.21.15.78:0/4017118351 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c180035d0 con 0x7f6c3006b6e0 2023-06-09T11:12:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2e59c700 1 -- 172.21.15.78:0/4017118351 >> v2:172.21.15.187:3300/0 conn(0x7f6c30161610 msgr2=0x7f6c3006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2e59c700 1 --2- 172.21.15.78:0/4017118351 >> v2:172.21.15.187:3300/0 conn(0x7f6c30161610 0x7f6c3006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2e59c700 1 -- 172.21.15.78:0/4017118351 >> v1:172.21.15.187:6789/0 conn(0x7f6c3006b6e0 legacy=0x7f6c30160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.768+0000 7f6c2e59c700 1 -- 172.21.15.78:0/4017118351 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3006a8d0 con 0x7f6c30146c50 2023-06-09T11:12:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2e59c700 1 --2- 172.21.15.78:0/4017118351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300b2590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009850 tx=0x7f6c20009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cade3754da8fde27 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2d59a700 1 -- 172.21.15.78:0/4017118351 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20011830 con 0x7f6c30146c50 2023-06-09T11:12:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2d59a700 1 -- 172.21.15.78:0/4017118351 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c20011990 con 0x7f6c30146c50 2023-06-09T11:12:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2d59a700 1 -- 172.21.15.78:0/4017118351 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20011d40 con 0x7f6c30146c50 2023-06-09T11:12:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 -- 172.21.15.78:0/4017118351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 msgr2=0x7f6c300b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/4017118351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300b2590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009850 tx=0x7f6c20009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 -- 172.21.15.78:0/4017118351 shutdown_connections 2023-06-09T11:12:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/4017118351 >> v2:172.21.15.187:3300/0 conn(0x7f6c30161610 0x7f6c3006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/4017118351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300b2590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 -- 172.21.15.78:0/4017118351 >> 172.21.15.78:0/4017118351 conn(0x7f6c300b0780 msgr2=0x7f6c300b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 -- 172.21.15.78:0/4017118351 shutdown_connections 2023-06-09T11:12:19.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.772+0000 7f6c2f59e700 1 -- 172.21.15.78:0/4017118351 wait complete. 2023-06-09T11:12:19.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 Processor -- start 2023-06-09T11:12:19.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 -- start start 2023-06-09T11:12:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c3006b6e0 0x7f6c3013a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c30161610 0x7f6c300cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30137e90 con 0x7f6c30161610 2023-06-09T11:12:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c300cf6d0 con 0x7f6c3006b6e0 2023-06-09T11:12:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2f59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3013a5b0 con 0x7f6c30146c50 2023-06-09T11:12:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c30161610 0x7f6c300cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c30161610 0x7f6c300cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48012/0 (socket says 172.21.15.78:48012) 2023-06-09T11:12:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2ed9d700 1 -- 172.21.15.78:0/1221608412 learned_addr learned my addr 172.21.15.78:0/1221608412 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2e59c700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c3006b6e0 0x7f6c3013a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2dd9b700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2ed9d700 1 -- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 msgr2=0x7f6c300cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2ed9d700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2ed9d700 1 -- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c3006b6e0 msgr2=0x7f6c3013a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.776+0000 7f6c2ed9d700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c3006b6e0 0x7f6c3013a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c2ed9d700 1 -- 172.21.15.78:0/1221608412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200094b0 con 0x7f6c30161610 2023-06-09T11:12:19.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c2dd9b700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:19.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c2ed9d700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c30161610 0x7f6c300cba10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009dd0 tx=0x7f6c2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:19.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c1effd700 1 -- 172.21.15.78:0/1221608412 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28009c40 con 0x7f6c30161610 2023-06-09T11:12:19.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c1effd700 1 -- 172.21.15.78:0/1221608412 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2800f040 con 0x7f6c30161610 2023-06-09T11:12:19.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c1effd700 1 -- 172.21.15.78:0/1221608412 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28014480 con 0x7f6c30161610 2023-06-09T11:12:19.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3006b0d0 con 0x7f6c30161610 2023-06-09T11:12:19.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3006abb0 con 0x7f6c30161610 2023-06-09T11:12:19.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.780+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c300b2ad0 con 0x7f6c30161610 2023-06-09T11:12:19.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.784+0000 7f6c1effd700 1 -- 172.21.15.78:0/1221608412 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c280145e0 con 0x7f6c30161610 2023-06-09T11:12:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.784+0000 7f6c1effd700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6c100662f0 0x7f6c100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:19.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.784+0000 7f6c1effd700 1 -- 172.21.15.78:0/1221608412 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c28084840 con 0x7f6c30161610 2023-06-09T11:12:19.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.788+0000 7f6c2e59c700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6c100662f0 0x7f6c100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:19.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.788+0000 7f6c2e59c700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6c100662f0 0x7f6c100687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6c200090b0 tx=0x7f6c20008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.792+0000 7f6c1effd700 1 -- 172.21.15.78:0/1221608412 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6c28051cb0 con 0x7f6c30161610 2023-06-09T11:12:19.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.964+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c30067610 con 0x7f6c30161610 2023-06-09T11:12:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.964+0000 7f6c1effd700 1 -- 172.21.15.78:0/1221608412 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c280552d0 con 0x7f6c30161610 2023-06-09T11:12:19.972 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:19.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6c100662f0 msgr2=0x7f6c100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6c100662f0 0x7f6c100687a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6c200090b0 tx=0x7f6c20008030 comp rx=0 tx=0).stop 2023-06-09T11:12:19.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c30161610 msgr2=0x7f6c300cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:19.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c30161610 0x7f6c300cba10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009dd0 tx=0x7f6c2800c3a0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 shutdown_connections 2023-06-09T11:12:19.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6c100662f0 0x7f6c100687a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c30161610 0x7f6c300cba10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c30146c50 0x7f6c300cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 --2- 172.21.15.78:0/1221608412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c3006b6e0 0x7f6c3013a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:19.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 >> 172.21.15.78:0/1221608412 conn(0x7f6c300b0780 msgr2=0x7f6c30145ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:19.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 shutdown_connections 2023-06-09T11:12:19.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:19.968+0000 7f6c2f59e700 1 -- 172.21.15.78:0/1221608412 wait complete. 2023-06-09T11:12:19.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:20.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.160+0000 7fae9f57a700 1 Processor -- start 2023-06-09T11:12:20.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.160+0000 7fae9f57a700 1 -- start start 2023-06-09T11:12:20.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9f57a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae9815c9f0 0x7fae98160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9f57a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae9806d790 0x7fae980d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9f57a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae980cda60 con 0x7fae980d11b0 2023-06-09T11:12:20.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9f57a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae980d15d0 con 0x7fae9806d790 2023-06-09T11:12:20.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9f57a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae98160d70 con 0x7fae9815c9f0 2023-06-09T11:12:20.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9db17700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fae980d11b0 0x7fae9806f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37910/0 (socket says 172.21.15.78:37910) 2023-06-09T11:12:20.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9db17700 1 -- 172.21.15.78:0/119318737 learned_addr learned my addr 172.21.15.78:0/119318737 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:20.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9cb15700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae9806d790 0x7fae980d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9d316700 1 --2- 172.21.15.78:0/119318737 >> v2:172.21.15.187:3300/0 conn(0x7fae9815c9f0 0x7fae98160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae8ffff700 1 -- 172.21.15.78:0/119318737 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449288931 0 0) 0x7fae980cda60 con 0x7fae980d11b0 2023-06-09T11:12:20.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae8ffff700 1 -- 172.21.15.78:0/119318737 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae840035d0 con 0x7fae980d11b0 2023-06-09T11:12:20.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9cb15700 1 -- 172.21.15.78:0/119318737 >> v2:172.21.15.187:3300/0 conn(0x7fae9815c9f0 msgr2=0x7fae98160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9cb15700 1 --2- 172.21.15.78:0/119318737 >> v2:172.21.15.187:3300/0 conn(0x7fae9815c9f0 0x7fae98160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9cb15700 1 -- 172.21.15.78:0/119318737 >> v1:172.21.15.78:6789/0 conn(0x7fae980d11b0 legacy=0x7fae9806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9cb15700 1 -- 172.21.15.78:0/119318737 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98161050 con 0x7fae9806d790 2023-06-09T11:12:20.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9d316700 1 --2- 172.21.15.78:0/119318737 >> v2:172.21.15.187:3300/0 conn(0x7fae9815c9f0 0x7fae98160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae9cb15700 1 --2- 172.21.15.78:0/119318737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9806d790 0x7fae980d0c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae9806c320 tx=0x7fae88009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833cc22506eb5fdb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae8ffff700 1 -- 172.21.15.78:0/119318737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88011830 con 0x7fae9806d790 2023-06-09T11:12:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae8ffff700 1 -- 172.21.15.78:0/119318737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae88011990 con 0x7fae9806d790 2023-06-09T11:12:20.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.164+0000 7fae8ffff700 1 -- 172.21.15.78:0/119318737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88011d20 con 0x7fae9806d790 2023-06-09T11:12:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 -- 172.21.15.78:0/119318737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9806d790 msgr2=0x7fae980d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 --2- 172.21.15.78:0/119318737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9806d790 0x7fae980d0c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae9806c320 tx=0x7fae88009b30 comp rx=0 tx=0).stop 2023-06-09T11:12:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 -- 172.21.15.78:0/119318737 shutdown_connections 2023-06-09T11:12:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 --2- 172.21.15.78:0/119318737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9806d790 0x7fae980d0c70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 --2- 172.21.15.78:0/119318737 >> v2:172.21.15.187:3300/0 conn(0x7fae9815c9f0 0x7fae98160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 -- 172.21.15.78:0/119318737 >> 172.21.15.78:0/119318737 conn(0x7fae980b4c90 msgr2=0x7fae980b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 -- 172.21.15.78:0/119318737 shutdown_connections 2023-06-09T11:12:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.168+0000 7fae9f57a700 1 -- 172.21.15.78:0/119318737 wait complete. 2023-06-09T11:12:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 Processor -- start 2023-06-09T11:12:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 -- start start 2023-06-09T11:12:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae9806d790 0x7fae9815ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae980d11b0 0x7fae981f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9815c9f0 0x7fae9806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9815f6c0 con 0x7fae9815c9f0 2023-06-09T11:12:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae98158e00 con 0x7fae980d11b0 2023-06-09T11:12:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9f57a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae981f2100 con 0x7fae9806d790 2023-06-09T11:12:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9815c9f0 0x7fae9806dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9815c9f0 0x7fae9806dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48032/0 (socket says 172.21.15.78:48032) 2023-06-09T11:12:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 -- 172.21.15.78:0/1474023670 learned_addr learned my addr 172.21.15.78:0/1474023670 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9d316700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae9806d790 0x7fae9815ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9cb15700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae980d11b0 0x7fae981f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 -- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae9806d790 msgr2=0x7fae9815ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae9806d790 0x7fae9815ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 -- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae980d11b0 msgr2=0x7fae981f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae980d11b0 0x7fae981f1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 -- 172.21.15.78:0/1474023670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880094b0 con 0x7fae9815c9f0 2023-06-09T11:12:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9d316700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae9806d790 0x7fae9815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9cb15700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae980d11b0 0x7fae981f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.172+0000 7fae9db17700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9815c9f0 0x7fae9806dc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fae9000cb40 tx=0x7fae9000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.176+0000 7fae8dffb700 1 -- 172.21.15.78:0/1474023670 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000a9e0 con 0x7fae9815c9f0 2023-06-09T11:12:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.176+0000 7fae8dffb700 1 -- 172.21.15.78:0/1474023670 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9000ab40 con 0x7fae9815c9f0 2023-06-09T11:12:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.176+0000 7fae8dffb700 1 -- 172.21.15.78:0/1474023670 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000ce60 con 0x7fae9815c9f0 2023-06-09T11:12:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.176+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae980cd6f0 con 0x7fae9815c9f0 2023-06-09T11:12:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.176+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae98161330 con 0x7fae9815c9f0 2023-06-09T11:12:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.176+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9815cdc0 con 0x7fae9815c9f0 2023-06-09T11:12:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.176+0000 7fae8dffb700 1 -- 172.21.15.78:0/1474023670 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae9001b3b0 con 0x7fae9815c9f0 2023-06-09T11:12:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.180+0000 7fae8dffb700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fae7c0662f0 0x7fae7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.180+0000 7fae8dffb700 1 -- 172.21.15.78:0/1474023670 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae90083840 con 0x7fae9815c9f0 2023-06-09T11:12:20.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.180+0000 7fae9d316700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fae7c0662f0 0x7fae7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.180+0000 7fae9d316700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fae7c0662f0 0x7fae7c0687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c9a0 tx=0x7fae94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.184+0000 7fae8dffb700 1 -- 172.21.15.78:0/1474023670 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fae90050cc0 con 0x7fae9815c9f0 2023-06-09T11:12:20.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.356+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae98158f70 con 0x7fae9815c9f0 2023-06-09T11:12:20.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.356+0000 7fae8dffb700 1 -- 172.21.15.78:0/1474023670 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae90017020 con 0x7fae9815c9f0 2023-06-09T11:12:20.364 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:20.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fae7c0662f0 msgr2=0x7fae7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fae7c0662f0 0x7fae7c0687a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c9a0 tx=0x7fae94008040 comp rx=0 tx=0).stop 2023-06-09T11:12:20.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9815c9f0 msgr2=0x7fae9806dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9815c9f0 0x7fae9806dc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fae9000cb40 tx=0x7fae9000cc20 comp rx=0 tx=0).stop 2023-06-09T11:12:20.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 shutdown_connections 2023-06-09T11:12:20.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fae7c0662f0 0x7fae7c0687a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae9815c9f0 0x7fae9806dc70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae980d11b0 0x7fae981f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 --2- 172.21.15.78:0/1474023670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae9806d790 0x7fae9815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 >> 172.21.15.78:0/1474023670 conn(0x7fae980b4c90 msgr2=0x7fae980b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:20.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 shutdown_connections 2023-06-09T11:12:20.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.360+0000 7fae9f57a700 1 -- 172.21.15.78:0/1474023670 wait complete. 2023-06-09T11:12:20.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.552+0000 7fa7b54fc700 1 Processor -- start 2023-06-09T11:12:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.552+0000 7fa7b54fc700 1 -- start start 2023-06-09T11:12:20.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7b54fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0142a50 0x7fa7b006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7b54fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7b01600b0 0x7fa7b0143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7b54fc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b0160650 con 0x7fa7b0070890 2023-06-09T11:12:20.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7b54fc700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b006bb80 con 0x7fa7b01600b0 2023-06-09T11:12:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7b54fc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00b5f50 con 0x7fa7b0142a50 2023-06-09T11:12:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7b01600b0 0x7fa7b0143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7b01600b0 0x7fa7b0143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37290/0 (socket says 172.21.15.78:37290) 2023-06-09T11:12:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 -- 172.21.15.78:0/1989117951 learned_addr learned my addr 172.21.15.78:0/1989117951 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7affff700 1 --2- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0142a50 0x7fa7b006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 -- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0142a50 msgr2=0x7fa7b006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 --2- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0142a50 0x7fa7b006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 -- 172.21.15.78:0/1989117951 >> v1:172.21.15.187:6789/0 conn(0x7fa7b0070890 legacy=0x7fa7b00b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 -- 172.21.15.78:0/1989117951 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0160930 con 0x7fa7b01600b0 2023-06-09T11:12:20.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7affff700 1 --2- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0142a50 0x7fa7b006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7a77fe700 1 --2- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b01600b0 0x7fa7b0143260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa798009910 tx=0x7fa798009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90da9c46bd2be1a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7af7fe700 1 -- 172.21.15.78:0/1989117951 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798011830 con 0x7fa7b01600b0 2023-06-09T11:12:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7af7fe700 1 -- 172.21.15.78:0/1989117951 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798011990 con 0x7fa7b01600b0 2023-06-09T11:12:20.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.556+0000 7fa7af7fe700 1 -- 172.21.15.78:0/1989117951 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798011d40 con 0x7fa7b01600b0 2023-06-09T11:12:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 -- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b01600b0 msgr2=0x7fa7b0143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b01600b0 0x7fa7b0143260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa798009910 tx=0x7fa798009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 -- 172.21.15.78:0/1989117951 shutdown_connections 2023-06-09T11:12:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b01600b0 0x7fa7b0143260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/1989117951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0142a50 0x7fa7b006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 -- 172.21.15.78:0/1989117951 >> 172.21.15.78:0/1989117951 conn(0x7fa7b00d2e10 msgr2=0x7fa7b00d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:20.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 -- 172.21.15.78:0/1989117951 shutdown_connections 2023-06-09T11:12:20.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 -- 172.21.15.78:0/1989117951 wait complete. 2023-06-09T11:12:20.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.560+0000 7fa7b54fc700 1 Processor -- start 2023-06-09T11:12:20.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b54fc700 1 -- start start 2023-06-09T11:12:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b54fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0070890 0x7fa7b0141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b54fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b0142a50 0x7fa7b01f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b54fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7b01600b0 0x7fa7b01f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b54fc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00c8c30 con 0x7fa7b01600b0 2023-06-09T11:12:20.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b54fc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00c8f10 con 0x7fa7b0142a50 2023-06-09T11:12:20.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b54fc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b00c91f0 con 0x7fa7b0070890 2023-06-09T11:12:20.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7b4cfb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7b01600b0 0x7fa7b01f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7affff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0070890 0x7fa7b0141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7a77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b0142a50 0x7fa7b01f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7affff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0070890 0x7fa7b0141460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45846/0 (socket says 172.21.15.78:45846) 2023-06-09T11:12:20.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7affff700 1 -- 172.21.15.78:0/3684324709 learned_addr learned my addr 172.21.15.78:0/3684324709 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:20.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7a77fe700 1 -- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0070890 msgr2=0x7fa7b0141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7a77fe700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0070890 0x7fa7b0141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7a77fe700 1 -- 172.21.15.78:0/3684324709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7b01600b0 msgr2=0x7fa7b01f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7a77fe700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7b01600b0 0x7fa7b01f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7a77fe700 1 -- 172.21.15.78:0/3684324709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a00094b0 con 0x7fa7b0142a50 2023-06-09T11:12:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7affff700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0070890 0x7fa7b0141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:20.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.564+0000 7fa7a77fe700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b0142a50 0x7fa7b01f4de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa798016000 tx=0x7fa798004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.568+0000 7fa7ad7fa700 1 -- 172.21.15.78:0/3684324709 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798004510 con 0x7fa7b0142a50 2023-06-09T11:12:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.568+0000 7fa7ad7fa700 1 -- 172.21.15.78:0/3684324709 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79801e070 con 0x7fa7b0142a50 2023-06-09T11:12:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.568+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798009570 con 0x7fa7b0142a50 2023-06-09T11:12:20.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.568+0000 7fa7ad7fa700 1 -- 172.21.15.78:0/3684324709 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798003900 con 0x7fa7b0142a50 2023-06-09T11:12:20.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.568+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b0160ef0 con 0x7fa7b0142a50 2023-06-09T11:12:20.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.568+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b0160c10 con 0x7fa7b0142a50 2023-06-09T11:12:20.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.572+0000 7fa7ad7fa700 1 -- 172.21.15.78:0/3684324709 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa798003a60 con 0x7fa7b0142a50 2023-06-09T11:12:20.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.572+0000 7fa7ad7fa700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa7900662f0 0x7fa7900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.572+0000 7fa7ad7fa700 1 -- 172.21.15.78:0/3684324709 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa798084aa0 con 0x7fa7b0142a50 2023-06-09T11:12:20.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.572+0000 7fa7affff700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa7900662f0 0x7fa7900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.572+0000 7fa7affff700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa7900662f0 0x7fa7900687a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0011530 tx=0x7fa7a0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.576+0000 7fa7ad7fa700 1 -- 172.21.15.78:0/3684324709 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa798051f90 con 0x7fa7b0142a50 2023-06-09T11:12:20.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.748+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa7b01437a0 con 0x7fa7b0142a50 2023-06-09T11:12:20.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7ad7fa700 1 -- 172.21.15.78:0/3684324709 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa7980555b0 con 0x7fa7b0142a50 2023-06-09T11:12:20.758 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:20.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa7900662f0 msgr2=0x7fa7900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa7900662f0 0x7fa7900687a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0011530 tx=0x7fa7a0009240 comp rx=0 tx=0).stop 2023-06-09T11:12:20.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b0142a50 msgr2=0x7fa7b01f4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b0142a50 0x7fa7b01f4de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa798016000 tx=0x7fa798004770 comp rx=0 tx=0).stop 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 shutdown_connections 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa7900662f0 0x7fa7900687a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7b01600b0 0x7fa7b01f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b0142a50 0x7fa7b01f4de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 --2- 172.21.15.78:0/3684324709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7b0070890 0x7fa7b0141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 >> 172.21.15.78:0/3684324709 conn(0x7fa7b00d2e10 msgr2=0x7fa7b00d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 shutdown_connections 2023-06-09T11:12:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.752+0000 7fa7b54fc700 1 -- 172.21.15.78:0/3684324709 wait complete. 2023-06-09T11:12:20.781 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:20.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2510b1700 1 Processor -- start 2023-06-09T11:12:20.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2510b1700 1 -- start start 2023-06-09T11:12:20.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2510b1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe24c15cb30 0x7fe24c0d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2510b1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2510b1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c071210 con 0x7fe24c15a160 2023-06-09T11:12:20.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2510b1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c06d730 con 0x7fe24c15cb30 2023-06-09T11:12:20.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2510b1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15a530 con 0x7fe24c070890 2023-06-09T11:12:20.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe24bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe24c15a160 0x7fe24c0d26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37924/0 (socket says 172.21.15.78:37924) 2023-06-09T11:12:20.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe24bfff700 1 -- 172.21.15.78:0/3922789680 learned_addr learned my addr 172.21.15.78:0/3922789680 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:20.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe243fff700 1 --2- 172.21.15.78:0/3922789680 >> v2:172.21.15.78:3300/0 conn(0x7fe24c15cb30 0x7fe24c0d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe2508b0700 1 --2- 172.21.15.78:0/3922789680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.952+0000 7fe24b7fe700 1 -- 172.21.15.78:0/3922789680 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653239442 0 0) 0x7fe24c071210 con 0x7fe24c15a160 2023-06-09T11:12:20.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe24b7fe700 1 -- 172.21.15.78:0/3922789680 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2380035d0 con 0x7fe24c15a160 2023-06-09T11:12:20.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe243fff700 1 -- 172.21.15.78:0/3922789680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 msgr2=0x7fe24c070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:20.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe243fff700 1 --2- 172.21.15.78:0/3922789680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe243fff700 1 -- 172.21.15.78:0/3922789680 >> v1:172.21.15.78:6789/0 conn(0x7fe24c15a160 legacy=0x7fe24c0d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe243fff700 1 -- 172.21.15.78:0/3922789680 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c15d180 con 0x7fe24c15cb30 2023-06-09T11:12:20.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe243fff700 1 --2- 172.21.15.78:0/3922789680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15cb30 0x7fe24c0d0a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe234009850 tx=0x7fe234009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cb2a1863472a30 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe24b7fe700 1 -- 172.21.15.78:0/3922789680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234011830 con 0x7fe24c15cb30 2023-06-09T11:12:20.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe24b7fe700 1 -- 172.21.15.78:0/3922789680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234011990 con 0x7fe24c15cb30 2023-06-09T11:12:20.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe24b7fe700 1 -- 172.21.15.78:0/3922789680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234011d40 con 0x7fe24c15cb30 2023-06-09T11:12:20.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 -- 172.21.15.78:0/3922789680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15cb30 msgr2=0x7fe24c0d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 --2- 172.21.15.78:0/3922789680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15cb30 0x7fe24c0d0a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe234009850 tx=0x7fe234009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:20.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 -- 172.21.15.78:0/3922789680 shutdown_connections 2023-06-09T11:12:20.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 --2- 172.21.15.78:0/3922789680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 --2- 172.21.15.78:0/3922789680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15cb30 0x7fe24c0d0a80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 -- 172.21.15.78:0/3922789680 >> 172.21.15.78:0/3922789680 conn(0x7fe24c0cf930 msgr2=0x7fe24c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:20.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 -- 172.21.15.78:0/3922789680 shutdown_connections 2023-06-09T11:12:20.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.956+0000 7fe2510b1700 1 -- 172.21.15.78:0/3922789680 wait complete. 2023-06-09T11:12:20.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 Processor -- start 2023-06-09T11:12:20.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 -- start start 2023-06-09T11:12:20.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15a160 0x7fe24c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe24c15cb30 0x7fe24c14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c14c530 con 0x7fe24c15a160 2023-06-09T11:12:20.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15c9a0 con 0x7fe24c15cb30 2023-06-09T11:12:20.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2510b1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15c140 con 0x7fe24c070890 2023-06-09T11:12:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15a160 0x7fe24c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15a160 0x7fe24c157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48052/0 (socket says 172.21.15.78:48052) 2023-06-09T11:12:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 -- 172.21.15.78:0/2179499876 learned_addr learned my addr 172.21.15.78:0/2179499876 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe24bfff700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2508b0700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe24c15cb30 0x7fe24c14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 -- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 msgr2=0x7fe24c14b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c14b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 -- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe24c15cb30 msgr2=0x7fe24c14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe24c15cb30 0x7fe24c14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 -- 172.21.15.78:0/2179499876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340094b0 con 0x7fe24c15a160 2023-06-09T11:12:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe2508b0700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe24c15cb30 0x7fe24c14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:20.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.960+0000 7fe243fff700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15a160 0x7fe24c157ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe2340090b0 tx=0x7fe234004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.964+0000 7fe2497fa700 1 -- 172.21.15.78:0/2179499876 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234004520 con 0x7fe24c15a160 2023-06-09T11:12:20.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.964+0000 7fe2497fa700 1 -- 172.21.15.78:0/2179499876 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23401f070 con 0x7fe24c15a160 2023-06-09T11:12:20.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.964+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c15d740 con 0x7fe24c15a160 2023-06-09T11:12:20.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.964+0000 7fe2497fa700 1 -- 172.21.15.78:0/2179499876 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234003900 con 0x7fe24c15a160 2023-06-09T11:12:20.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.964+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c15d460 con 0x7fe24c15a160 2023-06-09T11:12:20.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.964+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c15da20 con 0x7fe24c15a160 2023-06-09T11:12:20.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.964+0000 7fe2497fa700 1 -- 172.21.15.78:0/2179499876 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe234003a60 con 0x7fe24c15a160 2023-06-09T11:12:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.968+0000 7fe2497fa700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe22c0662f0 0x7fe22c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.968+0000 7fe2497fa700 1 -- 172.21.15.78:0/2179499876 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe234021070 con 0x7fe24c15a160 2023-06-09T11:12:20.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.968+0000 7fe24bfff700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe22c0662f0 0x7fe22c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:20.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.968+0000 7fe24bfff700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe22c0662f0 0x7fe22c0687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0011e0 tx=0x7fe23c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:20.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:20.972+0000 7fe2497fa700 1 -- 172.21.15.78:0/2179499876 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe2340527b0 con 0x7fe24c15a160 2023-06-09T11:12:21.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.140+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe24c067610 con 0x7fe24c15a160 2023-06-09T11:12:21.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2497fa700 1 -- 172.21.15.78:0/2179499876 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe234006ce0 con 0x7fe24c15a160 2023-06-09T11:12:21.150 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe22c0662f0 msgr2=0x7fe22c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe22c0662f0 0x7fe22c0687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0011e0 tx=0x7fe23c009040 comp rx=0 tx=0).stop 2023-06-09T11:12:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15a160 msgr2=0x7fe24c157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15a160 0x7fe24c157ac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe2340090b0 tx=0x7fe234004770 comp rx=0 tx=0).stop 2023-06-09T11:12:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 shutdown_connections 2023-06-09T11:12:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe22c0662f0 0x7fe22c0687a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe24c15cb30 0x7fe24c14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe24c15a160 0x7fe24c157ac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 --2- 172.21.15.78:0/2179499876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe24c070890 0x7fe24c14b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 >> 172.21.15.78:0/2179499876 conn(0x7fe24c0cf930 msgr2=0x7fe24c0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 shutdown_connections 2023-06-09T11:12:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.144+0000 7fe2510b1700 1 -- 172.21.15.78:0/2179499876 wait complete. 2023-06-09T11:12:21.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:21.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.332+0000 7f3c4710e700 1 Processor -- start 2023-06-09T11:12:21.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.332+0000 7f3c4710e700 1 -- start start 2023-06-09T11:12:21.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4710e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3c4006f2a0 0x7f3c400ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4710e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c400adb00 con 0x7f3c40164c00 2023-06-09T11:12:21.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4710e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c400ccb10 con 0x7f3c40160940 2023-06-09T11:12:21.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4710e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c401653a0 con 0x7f3c4006f2a0 2023-06-09T11:12:21.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3c40164c00 0x7f3c4006dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37926/0 (socket says 172.21.15.78:37926) 2023-06-09T11:12:21.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 -- 172.21.15.78:0/929275249 learned_addr learned my addr 172.21.15.78:0/929275249 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:21.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4690d700 1 --2- 172.21.15.78:0/929275249 >> v2:172.21.15.187:3300/0 conn(0x7f3c4006f2a0 0x7f3c400ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387308478 0 0) 0x7f3c400adb00 con 0x7f3c40164c00 2023-06-09T11:12:21.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c2c0035d0 con 0x7f3c40164c00 2023-06-09T11:12:21.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 578038583 0 0) 0x7f3c2c0035d0 con 0x7f3c40164c00 2023-06-09T11:12:21.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 >> v2:172.21.15.187:3300/0 conn(0x7f3c4006f2a0 msgr2=0x7f3c400ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:21.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 --2- 172.21.15.78:0/929275249 >> v2:172.21.15.187:3300/0 conn(0x7f3c4006f2a0 0x7f3c400ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 >> v1:172.21.15.187:6789/0 conn(0x7f3c40160940 legacy=0x7f3c401644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400add50 con 0x7f3c40164c00 2023-06-09T11:12:21.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f3c30001670 con 0x7f3c40164c00 2023-06-09T11:12:21.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 >> v1:172.21.15.78:6789/0 conn(0x7f3c40164c00 legacy=0x7f3c4006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2c003a20 0x7f3c2c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c2c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2c005220 0x7f3c2c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c401653a0 con 0x7f3c2c004870 2023-06-09T11:12:21.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c00c130 con 0x7f3c2c003a20 2023-06-09T11:12:21.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c00c2f0 con 0x7f3c2c005220 2023-06-09T11:12:21.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c2c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4610c700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2c003a20 0x7f3c2c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4690d700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2c005220 0x7f3c2c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 -- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2c005220 msgr2=0x7f3c2c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c2c005220 0x7f3c2c00ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 -- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2c003a20 msgr2=0x7f3c2c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2c003a20 0x7f3c2c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4590b700 1 -- 172.21.15.78:0/929275249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c0035d0 con 0x7f3c2c004870 2023-06-09T11:12:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4610c700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c2c003a20 0x7f3c2c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:21.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.336+0000 7f3c4690d700 1 -- 172.21.15.78:0/929275249 reap_dead start 2023-06-09T11:12:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4590b700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c2c004ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c2f0 tx=0x7f3c2c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c743924130ff1c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30007c30 con 0x7f3c2c004870 2023-06-09T11:12:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3000ce50 con 0x7f3c2c004870 2023-06-09T11:12:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4510a700 1 -- 172.21.15.78:0/929275249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30005bc0 con 0x7f3c2c004870 2023-06-09T11:12:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4710e700 1 -- 172.21.15.78:0/929275249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 msgr2=0x7f3c2c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4710e700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c2c004ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c2f0 tx=0x7f3c2c0058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4710e700 1 -- 172.21.15.78:0/929275249 shutdown_connections 2023-06-09T11:12:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4710e700 1 --2- 172.21.15.78:0/929275249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c2c004ce0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4710e700 1 -- 172.21.15.78:0/929275249 >> 172.21.15.78:0/929275249 conn(0x7f3c400cf670 msgr2=0x7f3c400cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4710e700 1 -- 172.21.15.78:0/929275249 shutdown_connections 2023-06-09T11:12:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.340+0000 7f3c4710e700 1 -- 172.21.15.78:0/929275249 wait complete. 2023-06-09T11:12:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 Processor -- start 2023-06-09T11:12:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 -- start start 2023-06-09T11:12:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c4015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c401638c0 0x7f3c401555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c40161470 0x7f3c40161910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40161e50 con 0x7f3c2c004870 2023-06-09T11:12:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400b2770 con 0x7f3c401638c0 2023-06-09T11:12:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4710e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40163d30 con 0x7f3c40161470 2023-06-09T11:12:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4610c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c4015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4610c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c4015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48074/0 (socket says 172.21.15.78:48074) 2023-06-09T11:12:21.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4610c700 1 -- 172.21.15.78:0/18537607 learned_addr learned my addr 172.21.15.78:0/18537607 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:21.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.344+0000 7f3c4590b700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c401638c0 0x7f3c401555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4690d700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c40161470 0x7f3c40161910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4610c700 1 -- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c40161470 msgr2=0x7f3c40161910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4610c700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c40161470 0x7f3c40161910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4610c700 1 -- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c401638c0 msgr2=0x7f3c401555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4610c700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c401638c0 0x7f3c401555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4610c700 1 -- 172.21.15.78:0/18537607 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4006b2d0 con 0x7f3c2c004870 2023-06-09T11:12:21.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4610c700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c4015a640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00e4e0 tx=0x7f3c3c00e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:21.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c36ffd700 1 -- 172.21.15.78:0/18537607 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00ee70 con 0x7f3c2c004870 2023-06-09T11:12:21.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c36ffd700 1 -- 172.21.15.78:0/18537607 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0052e0 con 0x7f3c2c004870 2023-06-09T11:12:21.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c401650c0 con 0x7f3c2c004870 2023-06-09T11:12:21.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c36ffd700 1 -- 172.21.15.78:0/18537607 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0036a0 con 0x7f3c2c004870 2023-06-09T11:12:21.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4006f880 con 0x7f3c2c004870 2023-06-09T11:12:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.348+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c400741c0 con 0x7f3c2c004870 2023-06-09T11:12:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.352+0000 7f3c36ffd700 1 -- 172.21.15.78:0/18537607 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c3c003800 con 0x7f3c2c004870 2023-06-09T11:12:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.352+0000 7f3c36ffd700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3c240662f0 0x7f3c240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.352+0000 7f3c36ffd700 1 -- 172.21.15.78:0/18537607 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c3c083200 con 0x7f3c2c004870 2023-06-09T11:12:21.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.352+0000 7f3c4590b700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3c240662f0 0x7f3c240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.352+0000 7f3c4590b700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3c240662f0 0x7f3c240687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c400b2670 tx=0x7f3c30007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:21.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.356+0000 7f3c36ffd700 1 -- 172.21.15.78:0/18537607 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3c3c050880 con 0x7f3c2c004870 2023-06-09T11:12:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.564+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c4006b0b0 con 0x7f3c2c004870 2023-06-09T11:12:21.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.564+0000 7f3c36ffd700 1 -- 172.21.15.78:0/18537607 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f3c3c053ea0 con 0x7f3c2c004870 2023-06-09T11:12:21.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:21.573 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3c240662f0 msgr2=0x7f3c240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3c240662f0 0x7f3c240687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c400b2670 tx=0x7f3c30007000 comp rx=0 tx=0).stop 2023-06-09T11:12:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 msgr2=0x7f3c4015a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c4015a640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00e4e0 tx=0x7f3c3c00e7f0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 shutdown_connections 2023-06-09T11:12:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3c240662f0 0x7f3c240687a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c40161470 0x7f3c40161910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c401638c0 0x7f3c401555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 --2- 172.21.15.78:0/18537607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3c2c004870 0x7f3c4015a640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 >> 172.21.15.78:0/18537607 conn(0x7f3c400cf670 msgr2=0x7f3c400c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 shutdown_connections 2023-06-09T11:12:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.568+0000 7f3c4710e700 1 -- 172.21.15.78:0/18537607 wait complete. 2023-06-09T11:12:21.578 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:21.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:21.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce78a2f700 1 Processor -- start 2023-06-09T11:12:21.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce78a2f700 1 -- start start 2023-06-09T11:12:21.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce78a2f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce74070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce78a2f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce7415c880 0x7fce7406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce78a2f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740c87a0 con 0x7fce740c7cb0 2023-06-09T11:12:21.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce78a2f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce74070590 con 0x7fce7415c880 2023-06-09T11:12:21.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce78a2f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c81e0 con 0x7fce7406fc80 2023-06-09T11:12:21.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce737fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce74070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce72ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce7415c880 0x7fce7406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce737fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce74070050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45886/0 (socket says 172.21.15.78:45886) 2023-06-09T11:12:21.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce737fe700 1 -- 172.21.15.78:0/390092585 learned_addr learned my addr 172.21.15.78:0/390092585 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:21.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce73fff700 1 --1- 172.21.15.78:0/390092585 >> v1:172.21.15.187:6789/0 conn(0x7fce740c7cb0 0x7fce7406a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45842/0 (socket says 172.21.15.78:45842) 2023-06-09T11:12:21.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce72ffd700 1 -- 172.21.15.78:0/390092585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 msgr2=0x7fce74070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:21.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce727fc700 1 -- 172.21.15.78:0/390092585 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920358107 0 0) 0x7fce740c87a0 con 0x7fce740c7cb0 2023-06-09T11:12:21.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce72ffd700 1 --2- 172.21.15.78:0/390092585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce74070050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.756+0000 7fce72ffd700 1 -- 172.21.15.78:0/390092585 >> v1:172.21.15.187:6789/0 conn(0x7fce740c7cb0 legacy=0x7fce7406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce72ffd700 1 -- 172.21.15.78:0/390092585 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740c84c0 con 0x7fce7415c880 2023-06-09T11:12:21.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce72ffd700 1 --2- 172.21.15.78:0/390092585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce7415c880 0x7fce7406df50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce68009850 tx=0x7fce68009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bcee2a587d4f21 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:21.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce727fc700 1 -- 172.21.15.78:0/390092585 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011830 con 0x7fce7415c880 2023-06-09T11:12:21.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce727fc700 1 -- 172.21.15.78:0/390092585 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68011990 con 0x7fce7415c880 2023-06-09T11:12:21.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce727fc700 1 -- 172.21.15.78:0/390092585 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011d40 con 0x7fce7415c880 2023-06-09T11:12:21.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 -- 172.21.15.78:0/390092585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce7415c880 msgr2=0x7fce7406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 --2- 172.21.15.78:0/390092585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce7415c880 0x7fce7406df50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce68009850 tx=0x7fce68009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 -- 172.21.15.78:0/390092585 shutdown_connections 2023-06-09T11:12:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 --2- 172.21.15.78:0/390092585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce7415c880 0x7fce7406df50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 --2- 172.21.15.78:0/390092585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce74070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 -- 172.21.15.78:0/390092585 >> 172.21.15.78:0/390092585 conn(0x7fce740cf870 msgr2=0x7fce740cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 -- 172.21.15.78:0/390092585 shutdown_connections 2023-06-09T11:12:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.760+0000 7fce78a2f700 1 -- 172.21.15.78:0/390092585 wait complete. 2023-06-09T11:12:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 Processor -- start 2023-06-09T11:12:21.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 -- start start 2023-06-09T11:12:21.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce7415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce740c7cb0 0x7fce741609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7415c880 0x7fce7408b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce74160560 con 0x7fce740c7cb0 2023-06-09T11:12:21.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7415fc30 con 0x7fce7415c880 2023-06-09T11:12:21.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7415ff10 con 0x7fce7406fc80 2023-06-09T11:12:21.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce740c7cb0 0x7fce741609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce740c7cb0 0x7fce741609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48096/0 (socket says 172.21.15.78:48096) 2023-06-09T11:12:21.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 -- 172.21.15.78:0/2234969029 learned_addr learned my addr 172.21.15.78:0/2234969029 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:21.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce73fff700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7415c880 0x7fce7408b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce737fe700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce7415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 -- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 msgr2=0x7fce7415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce7415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 -- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7415c880 msgr2=0x7fce7408b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7415c880 0x7fce7408b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 -- 172.21.15.78:0/2234969029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680094b0 con 0x7fce740c7cb0 2023-06-09T11:12:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce73fff700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7415c880 0x7fce7408b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce72ffd700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce740c7cb0 0x7fce741609f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce68009ba0 tx=0x7fce68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce5bfff700 1 -- 172.21.15.78:0/2234969029 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68004610 con 0x7fce740c7cb0 2023-06-09T11:12:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce5bfff700 1 -- 172.21.15.78:0/2234969029 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6801e070 con 0x7fce740c7cb0 2023-06-09T11:12:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce5bfff700 1 -- 172.21.15.78:0/2234969029 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68003900 con 0x7fce740c7cb0 2023-06-09T11:12:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.764+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7406a350 con 0x7fce740c7cb0 2023-06-09T11:12:21.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.768+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7406a070 con 0x7fce740c7cb0 2023-06-09T11:12:21.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.768+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7406e490 con 0x7fce740c7cb0 2023-06-09T11:12:21.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.768+0000 7fce5bfff700 1 -- 172.21.15.78:0/2234969029 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce68003a60 con 0x7fce740c7cb0 2023-06-09T11:12:21.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.768+0000 7fce5bfff700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fce600662f0 0x7fce600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:21.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.772+0000 7fce5bfff700 1 -- 172.21.15.78:0/2234969029 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce68084bd0 con 0x7fce740c7cb0 2023-06-09T11:12:21.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.772+0000 7fce737fe700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fce600662f0 0x7fce600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:21.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.772+0000 7fce737fe700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fce600662f0 0x7fce600687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce64009ae0 tx=0x7fce64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:21.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.776+0000 7fce5bfff700 1 -- 172.21.15.78:0/2234969029 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fce68052040 con 0x7fce740c7cb0 2023-06-09T11:12:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.944+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce740741c0 con 0x7fce740c7cb0 2023-06-09T11:12:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.944+0000 7fce5bfff700 1 -- 172.21.15.78:0/2234969029 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7fce68020090 con 0x7fce740c7cb0 2023-06-09T11:12:21.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:21.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fce600662f0 msgr2=0x7fce600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fce600662f0 0x7fce600687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce64009ae0 tx=0x7fce64008040 comp rx=0 tx=0).stop 2023-06-09T11:12:21.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce740c7cb0 msgr2=0x7fce741609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:21.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce740c7cb0 0x7fce741609f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce68009ba0 tx=0x7fce68004770 comp rx=0 tx=0).stop 2023-06-09T11:12:21.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 shutdown_connections 2023-06-09T11:12:21.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fce600662f0 0x7fce600687a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7415c880 0x7fce7408b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce740c7cb0 0x7fce741609f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 --2- 172.21.15.78:0/2234969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7406fc80 0x7fce7415e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:21.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.948+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 >> 172.21.15.78:0/2234969029 conn(0x7fce740cf870 msgr2=0x7fce740cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:21.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.952+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 shutdown_connections 2023-06-09T11:12:21.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:21.952+0000 7fce78a2f700 1 -- 172.21.15.78:0/2234969029 wait complete. 2023-06-09T11:12:21.980 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:21.981 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.152+0000 7fe6bab16700 1 Processor -- start 2023-06-09T11:12:22.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6bab16700 1 -- start start 2023-06-09T11:12:22.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6bab16700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe6b415a160 0x7fe6b415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6bab16700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b4070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6bab16700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b4071210 con 0x7fe6b40d26d0 2023-06-09T11:12:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6bab16700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b40d1190 con 0x7fe6b415a160 2023-06-09T11:12:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6bab16700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b406d730 con 0x7fe6b4070890 2023-06-09T11:12:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b4070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b4070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45906/0 (socket says 172.21.15.78:45906) 2023-06-09T11:12:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 -- 172.21.15.78:0/2741808566 learned_addr learned my addr 172.21.15.78:0/2741808566 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6b9313700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe6b40d26d0 0x7fe6b40d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45854/0 (socket says 172.21.15.78:45854) 2023-06-09T11:12:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6b9b14700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe6b415a160 0x7fe6b415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 -- 172.21.15.78:0/2741808566 >> v2:172.21.15.187:3300/0 conn(0x7fe6b415a160 msgr2=0x7fe6b415cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 --2- 172.21.15.78:0/2741808566 >> v2:172.21.15.187:3300/0 conn(0x7fe6b415a160 0x7fe6b415cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 -- 172.21.15.78:0/2741808566 >> v1:172.21.15.187:6789/0 conn(0x7fe6b40d26d0 legacy=0x7fe6b40d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 -- 172.21.15.78:0/2741808566 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b415a530 con 0x7fe6b4070890 2023-06-09T11:12:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6b8b12700 1 -- 172.21.15.78:0/2741808566 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404845866 0 0) 0x7fe6b4071210 con 0x7fe6b40d26d0 2023-06-09T11:12:22.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.156+0000 7fe6ba315700 1 --2- 172.21.15.78:0/2741808566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b4070cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009e50 tx=0x7fe6ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e965a0ff78c709e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6b8b12700 1 -- 172.21.15.78:0/2741808566 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00e070 con 0x7fe6b4070890 2023-06-09T11:12:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6b8b12700 1 -- 172.21.15.78:0/2741808566 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac00b910 con 0x7fe6b4070890 2023-06-09T11:12:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6b8b12700 1 -- 172.21.15.78:0/2741808566 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00bcc0 con 0x7fe6b4070890 2023-06-09T11:12:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 -- 172.21.15.78:0/2741808566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 msgr2=0x7fe6b4070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 --2- 172.21.15.78:0/2741808566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b4070cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009e50 tx=0x7fe6ac00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:22.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 -- 172.21.15.78:0/2741808566 shutdown_connections 2023-06-09T11:12:22.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 --2- 172.21.15.78:0/2741808566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b4070cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 --2- 172.21.15.78:0/2741808566 >> v2:172.21.15.187:3300/0 conn(0x7fe6b415a160 0x7fe6b415cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 -- 172.21.15.78:0/2741808566 >> 172.21.15.78:0/2741808566 conn(0x7fe6b40cf930 msgr2=0x7fe6b40cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:22.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 -- 172.21.15.78:0/2741808566 shutdown_connections 2023-06-09T11:12:22.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.160+0000 7fe6bab16700 1 -- 172.21.15.78:0/2741808566 wait complete. 2023-06-09T11:12:22.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 Processor -- start 2023-06-09T11:12:22.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 -- start start 2023-06-09T11:12:22.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b40b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b40d26d0 0x7fe6b40b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6b415a160 0x7fe6b415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b414f590 con 0x7fe6b40d26d0 2023-06-09T11:12:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b414f7a0 con 0x7fe6b415a160 2023-06-09T11:12:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6bab16700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b414fa80 con 0x7fe6b4070890 2023-06-09T11:12:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6b9313700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b40d26d0 0x7fe6b40b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6b9b14700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b40b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6b9b14700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b40b6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:45914/0 (socket says 172.21.15.78:45914) 2023-06-09T11:12:22.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6b9b14700 1 -- 172.21.15.78:0/3002872300 learned_addr learned my addr 172.21.15.78:0/3002872300 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:22.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6ba315700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6b415a160 0x7fe6b415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.164+0000 7fe6b9313700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b40d26d0 0x7fe6b40b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48108/0 (socket says 172.21.15.78:48108) 2023-06-09T11:12:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6b9b14700 1 -- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6b415a160 msgr2=0x7fe6b415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6b9b14700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6b415a160 0x7fe6b415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6b9b14700 1 -- 172.21.15.78:0/3002872300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b40d26d0 msgr2=0x7fe6b40b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6b9b14700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b40d26d0 0x7fe6b40b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6b9b14700 1 -- 172.21.15.78:0/3002872300 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac009b30 con 0x7fe6b4070890 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6ba315700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6b415a160 0x7fe6b415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6b9313700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b40d26d0 0x7fe6b40b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6b9b14700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b40b6830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000e9d0 tx=0x7fe6b000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6aa7fc700 1 -- 172.21.15.78:0/3002872300 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0009720 con 0x7fe6b4070890 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6aa7fc700 1 -- 172.21.15.78:0/3002872300 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b000ee70 con 0x7fe6b4070890 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b415d460 con 0x7fe6b4070890 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6aa7fc700 1 -- 172.21.15.78:0/3002872300 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000ca50 con 0x7fe6b4070890 2023-06-09T11:12:22.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.168+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b415d180 con 0x7fe6b4070890 2023-06-09T11:12:22.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.172+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b415d740 con 0x7fe6b4070890 2023-06-09T11:12:22.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.172+0000 7fe6aa7fc700 1 -- 172.21.15.78:0/3002872300 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6b000cbb0 con 0x7fe6b4070890 2023-06-09T11:12:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.176+0000 7fe6aa7fc700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe6980662f0 0x7fe6980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.176+0000 7fe6aa7fc700 1 -- 172.21.15.78:0/3002872300 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6b0083db0 con 0x7fe6b4070890 2023-06-09T11:12:22.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.176+0000 7fe6b9313700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe6980662f0 0x7fe6980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.176+0000 7fe6b9313700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe6980662f0 0x7fe6980687a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6b415a0b0 tx=0x7fe6a4007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.180+0000 7fe6aa7fc700 1 -- 172.21.15.78:0/3002872300 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe6b0054c20 con 0x7fe6b4070890 2023-06-09T11:12:22.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.356+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6b4067610 con 0x7fe6b4070890 2023-06-09T11:12:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.356+0000 7fe6aa7fc700 1 -- 172.21.15.78:0/3002872300 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6b00170a0 con 0x7fe6b4070890 2023-06-09T11:12:22.365 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:22.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe6980662f0 msgr2=0x7fe6980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe6980662f0 0x7fe6980687a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6b415a0b0 tx=0x7fe6a4007e00 comp rx=0 tx=0).stop 2023-06-09T11:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 msgr2=0x7fe6b40b6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b40b6830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000e9d0 tx=0x7fe6b000ece0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 shutdown_connections 2023-06-09T11:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe6980662f0 0x7fe6980687a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6b415a160 0x7fe6b415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b40d26d0 0x7fe6b40b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 --2- 172.21.15.78:0/3002872300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6b4070890 0x7fe6b40b6830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 >> 172.21.15.78:0/3002872300 conn(0x7fe6b40cf930 msgr2=0x7fe6b40c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 shutdown_connections 2023-06-09T11:12:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.360+0000 7fe6bab16700 1 -- 172.21.15.78:0/3002872300 wait complete. 2023-06-09T11:12:22.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:22.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.556+0000 7f12e80c3700 1 Processor -- start 2023-06-09T11:12:22.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.556+0000 7f12e80c3700 1 -- start start 2023-06-09T11:12:22.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e80c3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e015c9f0 0x7f12e0160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e80c3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12e006d790 0x7f12e00d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e80c3700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f12e00d11b0 0x7f12e006f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e80c3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00d1630 con 0x7f12e006d790 2023-06-09T11:12:22.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e80c3700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00cda60 con 0x7f12e00d11b0 2023-06-09T11:12:22.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e80c3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0160d70 con 0x7f12e015c9f0 2023-06-09T11:12:22.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12e006d790 0x7f12e00d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12e006d790 0x7f12e00d0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48114/0 (socket says 172.21.15.78:48114) 2023-06-09T11:12:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 -- 172.21.15.78:0/776574951 learned_addr learned my addr 172.21.15.78:0/776574951 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e5e5f700 1 --2- 172.21.15.78:0/776574951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e015c9f0 0x7f12e0160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e6660700 1 --2- 172.21.15.78:0/776574951 >> v2:172.21.15.187:3300/0 conn(0x7f12e00d11b0 0x7f12e006f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 -- 172.21.15.78:0/776574951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e015c9f0 msgr2=0x7f12e0160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 --2- 172.21.15.78:0/776574951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e015c9f0 0x7f12e0160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 -- 172.21.15.78:0/776574951 >> v2:172.21.15.187:3300/0 conn(0x7f12e00d11b0 msgr2=0x7f12e006f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:22.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 --2- 172.21.15.78:0/776574951 >> v2:172.21.15.187:3300/0 conn(0x7f12e00d11b0 0x7f12e006f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 -- 172.21.15.78:0/776574951 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e0161050 con 0x7f12e006d790 2023-06-09T11:12:22.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e565e700 1 --2- 172.21.15.78:0/776574951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e006d790 0x7f12e00d0c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12e0070a90 tx=0x7f12d0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6032ceb7ceaea96 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e4e5d700 1 -- 172.21.15.78:0/776574951 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000b8a0 con 0x7f12e006d790 2023-06-09T11:12:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e4e5d700 1 -- 172.21.15.78:0/776574951 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d000ba00 con 0x7f12e006d790 2023-06-09T11:12:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.560+0000 7f12e4e5d700 1 -- 172.21.15.78:0/776574951 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000bd90 con 0x7f12e006d790 2023-06-09T11:12:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 -- 172.21.15.78:0/776574951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e006d790 msgr2=0x7f12e00d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 --2- 172.21.15.78:0/776574951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e006d790 0x7f12e00d0c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12e0070a90 tx=0x7f12d0009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 -- 172.21.15.78:0/776574951 shutdown_connections 2023-06-09T11:12:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 --2- 172.21.15.78:0/776574951 >> v2:172.21.15.187:3300/0 conn(0x7f12e00d11b0 0x7f12e006f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 --2- 172.21.15.78:0/776574951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e006d790 0x7f12e00d0c70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 --2- 172.21.15.78:0/776574951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e015c9f0 0x7f12e0160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 -- 172.21.15.78:0/776574951 >> 172.21.15.78:0/776574951 conn(0x7f12e00b4c90 msgr2=0x7f12e00b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 -- 172.21.15.78:0/776574951 shutdown_connections 2023-06-09T11:12:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 -- 172.21.15.78:0/776574951 wait complete. 2023-06-09T11:12:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 Processor -- start 2023-06-09T11:12:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.564+0000 7f12e80c3700 1 -- start start 2023-06-09T11:12:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12e006d790 0x7f12e00b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e00d11b0 0x7f12e01f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e015c9f0 0x7f12e01f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00ca170 con 0x7f12e015c9f0 2023-06-09T11:12:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e01f2060 con 0x7f12e006d790 2023-06-09T11:12:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00ca3c0 con 0x7f12e00d11b0 2023-06-09T11:12:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e015c9f0 0x7f12e01f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e5e5f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12e006d790 0x7f12e00b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e015c9f0 0x7f12e01f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48124/0 (socket says 172.21.15.78:48124) 2023-06-09T11:12:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 -- 172.21.15.78:0/1176255178 learned_addr learned my addr 172.21.15.78:0/1176255178 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e565e700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e00d11b0 0x7f12e01f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 -- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e00d11b0 msgr2=0x7f12e01f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e00d11b0 0x7f12e01f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 -- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12e006d790 msgr2=0x7f12e00b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12e006d790 0x7f12e00b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 -- 172.21.15.78:0/1176255178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d0009570 con 0x7f12e015c9f0 2023-06-09T11:12:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e6660700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e015c9f0 0x7f12e01f1b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f12d8007e90 tx=0x7f12d800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12d67fc700 1 -- 172.21.15.78:0/1176255178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d800ed30 con 0x7f12e015c9f0 2023-06-09T11:12:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12d67fc700 1 -- 172.21.15.78:0/1176255178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d800eeb0 con 0x7f12e015c9f0 2023-06-09T11:12:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12d67fc700 1 -- 172.21.15.78:0/1176255178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8014640 con 0x7f12e015c9f0 2023-06-09T11:12:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e00cd6f0 con 0x7f12e015c9f0 2023-06-09T11:12:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.568+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e0161330 con 0x7f12e015c9f0 2023-06-09T11:12:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.572+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e015cdc0 con 0x7f12e015c9f0 2023-06-09T11:12:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.572+0000 7f12d67fc700 1 -- 172.21.15.78:0/1176255178 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12d80147a0 con 0x7f12e015c9f0 2023-06-09T11:12:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.572+0000 7f12d67fc700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f12c40662f0 0x7f12c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.576+0000 7f12d67fc700 1 -- 172.21.15.78:0/1176255178 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12d80842a0 con 0x7f12e015c9f0 2023-06-09T11:12:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.576+0000 7f12e5e5f700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f12c40662f0 0x7f12c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.576+0000 7f12e5e5f700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f12c40662f0 0x7f12c40687a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12e01549d0 tx=0x7f12dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.580+0000 7f12d67fc700 1 -- 172.21.15.78:0/1176255178 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f12d80517b0 con 0x7f12e015c9f0 2023-06-09T11:12:22.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.748+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12e00741c0 con 0x7f12e015c9f0 2023-06-09T11:12:22.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.748+0000 7f12d67fc700 1 -- 172.21.15.78:0/1176255178 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12d8054dd0 con 0x7f12e015c9f0 2023-06-09T11:12:22.757 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f12c40662f0 msgr2=0x7f12c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f12c40662f0 0x7f12c40687a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12e01549d0 tx=0x7f12dc008040 comp rx=0 tx=0).stop 2023-06-09T11:12:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e015c9f0 msgr2=0x7f12e01f1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e015c9f0 0x7f12e01f1b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f12d8007e90 tx=0x7f12d800e3c0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 shutdown_connections 2023-06-09T11:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f12c40662f0 0x7f12c40687a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12e015c9f0 0x7f12e01f1b20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12e00d11b0 0x7f12e01f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 --2- 172.21.15.78:0/1176255178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12e006d790 0x7f12e00b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 >> 172.21.15.78:0/1176255178 conn(0x7f12e00b4c90 msgr2=0x7f12e00c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:22.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 shutdown_connections 2023-06-09T11:12:22.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.752+0000 7f12e80c3700 1 -- 172.21.15.78:0/1176255178 wait complete. 2023-06-09T11:12:22.781 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.952+0000 7f1ad54a3700 1 Processor -- start 2023-06-09T11:12:22.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.952+0000 7f1ad54a3700 1 -- start start 2023-06-09T11:12:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.952+0000 7f1ad54a3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad015feb0 0x7f1ad00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.952+0000 7f1ad54a3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad006ea80 con 0x7f1ad006d790 2023-06-09T11:12:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.952+0000 7f1ad54a3700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad0160280 con 0x7f1ad00cf5e0 2023-06-09T11:12:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.952+0000 7f1ad54a3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00d1c60 con 0x7f1ad015feb0 2023-06-09T11:12:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1ace7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1ad006d790 0x7f1ad006dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37940/0 (socket says 172.21.15.78:37940) 2023-06-09T11:12:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1ace7fc700 1 -- 172.21.15.78:0/124744227 learned_addr learned my addr 172.21.15.78:0/124744227 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1aceffd700 1 --2- 172.21.15.78:0/124744227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad015feb0 0x7f1ad00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1acdffb700 1 -- 172.21.15.78:0/124744227 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574500702 0 0) 0x7f1ad006ea80 con 0x7f1ad006d790 2023-06-09T11:12:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1acdffb700 1 -- 172.21.15.78:0/124744227 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab80035d0 con 0x7f1ad006d790 2023-06-09T11:12:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1acdffb700 1 -- 172.21.15.78:0/124744227 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770261059 0 0) 0x7f1ad0160280 con 0x7f1ad00cf5e0 2023-06-09T11:12:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1acdffb700 1 -- 172.21.15.78:0/124744227 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad006ea80 con 0x7f1ad00cf5e0 2023-06-09T11:12:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1aceffd700 1 -- 172.21.15.78:0/124744227 >> v1:172.21.15.187:6789/0 conn(0x7f1ad00cf5e0 legacy=0x7f1ad006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1aceffd700 1 -- 172.21.15.78:0/124744227 >> v1:172.21.15.78:6789/0 conn(0x7f1ad006d790 legacy=0x7f1ad006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1aceffd700 1 -- 172.21.15.78:0/124744227 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0160f00 con 0x7f1ad015feb0 2023-06-09T11:12:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1aceffd700 1 --2- 172.21.15.78:0/124744227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad015feb0 0x7f1ad00d0f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009880 tx=0x7f1ac0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ca7e70e1402ce5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1acdffb700 1 -- 172.21.15.78:0/124744227 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0011830 con 0x7f1ad015feb0 2023-06-09T11:12:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1acdffb700 1 -- 172.21.15.78:0/124744227 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0011990 con 0x7f1ad015feb0 2023-06-09T11:12:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1acdffb700 1 -- 172.21.15.78:0/124744227 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0011d20 con 0x7f1ad015feb0 2023-06-09T11:12:22.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1ad54a3700 1 -- 172.21.15.78:0/124744227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad015feb0 msgr2=0x7f1ad00d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.956+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/124744227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad015feb0 0x7f1ad00d0f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009880 tx=0x7f1ac0009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:22.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- 172.21.15.78:0/124744227 shutdown_connections 2023-06-09T11:12:22.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/124744227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad015feb0 0x7f1ad00d0f30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- 172.21.15.78:0/124744227 >> 172.21.15.78:0/124744227 conn(0x7f1ad00b5950 msgr2=0x7f1ad00d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:22.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- 172.21.15.78:0/124744227 shutdown_connections 2023-06-09T11:12:22.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- 172.21.15.78:0/124744227 wait complete. 2023-06-09T11:12:22.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 Processor -- start 2023-06-09T11:12:22.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- start start 2023-06-09T11:12:22.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ad006d790 0x7f1ad0148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad00cf5e0 0x7f1ad00c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ad015feb0 0x7f1ad014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad015d600 con 0x7f1ad015feb0 2023-06-09T11:12:22.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad01488c0 con 0x7f1ad006d790 2023-06-09T11:12:22.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1ad54a3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad015d830 con 0x7f1ad00cf5e0 2023-06-09T11:12:22.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.960+0000 7f1acf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ad015feb0 0x7f1ad014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ad015feb0 0x7f1ad014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48136/0 (socket says 172.21.15.78:48136) 2023-06-09T11:12:22.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 -- 172.21.15.78:0/3021512495 learned_addr learned my addr 172.21.15.78:0/3021512495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:22.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1ace7fc700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad00cf5e0 0x7f1ad00c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1aceffd700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ad006d790 0x7f1ad0148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 -- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad00cf5e0 msgr2=0x7f1ad00c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad00cf5e0 0x7f1ad00c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 -- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ad006d790 msgr2=0x7f1ad0148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ad006d790 0x7f1ad0148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 -- 172.21.15.78:0/3021512495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac00094b0 con 0x7f1ad015feb0 2023-06-09T11:12:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1aceffd700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ad006d790 0x7f1ad0148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1acf7fe700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ad015feb0 0x7f1ad014ded0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800cc50 tx=0x7f1ac800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1ab77fe700 1 -- 172.21.15.78:0/3021512495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8003c20 con 0x7f1ad015feb0 2023-06-09T11:12:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1ab77fe700 1 -- 172.21.15.78:0/3021512495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac8003d80 con 0x7f1ad015feb0 2023-06-09T11:12:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad00cf010 con 0x7f1ad015feb0 2023-06-09T11:12:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1ab77fe700 1 -- 172.21.15.78:0/3021512495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800ab80 con 0x7f1ad015feb0 2023-06-09T11:12:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad01611e0 con 0x7f1ad015feb0 2023-06-09T11:12:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.964+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad00cf2f0 con 0x7f1ad015feb0 2023-06-09T11:12:22.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.968+0000 7f1ab77fe700 1 -- 172.21.15.78:0/3021512495 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ac800ace0 con 0x7f1ad015feb0 2023-06-09T11:12:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.968+0000 7f1ab77fe700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1abc0662f0 0x7f1abc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.968+0000 7f1ab77fe700 1 -- 172.21.15.78:0/3021512495 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ac8083e90 con 0x7f1ad015feb0 2023-06-09T11:12:22.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.968+0000 7f1aceffd700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1abc0662f0 0x7f1abc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.972+0000 7f1aceffd700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1abc0662f0 0x7f1abc0687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00090b0 tx=0x7f1ac001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:22.976+0000 7f1ab77fe700 1 -- 172.21.15.78:0/3021512495 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1ac8051270 con 0x7f1ad015feb0 2023-06-09T11:12:23.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.144+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ad006f540 con 0x7f1ad015feb0 2023-06-09T11:12:23.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.144+0000 7f1ab77fe700 1 -- 172.21.15.78:0/3021512495 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ac8085020 con 0x7f1ad015feb0 2023-06-09T11:12:23.153 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:23.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1abc0662f0 msgr2=0x7f1abc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1abc0662f0 0x7f1abc0687a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00090b0 tx=0x7f1ac001c040 comp rx=0 tx=0).stop 2023-06-09T11:12:23.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ad015feb0 msgr2=0x7f1ad014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ad015feb0 0x7f1ad014ded0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800cc50 tx=0x7f1ac800cf60 comp rx=0 tx=0).stop 2023-06-09T11:12:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 shutdown_connections 2023-06-09T11:12:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f1abc0662f0 0x7f1abc0687a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ad015feb0 0x7f1ad014ded0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ad00cf5e0 0x7f1ad00c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 --2- 172.21.15.78:0/3021512495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ad006d790 0x7f1ad0148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 >> 172.21.15.78:0/3021512495 conn(0x7f1ad00b5950 msgr2=0x7f1ad00d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 shutdown_connections 2023-06-09T11:12:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.148+0000 7f1ad54a3700 1 -- 172.21.15.78:0/3021512495 wait complete. 2023-06-09T11:12:23.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:23.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.348+0000 7f2da0ad1700 1 Processor -- start 2023-06-09T11:12:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.348+0000 7f2da0ad1700 1 -- start start 2023-06-09T11:12:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2da0ad1700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2d9c156d50 0x7f2d9c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2da0ad1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c0b2da0 0x7f2d9c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2da0ad1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c0b3720 con 0x7f2d9c15cd50 2023-06-09T11:12:23.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2da0ad1700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c159760 con 0x7f2d9c156d50 2023-06-09T11:12:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2da0ad1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15d4c0 con 0x7f2d9c0b2da0 2023-06-09T11:12:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2d9c156d50 0x7f2d9c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2d9c156d50 0x7f2d9c0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37392/0 (socket says 172.21.15.78:37392) 2023-06-09T11:12:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/1169171518 learned_addr learned my addr 172.21.15.78:0/1169171518 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9bfff700 1 --2- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c0b2da0 0x7f2d9c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c0b2da0 msgr2=0x7f2d9c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 --2- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c0b2da0 0x7f2d9c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/1169171518 >> v1:172.21.15.187:6789/0 conn(0x7f2d9c15cd50 legacy=0x7f2d9c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/1169171518 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c15d7a0 con 0x7f2d9c156d50 2023-06-09T11:12:23.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9b7fe700 1 --2- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c156d50 0x7f2d9c0ce3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009910 tx=0x7f2d8c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260c7622600e3627 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:23.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9a7fc700 1 -- 172.21.15.78:0/1169171518 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011830 con 0x7f2d9c156d50 2023-06-09T11:12:23.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9a7fc700 1 -- 172.21.15.78:0/1169171518 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c011990 con 0x7f2d9c156d50 2023-06-09T11:12:23.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.352+0000 7f2d9a7fc700 1 -- 172.21.15.78:0/1169171518 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c011d40 con 0x7f2d9c156d50 2023-06-09T11:12:23.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 -- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c156d50 msgr2=0x7f2d9c0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c156d50 0x7f2d9c0ce3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009910 tx=0x7f2d8c009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:23.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 -- 172.21.15.78:0/1169171518 shutdown_connections 2023-06-09T11:12:23.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c0b2da0 0x7f2d9c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/1169171518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c156d50 0x7f2d9c0ce3d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 -- 172.21.15.78:0/1169171518 >> 172.21.15.78:0/1169171518 conn(0x7f2d9c0b0780 msgr2=0x7f2d9c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 -- 172.21.15.78:0/1169171518 shutdown_connections 2023-06-09T11:12:23.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 -- 172.21.15.78:0/1169171518 wait complete. 2023-06-09T11:12:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 Processor -- start 2023-06-09T11:12:23.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.356+0000 7f2da0ad1700 1 -- start start 2023-06-09T11:12:23.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c0b2da0 0x7f2d9c0a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c156d50 0x7f2d9c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c15cd50 0x7f2d9c144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c148ba0 con 0x7f2d9c15cd50 2023-06-09T11:12:23.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c1f3730 con 0x7f2d9c0b2da0 2023-06-09T11:12:23.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0a79f0 con 0x7f2d9c156d50 2023-06-09T11:12:23.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c15cd50 0x7f2d9c144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c15cd50 0x7f2d9c144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48138/0 (socket says 172.21.15.78:48138) 2023-06-09T11:12:23.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c156d50 0x7f2d9c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 -- 172.21.15.78:0/2155199275 learned_addr learned my addr 172.21.15.78:0/2155199275 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:23.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9b7fe700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c0b2da0 0x7f2d9c0a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 -- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c156d50 msgr2=0x7f2d9c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c156d50 0x7f2d9c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 -- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c0b2da0 msgr2=0x7f2d9c0a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c0b2da0 0x7f2d9c0a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 -- 172.21.15.78:0/2155199275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c009570 con 0x7f2d9c15cd50 2023-06-09T11:12:23.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d9bfff700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c15cd50 0x7f2d9c144e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009d30 tx=0x7f2d9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:23.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d83fff700 1 -- 172.21.15.78:0/2155199275 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400cc90 con 0x7f2d9c15cd50 2023-06-09T11:12:23.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d83fff700 1 -- 172.21.15.78:0/2155199275 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400f040 con 0x7f2d9c15cd50 2023-06-09T11:12:23.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c159950 con 0x7f2d9c15cd50 2023-06-09T11:12:23.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2d83fff700 1 -- 172.21.15.78:0/2155199275 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94009e80 con 0x7f2d9c15cd50 2023-06-09T11:12:23.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.360+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c15da80 con 0x7f2d9c15cd50 2023-06-09T11:12:23.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.364+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c15d1d0 con 0x7f2d9c15cd50 2023-06-09T11:12:23.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.364+0000 7f2d83fff700 1 -- 172.21.15.78:0/2155199275 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d94014480 con 0x7f2d9c15cd50 2023-06-09T11:12:23.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.368+0000 7f2d83fff700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2d880662f0 0x7f2d880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.368+0000 7f2d83fff700 1 -- 172.21.15.78:0/2155199275 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d94084470 con 0x7f2d9c15cd50 2023-06-09T11:12:23.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.368+0000 7f2d9b7fe700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2d880662f0 0x7f2d880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.368+0000 7f2d9b7fe700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2d880662f0 0x7f2d880687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000c00 tx=0x7f2d8c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.372+0000 7f2d83fff700 1 -- 172.21.15.78:0/2155199275 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2d94051900 con 0x7f2d9c15cd50 2023-06-09T11:12:23.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.540+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d9c1f38a0 con 0x7f2d9c15cd50 2023-06-09T11:12:23.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.540+0000 7f2d83fff700 1 -- 172.21.15.78:0/2155199275 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d94054f20 con 0x7f2d9c15cd50 2023-06-09T11:12:23.547 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:23.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2d880662f0 msgr2=0x7f2d880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2d880662f0 0x7f2d880687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c000c00 tx=0x7f2d8c008030 comp rx=0 tx=0).stop 2023-06-09T11:12:23.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c15cd50 msgr2=0x7f2d9c144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c15cd50 0x7f2d9c144e60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009d30 tx=0x7f2d9400c3a0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 shutdown_connections 2023-06-09T11:12:23.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2d880662f0 0x7f2d880687a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c15cd50 0x7f2d9c144e60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c156d50 0x7f2d9c0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 --2- 172.21.15.78:0/2155199275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c0b2da0 0x7f2d9c0a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 >> 172.21.15.78:0/2155199275 conn(0x7f2d9c0b0780 msgr2=0x7f2d9c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 shutdown_connections 2023-06-09T11:12:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.544+0000 7f2da0ad1700 1 -- 172.21.15.78:0/2155199275 wait complete. 2023-06-09T11:12:23.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.740+0000 7f2ad579a700 1 Processor -- start 2023-06-09T11:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.740+0000 7f2ad579a700 1 -- start start 2023-06-09T11:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad579a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2ad015a3e0 0x7f2ad006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad579a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00cc8e0 con 0x7f2ad015e670 2023-06-09T11:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad579a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad015a7b0 con 0x7f2ad00ce470 2023-06-09T11:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad579a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad00ccb80 con 0x7f2ad015a3e0 2023-06-09T11:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad4f99700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2ad015e670 0x7f2ad0070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37946/0 (socket says 172.21.15.78:37946) 2023-06-09T11:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1349645203 learned_addr learned my addr 172.21.15.78:0/1349645203 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2acffff700 1 --2- 172.21.15.78:0/1349645203 >> v2:172.21.15.187:3300/0 conn(0x7f2ad015a3e0 0x7f2ad006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608337347 0 0) 0x7f2ad00cc8e0 con 0x7f2ad015e670 2023-06-09T11:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab80035d0 con 0x7f2ad015e670 2023-06-09T11:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3634861372 0 0) 0x7f2ab80035d0 con 0x7f2ad015e670 2023-06-09T11:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 >> v2:172.21.15.187:3300/0 conn(0x7f2ad015a3e0 msgr2=0x7f2ad006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 --2- 172.21.15.78:0/1349645203 >> v2:172.21.15.187:3300/0 conn(0x7f2ad015a3e0 0x7f2ad006e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 >> v1:172.21.15.187:6789/0 conn(0x7f2ad00ce470 legacy=0x7f2ad015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad006b470 con 0x7f2ad015e670 2023-06-09T11:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f2ac80019f0 con 0x7f2ad015e670 2023-06-09T11:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 >> v1:172.21.15.78:6789/0 conn(0x7f2ad015e670 legacy=0x7f2ad0070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ab8003a20 0x7f2ab8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8004870 0x7f2ab8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab8005220 0x7f2ab800fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00ccb80 con 0x7f2ab8005220 2023-06-09T11:12:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8010540 con 0x7f2ab8004870 2023-06-09T11:12:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8010700 con 0x7f2ab8003a20 2023-06-09T11:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad4f99700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab8005220 0x7f2ab800fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2acf7fe700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8004870 0x7f2ab8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2acffff700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ab8003a20 0x7f2ab8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ab8003a20 msgr2=0x7f2ab8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad4f99700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ab8003a20 0x7f2ab8003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.744+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8004870 msgr2=0x7f2ab8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad4f99700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8004870 0x7f2ab8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1349645203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80035d0 con 0x7f2ab8005220 2023-06-09T11:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1349645203 reap_dead start 2023-06-09T11:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad4f99700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab8005220 0x7f2ab800fe40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ae200 tx=0x7f2ab80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a416ba470ff9dd1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800a2f0 con 0x7f2ab8005220 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80072f0 con 0x7f2ab8005220 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2aceffd700 1 -- 172.21.15.78:0/1349645203 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80076a0 con 0x7f2ab8005220 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad579a700 1 -- 172.21.15.78:0/1349645203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab8005220 msgr2=0x7f2ab800fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab8005220 0x7f2ab800fe40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ae200 tx=0x7f2ab80058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad579a700 1 -- 172.21.15.78:0/1349645203 shutdown_connections 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1349645203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab8005220 0x7f2ab800fe40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad579a700 1 -- 172.21.15.78:0/1349645203 >> 172.21.15.78:0/1349645203 conn(0x7f2ad00cf670 msgr2=0x7f2ad00cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad579a700 1 -- 172.21.15.78:0/1349645203 shutdown_connections 2023-06-09T11:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.748+0000 7f2ad579a700 1 -- 172.21.15.78:0/1349645203 wait complete. 2023-06-09T11:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 Processor -- start 2023-06-09T11:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 -- start start 2023-06-09T11:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8005220 0x7f2ad015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ad0151ec0 0x7f2ad0152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad015d450 0x7f2ad01532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad015c8e0 con 0x7f2ad015d450 2023-06-09T11:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0156530 con 0x7f2ab8005220 2023-06-09T11:12:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad579a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0156810 con 0x7f2ad0151ec0 2023-06-09T11:12:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad015d450 0x7f2ad01532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad015d450 0x7f2ad01532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48152/0 (socket says 172.21.15.78:48152) 2023-06-09T11:12:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1420234288 learned_addr learned my addr 172.21.15.78:0/1420234288 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2acf7fe700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ad0151ec0 0x7f2ad0152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2acffff700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8005220 0x7f2ad015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ad0151ec0 msgr2=0x7f2ad0152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ad0151ec0 0x7f2ad0152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8005220 msgr2=0x7f2ad015c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8005220 0x7f2ad015c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.752+0000 7f2ad4f99700 1 -- 172.21.15.78:0/1420234288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad006e960 con 0x7f2ad015d450 2023-06-09T11:12:23.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2ad4f99700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad015d450 0x7f2ad01532a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ce910 tx=0x7f2ad00cca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2accff9700 1 -- 172.21.15.78:0/1420234288 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8024030 con 0x7f2ad015d450 2023-06-09T11:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2accff9700 1 -- 172.21.15.78:0/1420234288 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac8007680 con 0x7f2ad015d450 2023-06-09T11:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad006b750 con 0x7f2ad015d450 2023-06-09T11:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2accff9700 1 -- 172.21.15.78:0/1420234288 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8007a30 con 0x7f2ad015d450 2023-06-09T11:12:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad006eaf0 con 0x7f2ad015d450 2023-06-09T11:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad00741c0 con 0x7f2ad015d450 2023-06-09T11:12:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.756+0000 7f2accff9700 1 -- 172.21.15.78:0/1420234288 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ac8027070 con 0x7f2ad015d450 2023-06-09T11:12:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.760+0000 7f2accff9700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2abc066320 0x7f2abc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.760+0000 7f2accff9700 1 -- 172.21.15.78:0/1420234288 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ac8025070 con 0x7f2ad015d450 2023-06-09T11:12:23.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.760+0000 7f2acffff700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2abc066320 0x7f2abc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.764+0000 7f2acffff700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2abc066320 0x7f2abc0687d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009ac0 tx=0x7f2ac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:23.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.768+0000 7f2accff9700 1 -- 172.21.15.78:0/1420234288 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2ac80523d0 con 0x7f2ad015d450 2023-06-09T11:12:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.968+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ad006ae80 con 0x7f2ad015d450 2023-06-09T11:12:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.968+0000 7f2accff9700 1 -- 172.21.15.78:0/1420234288 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f2ac8018090 con 0x7f2ad015d450 2023-06-09T11:12:23.978 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:23.978 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2abc066320 msgr2=0x7f2abc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2abc066320 0x7f2abc0687d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009ac0 tx=0x7f2ac0008040 comp rx=0 tx=0).stop 2023-06-09T11:12:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad015d450 msgr2=0x7f2ad01532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad015d450 0x7f2ad01532a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ce910 tx=0x7f2ad00cca70 comp rx=0 tx=0).stop 2023-06-09T11:12:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 shutdown_connections 2023-06-09T11:12:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2abc066320 0x7f2abc0687d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ad015d450 0x7f2ad01532a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ad0151ec0 0x7f2ad0152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 --2- 172.21.15.78:0/1420234288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ab8005220 0x7f2ad015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 >> 172.21.15.78:0/1420234288 conn(0x7f2ad00cf670 msgr2=0x7f2ad00b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 shutdown_connections 2023-06-09T11:12:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:23.976+0000 7f2ad579a700 1 -- 172.21.15.78:0/1420234288 wait complete. 2023-06-09T11:12:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:24.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:24.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.168+0000 7facdd2fa700 1 Processor -- start 2023-06-09T11:12:24.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.168+0000 7facdd2fa700 1 -- start start 2023-06-09T11:12:24.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.168+0000 7facdd2fa700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7facd815c920 0x7facd80d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.168+0000 7facdd2fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd806b0f0 0x7facd806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.168+0000 7facdd2fa700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd806ba70 con 0x7facd8070400 2023-06-09T11:12:24.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.168+0000 7facdd2fa700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd815ccf0 con 0x7facd815c920 2023-06-09T11:12:24.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.168+0000 7facdd2fa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd80d14d0 con 0x7facd806b0f0 2023-06-09T11:12:24.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd6ffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7facd815c920 0x7facd80d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd67fc700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7facd8070400 0x7facd8160de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45876/0 (socket says 172.21.15.78:45876) 2023-06-09T11:12:24.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd6ffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7facd815c920 0x7facd80d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37464/0 (socket says 172.21.15.78:37464) 2023-06-09T11:12:24.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd806b0f0 0x7facd806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd67fc700 1 -- 172.21.15.78:0/1748867260 learned_addr learned my addr 172.21.15.78:0/1748867260 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:24.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd77fe700 1 -- 172.21.15.78:0/1748867260 >> v2:172.21.15.187:3300/0 conn(0x7facd815c920 msgr2=0x7facd80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:24.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd77fe700 1 --2- 172.21.15.78:0/1748867260 >> v2:172.21.15.187:3300/0 conn(0x7facd815c920 0x7facd80d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd77fe700 1 -- 172.21.15.78:0/1748867260 >> v1:172.21.15.187:6789/0 conn(0x7facd8070400 legacy=0x7facd8160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd5ffb700 1 -- 172.21.15.78:0/1748867260 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825354903 0 0) 0x7facd806ba70 con 0x7facd8070400 2023-06-09T11:12:24.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd77fe700 1 -- 172.21.15.78:0/1748867260 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80d17b0 con 0x7facd806b0f0 2023-06-09T11:12:24.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd6ffd700 1 --2- 172.21.15.78:0/1748867260 >> v2:172.21.15.187:3300/0 conn(0x7facd815c920 0x7facd80d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:24.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd77fe700 1 --2- 172.21.15.78:0/1748867260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd806b0f0 0x7facd806b530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facd0009d90 tx=0x7facd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2c81af7f3dbf9d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:24.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd5ffb700 1 -- 172.21.15.78:0/1748867260 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000e070 con 0x7facd806b0f0 2023-06-09T11:12:24.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd5ffb700 1 -- 172.21.15.78:0/1748867260 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd000bb20 con 0x7facd806b0f0 2023-06-09T11:12:24.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facd5ffb700 1 -- 172.21.15.78:0/1748867260 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0012430 con 0x7facd806b0f0 2023-06-09T11:12:24.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 -- 172.21.15.78:0/1748867260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd806b0f0 msgr2=0x7facd806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 --2- 172.21.15.78:0/1748867260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd806b0f0 0x7facd806b530 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facd0009d90 tx=0x7facd000b330 comp rx=0 tx=0).stop 2023-06-09T11:12:24.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 -- 172.21.15.78:0/1748867260 shutdown_connections 2023-06-09T11:12:24.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 --2- 172.21.15.78:0/1748867260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd806b0f0 0x7facd806b530 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 --2- 172.21.15.78:0/1748867260 >> v2:172.21.15.187:3300/0 conn(0x7facd815c920 0x7facd80d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 -- 172.21.15.78:0/1748867260 >> 172.21.15.78:0/1748867260 conn(0x7facd80d3c10 msgr2=0x7facd80cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:24.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 -- 172.21.15.78:0/1748867260 shutdown_connections 2023-06-09T11:12:24.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.172+0000 7facdd2fa700 1 -- 172.21.15.78:0/1748867260 wait complete. 2023-06-09T11:12:24.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.176+0000 7facdd2fa700 1 Processor -- start 2023-06-09T11:12:24.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.176+0000 7facdd2fa700 1 -- start start 2023-06-09T11:12:24.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd806b0f0 0x7facd80b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facd8070400 0x7facd815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd815c920 0x7facd8150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd815e2a0 con 0x7facd806b0f0 2023-06-09T11:12:24.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd815d410 con 0x7facd8070400 2023-06-09T11:12:24.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd815d690 con 0x7facd815c920 2023-06-09T11:12:24.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd806b0f0 0x7facd80b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd806b0f0 0x7facd80b75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48158/0 (socket says 172.21.15.78:48158) 2023-06-09T11:12:24.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 -- 172.21.15.78:0/2532758738 learned_addr learned my addr 172.21.15.78:0/2532758738 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:24.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd67fc700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facd8070400 0x7facd815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd77fe700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd815c920 0x7facd8150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 -- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd815c920 msgr2=0x7facd8150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd815c920 0x7facd8150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 -- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facd8070400 msgr2=0x7facd815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facd8070400 0x7facd815ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 -- 172.21.15.78:0/2532758738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80094b0 con 0x7facd806b0f0 2023-06-09T11:12:24.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facd6ffd700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd806b0f0 0x7facd80b75e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facc800ec10 tx=0x7facc800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:24.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facbf7fe700 1 -- 172.21.15.78:0/2532758738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc800c850 con 0x7facd806b0f0 2023-06-09T11:12:24.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facbf7fe700 1 -- 172.21.15.78:0/2532758738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc800c9b0 con 0x7facd806b0f0 2023-06-09T11:12:24.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd0009a70 con 0x7facd806b0f0 2023-06-09T11:12:24.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facbf7fe700 1 -- 172.21.15.78:0/2532758738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc800cd40 con 0x7facd806b0f0 2023-06-09T11:12:24.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.180+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd806fc00 con 0x7facd806b0f0 2023-06-09T11:12:24.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.184+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd806f920 con 0x7facd806b0f0 2023-06-09T11:12:24.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.184+0000 7facbf7fe700 1 -- 172.21.15.78:0/2532758738 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facc8013470 con 0x7facd806b0f0 2023-06-09T11:12:24.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.184+0000 7facbf7fe700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7facc40662f0 0x7facc40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.184+0000 7facbf7fe700 1 -- 172.21.15.78:0/2532758738 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7facc80840b0 con 0x7facd806b0f0 2023-06-09T11:12:24.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.188+0000 7facd67fc700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7facc40662f0 0x7facc40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.188+0000 7facd67fc700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7facc40662f0 0x7facc40687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7facd80cf500 tx=0x7faccc007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:24.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.192+0000 7facbf7fe700 1 -- 172.21.15.78:0/2532758738 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7facc8051530 con 0x7facd806b0f0 2023-06-09T11:12:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.368+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facd806fee0 con 0x7facd806b0f0 2023-06-09T11:12:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.372+0000 7facbf7fe700 1 -- 172.21.15.78:0/2532758738 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7facc800cea0 con 0x7facd806b0f0 2023-06-09T11:12:24.379 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7facc40662f0 msgr2=0x7facc40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7facc40662f0 0x7facc40687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7facd80cf500 tx=0x7faccc007e90 comp rx=0 tx=0).stop 2023-06-09T11:12:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd806b0f0 msgr2=0x7facd80b75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd806b0f0 0x7facd80b75e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facc800ec10 tx=0x7facc800ef20 comp rx=0 tx=0).stop 2023-06-09T11:12:24.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 shutdown_connections 2023-06-09T11:12:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7facc40662f0 0x7facc40687a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facd815c920 0x7facd8150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facd8070400 0x7facd815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 --2- 172.21.15.78:0/2532758738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd806b0f0 0x7facd80b75e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 >> 172.21.15.78:0/2532758738 conn(0x7facd80d3c10 msgr2=0x7facd8070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 shutdown_connections 2023-06-09T11:12:24.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.376+0000 7facdd2fa700 1 -- 172.21.15.78:0/2532758738 wait complete. 2023-06-09T11:12:24.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:24.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.568+0000 7f8bec937700 1 Processor -- start 2023-06-09T11:12:24.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bec937700 1 -- start start 2023-06-09T11:12:24.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bec937700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8be815a3e0 0x7f8be806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bec937700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8be815e670 0x7f8be806f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bec937700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80cc8e0 con 0x7f8be80ce470 2023-06-09T11:12:24.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bec937700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be815a7b0 con 0x7f8be815a3e0 2023-06-09T11:12:24.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bec937700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80ccb80 con 0x7f8be815e670 2023-06-09T11:12:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bdffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8be80ce470 0x7f8be815df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37958/0 (socket says 172.21.15.78:37958) 2023-06-09T11:12:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8bdffff700 1 -- 172.21.15.78:0/3335778071 learned_addr learned my addr 172.21.15.78:0/3335778071 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be77fe700 1 --2- 172.21.15.78:0/3335778071 >> v2:172.21.15.78:3300/0 conn(0x7f8be815a3e0 0x7f8be806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be7fff700 1 --2- 172.21.15.78:0/3335778071 >> v2:172.21.15.187:3300/0 conn(0x7f8be815e670 0x7f8be806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be6ffd700 1 -- 172.21.15.78:0/3335778071 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159067974 0 0) 0x7f8be80cc8e0 con 0x7f8be80ce470 2023-06-09T11:12:24.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be6ffd700 1 -- 172.21.15.78:0/3335778071 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd40035d0 con 0x7f8be80ce470 2023-06-09T11:12:24.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be77fe700 1 -- 172.21.15.78:0/3335778071 >> v2:172.21.15.187:3300/0 conn(0x7f8be815e670 msgr2=0x7f8be806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:24.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be77fe700 1 --2- 172.21.15.78:0/3335778071 >> v2:172.21.15.187:3300/0 conn(0x7f8be815e670 0x7f8be806f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be77fe700 1 -- 172.21.15.78:0/3335778071 >> v1:172.21.15.78:6789/0 conn(0x7f8be80ce470 legacy=0x7f8be815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.572+0000 7f8be77fe700 1 -- 172.21.15.78:0/3335778071 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be806b470 con 0x7f8be815a3e0 2023-06-09T11:12:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8be77fe700 1 --2- 172.21.15.78:0/3335778071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815a3e0 0x7f8be806e960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8be80ce940 tx=0x7f8bd8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dee825673a4b354 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8be6ffd700 1 -- 172.21.15.78:0/3335778071 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8011830 con 0x7f8be815a3e0 2023-06-09T11:12:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8be6ffd700 1 -- 172.21.15.78:0/3335778071 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd8011990 con 0x7f8be815a3e0 2023-06-09T11:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8be6ffd700 1 -- 172.21.15.78:0/3335778071 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8011d20 con 0x7f8be815a3e0 2023-06-09T11:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 -- 172.21.15.78:0/3335778071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815a3e0 msgr2=0x7f8be806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 --2- 172.21.15.78:0/3335778071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815a3e0 0x7f8be806e960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8be80ce940 tx=0x7f8bd8009b30 comp rx=0 tx=0).stop 2023-06-09T11:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 -- 172.21.15.78:0/3335778071 shutdown_connections 2023-06-09T11:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 --2- 172.21.15.78:0/3335778071 >> v2:172.21.15.187:3300/0 conn(0x7f8be815e670 0x7f8be806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 --2- 172.21.15.78:0/3335778071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815a3e0 0x7f8be806e960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 -- 172.21.15.78:0/3335778071 >> 172.21.15.78:0/3335778071 conn(0x7f8be80cf670 msgr2=0x7f8be80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 -- 172.21.15.78:0/3335778071 shutdown_connections 2023-06-09T11:12:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 -- 172.21.15.78:0/3335778071 wait complete. 2023-06-09T11:12:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.576+0000 7f8bec937700 1 Processor -- start 2023-06-09T11:12:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 -- start start 2023-06-09T11:12:24.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8be80ce470 0x7f8be8150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8be815a3e0 0x7f8be815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815e670 0x7f8be80b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81f2d90 con 0x7f8be815e670 2023-06-09T11:12:24.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81f3070 con 0x7f8be815a3e0 2023-06-09T11:12:24.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be815ca70 con 0x7f8be80ce470 2023-06-09T11:12:24.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815e670 0x7f8be80b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815e670 0x7f8be80b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48174/0 (socket says 172.21.15.78:48174) 2023-06-09T11:12:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 -- 172.21.15.78:0/3535456596 learned_addr learned my addr 172.21.15.78:0/3535456596 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bdffff700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8be815a3e0 0x7f8be815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be77fe700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8be80ce470 0x7f8be8150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 -- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8be80ce470 msgr2=0x7f8be8150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8be80ce470 0x7f8be8150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 -- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8be815a3e0 msgr2=0x7f8be815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8be815a3e0 0x7f8be815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 -- 172.21.15.78:0/3535456596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80094b0 con 0x7f8be815e670 2023-06-09T11:12:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bdffff700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8be815a3e0 0x7f8be815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be7fff700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815e670 0x7f8be80b0ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8be000ef90 tx=0x7f8be0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be4ff9700 1 -- 172.21.15.78:0/3535456596 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0009b20 con 0x7f8be815e670 2023-06-09T11:12:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be4ff9700 1 -- 172.21.15.78:0/3535456596 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be000f040 con 0x7f8be815e670 2023-06-09T11:12:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8be4ff9700 1 -- 172.21.15.78:0/3535456596 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000cd20 con 0x7f8be815e670 2023-06-09T11:12:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be8070240 con 0x7f8be815e670 2023-06-09T11:12:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.580+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be806b750 con 0x7f8be815e670 2023-06-09T11:12:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.584+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be80703d0 con 0x7f8be815e670 2023-06-09T11:12:24.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.584+0000 7f8be4ff9700 1 -- 172.21.15.78:0/3535456596 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8be0014480 con 0x7f8be815e670 2023-06-09T11:12:24.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.588+0000 7f8be4ff9700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bc80662f0 0x7f8bc80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.588+0000 7f8be4ff9700 1 -- 172.21.15.78:0/3535456596 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8be00848a0 con 0x7f8be815e670 2023-06-09T11:12:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.588+0000 7f8be77fe700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bc80662f0 0x7f8bc80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.588+0000 7f8be77fe700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bc80662f0 0x7f8bc80687a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8000c00 tx=0x7f8bd8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:24.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.592+0000 7f8be4ff9700 1 -- 172.21.15.78:0/3535456596 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8be0051c80 con 0x7f8be815e670 2023-06-09T11:12:24.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.796+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8be8065b40 con 0x7f8be815e670 2023-06-09T11:12:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.796+0000 7f8be4ff9700 1 -- 172.21.15.78:0/3535456596 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f8be0018090 con 0x7f8be815e670 2023-06-09T11:12:24.805 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:24.805 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:24.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bc80662f0 msgr2=0x7f8bc80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bc80662f0 0x7f8bc80687a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8000c00 tx=0x7f8bd8008030 comp rx=0 tx=0).stop 2023-06-09T11:12:24.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815e670 msgr2=0x7f8be80b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815e670 0x7f8be80b0ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8be000ef90 tx=0x7f8be0009f60 comp rx=0 tx=0).stop 2023-06-09T11:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 shutdown_connections 2023-06-09T11:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bc80662f0 0x7f8bc80687a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8be815e670 0x7f8be80b0ba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8be815a3e0 0x7f8be815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 --2- 172.21.15.78:0/3535456596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8be80ce470 0x7f8be8150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 >> 172.21.15.78:0/3535456596 conn(0x7f8be80cf670 msgr2=0x7f8be80707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 shutdown_connections 2023-06-09T11:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:24.800+0000 7f8bec937700 1 -- 172.21.15.78:0/3535456596 wait complete. 2023-06-09T11:12:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:25.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T11:12:08.797648+0000', 'modified': '2023-06-09T11:12:12.170191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6835/2567299760', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 2567299760}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 2567299760}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T11:12:25.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T11:12:25.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-09T11:12:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.400+0000 7f7c095a8700 1 Processor -- start 2023-06-09T11:12:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.400+0000 7f7c095a8700 1 -- start start 2023-06-09T11:12:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.400+0000 7f7c095a8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c040ce470 0x7f7c0406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.400+0000 7f7c095a8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040cc8e0 con 0x7f7c0415e670 2023-06-09T11:12:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.400+0000 7f7c095a8700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0415a7b0 con 0x7f7c0415a3e0 2023-06-09T11:12:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.400+0000 7f7c095a8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040ccb80 con 0x7f7c040ce470 2023-06-09T11:12:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.400+0000 7f7c037fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7c0415e670 0x7f7c04070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37284/0 (socket says 172.21.15.78:37284) 2023-06-09T11:12:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c037fe700 1 -- 172.21.15.78:0/4059412369 learned_addr learned my addr 172.21.15.78:0/4059412369 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c08da7700 1 --2- 172.21.15.78:0/4059412369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c040ce470 0x7f7c0406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c02ffd700 1 -- 172.21.15.78:0/4059412369 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289389395 0 0) 0x7f7c040cc8e0 con 0x7f7c0415e670 2023-06-09T11:12:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c02ffd700 1 -- 172.21.15.78:0/4059412369 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec0035d0 con 0x7f7c0415e670 2023-06-09T11:12:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c02ffd700 1 -- 172.21.15.78:0/4059412369 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189670281 0 0) 0x7f7c0415a7b0 con 0x7f7c0415a3e0 2023-06-09T11:12:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c08da7700 1 -- 172.21.15.78:0/4059412369 >> v1:172.21.15.187:6789/0 conn(0x7f7c0415a3e0 legacy=0x7f7c0415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c08da7700 1 -- 172.21.15.78:0/4059412369 >> v1:172.21.15.78:6789/0 conn(0x7f7c0415e670 legacy=0x7f7c04070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c08da7700 1 -- 172.21.15.78:0/4059412369 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0406b470 con 0x7f7c040ce470 2023-06-09T11:12:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c08da7700 1 --2- 172.21.15.78:0/4059412369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c040ce470 0x7f7c0406e960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009dc0 tx=0x7f7bfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08ece051cb7e555 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c02ffd700 1 -- 172.21.15.78:0/4059412369 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00e070 con 0x7f7c040ce470 2023-06-09T11:12:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c02ffd700 1 -- 172.21.15.78:0/4059412369 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00bb20 con 0x7f7c040ce470 2023-06-09T11:12:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c02ffd700 1 -- 172.21.15.78:0/4059412369 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00bed0 con 0x7f7c040ce470 2023-06-09T11:12:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c095a8700 1 -- 172.21.15.78:0/4059412369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c040ce470 msgr2=0x7f7c0406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c095a8700 1 --2- 172.21.15.78:0/4059412369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c040ce470 0x7f7c0406e960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009dc0 tx=0x7f7bfc00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c095a8700 1 -- 172.21.15.78:0/4059412369 shutdown_connections 2023-06-09T11:12:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c095a8700 1 --2- 172.21.15.78:0/4059412369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c040ce470 0x7f7c0406e960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c095a8700 1 -- 172.21.15.78:0/4059412369 >> 172.21.15.78:0/4059412369 conn(0x7f7c040cf670 msgr2=0x7f7c040cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c095a8700 1 -- 172.21.15.78:0/4059412369 shutdown_connections 2023-06-09T11:12:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.404+0000 7f7c095a8700 1 -- 172.21.15.78:0/4059412369 wait complete. 2023-06-09T11:12:25.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 Processor -- start 2023-06-09T11:12:25.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 -- start start 2023-06-09T11:12:25.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c040ce470 0x7f7c040b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c0415a3e0 0x7f7c040c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c0415e670 0x7f7c040b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c7fd0 con 0x7f7c040ce470 2023-06-09T11:12:25.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c7210 con 0x7f7c0415e670 2023-06-09T11:12:25.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c095a8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c74f0 con 0x7f7c0415a3e0 2023-06-09T11:12:25.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c040ce470 0x7f7c040b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c040ce470 0x7f7c040b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55932/0 (socket says 172.21.15.78:55932) 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.408+0000 7f7c03fff700 1 -- 172.21.15.78:0/3477954200 learned_addr learned my addr 172.21.15.78:0/3477954200 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c08da7700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c0415e670 0x7f7c040b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c037fe700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c0415a3e0 0x7f7c040c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c03fff700 1 -- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c0415a3e0 msgr2=0x7f7c040c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c03fff700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c0415a3e0 0x7f7c040c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c03fff700 1 -- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c0415e670 msgr2=0x7f7c040b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c03fff700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c0415e670 0x7f7c040b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c03fff700 1 -- 172.21.15.78:0/3477954200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc009a70 con 0x7f7c040ce470 2023-06-09T11:12:25.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c037fe700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c0415a3e0 0x7f7c040c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:25.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c03fff700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c040ce470 0x7f7c040b1930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40011e0 tx=0x7f7bf400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:25.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c00ff9700 1 -- 172.21.15.78:0/3477954200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40054e0 con 0x7f7c040ce470 2023-06-09T11:12:25.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c00ff9700 1 -- 172.21.15.78:0/3477954200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf40036a0 con 0x7f7c040ce470 2023-06-09T11:12:25.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c00ff9700 1 -- 172.21.15.78:0/3477954200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4003a50 con 0x7f7c040ce470 2023-06-09T11:12:25.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0406f090 con 0x7f7c040ce470 2023-06-09T11:12:25.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.412+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0406b750 con 0x7f7c040ce470 2023-06-09T11:12:25.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.416+0000 7f7c00ff9700 1 -- 172.21.15.78:0/3477954200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7bf4003bb0 con 0x7f7c040ce470 2023-06-09T11:12:25.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c00ff9700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7bf0066320 0x7f7bf00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c00ff9700 1 -- 172.21.15.78:0/3477954200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bf4083200 con 0x7f7c040ce470 2023-06-09T11:12:25.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c037fe700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7bf0066320 0x7f7bf00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 Processor -- start 2023-06-09T11:12:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 -- start start 2023-06-09T11:12:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c037fe700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7bf0066320 0x7f7bf00687d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7c040ad9b0 tx=0x7f7bf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10f8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3feb0 0x10f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3fae0 0x10c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0xfccb30 con 0x10104f0 2023-06-09T11:12:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x101f710 con 0xe3feb0 2023-06-09T11:12:25.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x1018970 con 0xe3fae0 2023-06-09T11:12:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55938/0 (socket says 172.21.15.78:55938) 2023-06-09T11:12:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c03fff700 1 -- 172.21.15.78:0/3090208447 learned_addr learned my addr 172.21.15.78:0/3090208447 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c037fe700 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3feb0 0x10f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.420+0000 7f7c08da7700 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3fae0 0x10c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c03fff700 1 -- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3fae0 msgr2=0x10c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c03fff700 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3fae0 0x10c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c03fff700 1 -- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3feb0 msgr2=0x10f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c03fff700 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3feb0 0x10f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c03fff700 1 -- 172.21.15.78:0/3090208447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xfdea10 con 0x10104f0 2023-06-09T11:12:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c03fff700 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10f8390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4050830 tx=0x7f7bf4053d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9715673f20077bba server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7be9ffb700 1 -- 172.21.15.78:0/3090208447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40580b0 con 0x10104f0 2023-06-09T11:12:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7be9ffb700 1 -- 172.21.15.78:0/3090208447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf40582f0 con 0x10104f0 2023-06-09T11:12:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7be9ffb700 1 -- 172.21.15.78:0/3090208447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf405c680 con 0x10104f0 2023-06-09T11:12:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 -- 172.21.15.78:0/3090208447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 msgr2=0x10f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10f8390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4050830 tx=0x7f7bf4053d10 comp rx=0 tx=0).stop 2023-06-09T11:12:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 -- 172.21.15.78:0/3090208447 shutdown_connections 2023-06-09T11:12:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3fae0 0x10c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3feb0 0x10f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 --2- 172.21.15.78:0/3090208447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10f8390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 -- 172.21.15.78:0/3090208447 >> 172.21.15.78:0/3090208447 conn(0x10a9310 msgr2=0x10da790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 -- 172.21.15.78:0/3090208447 shutdown_connections 2023-06-09T11:12:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 -- 172.21.15.78:0/3090208447 wait complete. 2023-06-09T11:12:25.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 -- start start 2023-06-09T11:12:25.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.424+0000 7f7c0da98740 1 Processor -- start 2023-06-09T11:12:25.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x10d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0xfb6b00 con 0x10104f0 2023-06-09T11:12:25.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0xfdbd60 con 0xe3fae0 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0xec4b20 con 0xe3feb0 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 10 client.0 _ll_register_callbacks cb 0x1012210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55944/0 (socket says 172.21.15.78:55944) 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 -- 172.21.15.78:0/2446706133 learned_addr learned my addr 172.21.15.78:0/2446706133 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c03fff700 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x10d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c037fe700 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 -- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 msgr2=0x10b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 -- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 msgr2=0x10d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x10d7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 -- 172.21.15.78:0/2446706133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0406b750 con 0x10104f0 2023-06-09T11:12:25.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c08da7700 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10b0a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b680 tx=0x7f7bfc004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633452d97386ed60 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:25.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7be2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-09T11:12:25.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7be2ffd700 1 -- 172.21.15.78:0/2446706133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc02b070 con 0x10104f0 2023-06-09T11:12:25.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7be2ffd700 1 -- 172.21.15.78:0/2446706133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bfc021040 con 0x10104f0 2023-06-09T11:12:25.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1011950 con 0x10104f0 2023-06-09T11:12:25.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7be2ffd700 1 -- 172.21.15.78:0/2446706133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bfc01c610 con 0x10104f0 2023-06-09T11:12:25.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 10 client.4641 fetch_fsmap learned FSMap version 8 2023-06-09T11:12:25.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xe8b9e0 con 0x10104f0 2023-06-09T11:12:25.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7be2ffd700 1 -- 172.21.15.78:0/2446706133 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1011950 con 0x10104f0 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7be2ffd700 1 -- 172.21.15.78:0/2446706133 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7bfc02e020 con 0x10104f0 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 10 client.4641 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 20 client.4641 populate_metadata read hostname 'smithi078' 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe3f710 0x10aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 4 client.4641 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.428+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 --> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfd3830 con 0xe3f710 2023-06-09T11:12:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c03fff700 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe3f710 0x10aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c03fff700 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe3f710 0x10aec60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5378f6ab075aaf2 server_cookie=5cb1917e28c92fbf in_seq=0 out_seq=0 2023-06-09T11:12:25.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7be2ffd700 10 client.4641 ms_handle_connect on v2:172.21.15.187:6834/2567299760 2023-06-09T11:12:25.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7be2ffd700 1 -- 172.21.15.78:0/2446706133 <== mds.0 v2:172.21.15.187:6834/2567299760 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0xfd3830 con 0xe3f710 2023-06-09T11:12:25.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7be2ffd700 10 client.4641 handle_command_reply: tid=0 2023-06-09T11:12:25.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 client.4641 shutdown 2023-06-09T11:12:25.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 msgr2=0x10b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10b0a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b680 tx=0x7f7bfc004b60 comp rx=0 tx=0).stop 2023-06-09T11:12:25.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 shutdown_connections 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe3f710 0x10aec60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x10104f0 0x10b0a70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 --2- 172.21.15.78:0/2446706133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x10d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7be2ffd700 0 client.4641 ms_handle_reset on v2:172.21.15.187:6834/2567299760 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 >> 172.21.15.78:0/2446706133 conn(0x10a9310 msgr2=0x10b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 shutdown_connections 2023-06-09T11:12:25.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 1 -- 172.21.15.78:0/2446706133 wait complete. 2023-06-09T11:12:25.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.432+0000 7f7c0da98740 20 client.4641 trim_cache size 0 max 16384 2023-06-09T11:12:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 Processor -- start 2023-06-09T11:12:25.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 -- start start 2023-06-09T11:12:25.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3fae0 0x10acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x10104f0 0x10ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe36a0 con 0xe3fae0 2023-06-09T11:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x10a88c0 con 0x10104f0 2023-06-09T11:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.452+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x1012c70 con 0xe3feb0 2023-06-09T11:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3fae0 0x10acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c08da7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x10104f0 0x10ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c037fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3fae0 0x10acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55950/0 (socket says 172.21.15.78:55950) 2023-06-09T11:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 -- 172.21.15.78:0/768777300 learned_addr learned my addr 172.21.15.78:0/768777300 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:25.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c037fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:46190/0 (socket says 172.21.15.78:46190) 2023-06-09T11:12:25.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c08da7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x10104f0 0x10ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:35418/0 (socket says 172.21.15.78:35418) 2023-06-09T11:12:25.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 -- 172.21.15.78:0/768777300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 msgr2=0x10ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 --2- 172.21.15.78:0/768777300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 -- 172.21.15.78:0/768777300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x10104f0 msgr2=0x10ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 --2- 172.21.15.78:0/768777300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x10104f0 0x10ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 -- 172.21.15.78:0/768777300 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1107e70 con 0xe3fae0 2023-06-09T11:12:25.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c03fff700 1 --2- 172.21.15.78:0/768777300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3fae0 0x10acc40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4054030 tx=0x7f7bf4059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5027b25f7c9036 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7bea7fc700 1 -- 172.21.15.78:0/768777300 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4054100 con 0xe3fae0 2023-06-09T11:12:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7bea7fc700 1 -- 172.21.15.78:0/768777300 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf405c680 con 0xe3fae0 2023-06-09T11:12:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7bea7fc700 1 -- 172.21.15.78:0/768777300 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40526d0 con 0xe3fae0 2023-06-09T11:12:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 -- 172.21.15.78:0/768777300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3fae0 msgr2=0x10acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 --2- 172.21.15.78:0/768777300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3fae0 0x10acc40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4054030 tx=0x7f7bf4059000 comp rx=0 tx=0).stop 2023-06-09T11:12:25.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 -- 172.21.15.78:0/768777300 shutdown_connections 2023-06-09T11:12:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 --2- 172.21.15.78:0/768777300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x10104f0 0x10ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 --2- 172.21.15.78:0/768777300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0xe3feb0 0x10ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 --2- 172.21.15.78:0/768777300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3fae0 0x10acc40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 -- 172.21.15.78:0/768777300 >> 172.21.15.78:0/768777300 conn(0x10a9310 msgr2=0x10d65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 -- 172.21.15.78:0/768777300 shutdown_connections 2023-06-09T11:12:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 -- 172.21.15.78:0/768777300 wait complete. 2023-06-09T11:12:25.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 -- start start 2023-06-09T11:12:25.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.456+0000 7f7c0da98740 1 Processor -- start 2023-06-09T11:12:25.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x110da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3feb0 0x110f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x10104f0 0x1156630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe0650 con 0xe3feb0 2023-06-09T11:12:25.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x10209a0 con 0xe3fae0 2023-06-09T11:12:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x10d7930 con 0x10104f0 2023-06-09T11:12:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 10 client.0 _ll_register_callbacks cb 0x7f7bf40012b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T11:12:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3feb0 0x110f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3feb0 0x110f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55958/0 (socket says 172.21.15.78:55958) 2023-06-09T11:12:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 -- 172.21.15.78:0/4046402964 learned_addr learned my addr 172.21.15.78:0/4046402964 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c08da7700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x10104f0 0x1156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c03fff700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x110da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 -- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x10104f0 msgr2=0x1156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x10104f0 0x1156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 -- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 msgr2=0x110da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x110da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 -- 172.21.15.78:0/4046402964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xfdea10 con 0xe3feb0 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c08da7700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x10104f0 0x1156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c03fff700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x110da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c037fe700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3feb0 0x110f1b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7c0414f220 tx=0x7f7bf80010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4076e9eb7c3cac2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7be2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7be2ffd700 1 -- 172.21.15.78:0/4046402964 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800ea00 con 0xe3feb0 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7bf40582f0 con 0xe3feb0 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7be2ffd700 1 -- 172.21.15.78:0/4046402964 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bf800eb60 con 0xe3feb0 2023-06-09T11:12:25.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7be2ffd700 1 -- 172.21.15.78:0/4046402964 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bf800ed20 con 0xe3feb0 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 10 client.4647 fetch_fsmap learned FSMap version 8 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xfdecc0 con 0xe3feb0 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7be2ffd700 1 -- 172.21.15.78:0/4046402964 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf40582f0 con 0xe3feb0 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7be2ffd700 1 -- 172.21.15.78:0/4046402964 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7bf8020050 con 0xe3feb0 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 10 client.4647 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 20 client.4647 populate_metadata read hostname 'smithi078' 2023-06-09T11:12:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe8a790 0x110e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:25.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 4 client.4647 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-06-09T11:12:25.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.460+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 --> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] -- command(tid 0: {"prefix": "status"}) v1 -- 0xe974e0 con 0xe8a790 2023-06-09T11:12:25.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c03fff700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe8a790 0x110e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:25.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c03fff700 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe8a790 0x110e800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf8235011cc63aa1 server_cookie=ee2994e41f397c56 in_seq=0 out_seq=0 2023-06-09T11:12:25.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7be2ffd700 10 client.4647 ms_handle_connect on v2:172.21.15.187:6834/2567299760 2023-06-09T11:12:25.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7be2ffd700 1 -- 172.21.15.78:0/4046402964 <== mds.0 v2:172.21.15.187:6834/2567299760 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xe974e0 con 0xe8a790 2023-06-09T11:12:25.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7be2ffd700 10 client.4647 handle_command_reply: tid=0 2023-06-09T11:12:25.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 client.4647 shutdown 2023-06-09T11:12:25.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3feb0 msgr2=0x110f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3feb0 0x110f1b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7c0414f220 tx=0x7f7bf80010a0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 shutdown_connections 2023-06-09T11:12:25.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:6834/2567299760,v1:172.21.15.187:6835/2567299760] conn(0xe8a790 0x110e800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x10104f0 0x1156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0xe3feb0 0x110f1b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 --2- 172.21.15.78:0/4046402964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0xe3fae0 0x110da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 >> 172.21.15.78:0/4046402964 conn(0x10a9310 msgr2=0x10d6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:25.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7be2ffd700 0 client.4647 ms_handle_reset on v2:172.21.15.187:6834/2567299760 2023-06-09T11:12:25.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 shutdown_connections 2023-06-09T11:12:25.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 1 -- 172.21.15.78:0/4046402964 wait complete. 2023-06-09T11:12:25.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c0da98740 20 client.4647 trim_cache size 0 max 16384 2023-06-09T11:12:25.483 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T11:12:25.483 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "a733ef11-cd5d-4be5-8773-23eabcf05e48", 2023-06-09T11:12:25.483 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-06-09T11:12:25.483 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4300, 2023-06-09T11:12:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-06-09T11:12:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-06-09T11:12:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-06-09T11:12:25.484 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 16.659798314, 2023-06-09T11:12:25.485 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 8, 2023-06-09T11:12:25.485 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 23, 2023-06-09T11:12:25.485 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2023-06-09T11:12:25.485 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 22.109309805999999 2023-06-09T11:12:25.485 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T11:12:25.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7bf0066320 msgr2=0x7f7bf00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7bf0066320 0x7f7bf00687d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7c040ad9b0 tx=0x7f7bf8009040 comp rx=0 tx=0).stop 2023-06-09T11:12:25.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c040ce470 msgr2=0x7f7c040b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:25.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c040ce470 0x7f7c040b1930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40011e0 tx=0x7f7bf400ca30 comp rx=0 tx=0).stop 2023-06-09T11:12:25.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 shutdown_connections 2023-06-09T11:12:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7bf0066320 0x7f7bf00687d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c0415e670 0x7f7c040b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c0415a3e0 0x7f7c040c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 --2- 172.21.15.78:0/3477954200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c040ce470 0x7f7c040b1930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.464+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 >> 172.21.15.78:0/3477954200 conn(0x7f7c040cf670 msgr2=0x7f7c04157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.468+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 shutdown_connections 2023-06-09T11:12:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:25.468+0000 7f7c095a8700 1 -- 172.21.15.78:0/3477954200 wait complete. 2023-06-09T11:12:25.496 INFO:teuthology.run_tasks:Running task kclient... 2023-06-09T11:12:25.522 INFO:tasks.kclient:Mounting kernel clients... 2023-06-09T11:12:25.522 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-09T11:12:25.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:25.523 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-06-09T11:12:25.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:25.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-06-09T11:12:25.626 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-06-09T11:12:25.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:12:25.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:25.631 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-06-09T11:12:25.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:25.686 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:25.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:25.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-06-09T11:12:25.827 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-06-09T11:12:25.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:12:25.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:25.832 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-06-09T11:12:25.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:25.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-06-09T11:12:25.935 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-06-09T11:12:25.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:12:25.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:25.939 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-06-09T11:12:26.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.000 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-06-09T11:12:26.085 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-06-09T11:12:26.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:12:26.088 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-06-09T11:12:26.088 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T11:12:26.089 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T11:12:26.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T11:12:26.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c2b5d700 1 Processor -- start 2023-06-09T11:12:26.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c2b5d700 1 -- start start 2023-06-09T11:12:26.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c2b5d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23bc164c00 0x7f23bc0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:26.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c2b5d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f23bc06f2a0 0x7f23bc06dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:26.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c2b5d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc0adb00 con 0x7f23bc160940 2023-06-09T11:12:26.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c2b5d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc1653a0 con 0x7f23bc164c00 2023-06-09T11:12:26.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c2b5d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc06ba70 con 0x7f23bc06f2a0 2023-06-09T11:12:26.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c1b5b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f23bc160940 0x7f23bc1644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37290/0 (socket says 172.21.15.78:37290) 2023-06-09T11:12:26.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c1b5b700 1 -- 172.21.15.78:0/1719789744 learned_addr learned my addr 172.21.15.78:0/1719789744 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:26.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c135a700 1 --2- 172.21.15.78:0/1719789744 >> v2:172.21.15.78:3300/0 conn(0x7f23bc164c00 0x7f23bc0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:26.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c235c700 1 --2- 172.21.15.78:0/1719789744 >> v2:172.21.15.187:3300/0 conn(0x7f23bc06f2a0 0x7f23bc06dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:26.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.256+0000 7f23c0b59700 1 -- 172.21.15.78:0/1719789744 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415465250 0 0) 0x7f23bc0adb00 con 0x7f23bc160940 2023-06-09T11:12:26.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c0b59700 1 -- 172.21.15.78:0/1719789744 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a80035d0 con 0x7f23bc160940 2023-06-09T11:12:26.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c135a700 1 -- 172.21.15.78:0/1719789744 >> v2:172.21.15.187:3300/0 conn(0x7f23bc06f2a0 msgr2=0x7f23bc06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:26.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c135a700 1 --2- 172.21.15.78:0/1719789744 >> v2:172.21.15.187:3300/0 conn(0x7f23bc06f2a0 0x7f23bc06dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c135a700 1 -- 172.21.15.78:0/1719789744 >> v1:172.21.15.78:6789/0 conn(0x7f23bc160940 legacy=0x7f23bc1644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:26.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c135a700 1 -- 172.21.15.78:0/1719789744 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0ccb10 con 0x7f23bc164c00 2023-06-09T11:12:26.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c135a700 1 --2- 172.21.15.78:0/1719789744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc0ce4a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0ae170 tx=0x7f23ac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42cc7b93f291240 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:26.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c0b59700 1 -- 172.21.15.78:0/1719789744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac011830 con 0x7f23bc164c00 2023-06-09T11:12:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c0b59700 1 -- 172.21.15.78:0/1719789744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac011990 con 0x7f23bc164c00 2023-06-09T11:12:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c0b59700 1 -- 172.21.15.78:0/1719789744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac011d20 con 0x7f23bc164c00 2023-06-09T11:12:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 -- 172.21.15.78:0/1719789744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 msgr2=0x7f23bc0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/1719789744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc0ce4a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0ae170 tx=0x7f23ac009b30 comp rx=0 tx=0).stop 2023-06-09T11:12:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 -- 172.21.15.78:0/1719789744 shutdown_connections 2023-06-09T11:12:26.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/1719789744 >> v2:172.21.15.187:3300/0 conn(0x7f23bc06f2a0 0x7f23bc06dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/1719789744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc0ce4a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 -- 172.21.15.78:0/1719789744 >> 172.21.15.78:0/1719789744 conn(0x7f23bc0cf670 msgr2=0x7f23bc0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 -- 172.21.15.78:0/1719789744 shutdown_connections 2023-06-09T11:12:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.260+0000 7f23c2b5d700 1 -- 172.21.15.78:0/1719789744 wait complete. 2023-06-09T11:12:26.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 Processor -- start 2023-06-09T11:12:26.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 -- start start 2023-06-09T11:12:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23bc06f2a0 0x7f23bc151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23bc160940 0x7f23bc0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc06f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc151670 con 0x7f23bc164c00 2023-06-09T11:12:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc1584d0 con 0x7f23bc06f2a0 2023-06-09T11:12:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0b41d0 con 0x7f23bc160940 2023-06-09T11:12:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc06f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55966/0 (socket says 172.21.15.78:55966) 2023-06-09T11:12:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 -- 172.21.15.78:0/2863876589 learned_addr learned my addr 172.21.15.78:0/2863876589 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c1b5b700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23bc06f2a0 0x7f23bc151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c135a700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23bc160940 0x7f23bc0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 -- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23bc160940 msgr2=0x7f23bc0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23bc160940 0x7f23bc0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 -- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23bc06f2a0 msgr2=0x7f23bc151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23bc06f2a0 0x7f23bc151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 -- 172.21.15.78:0/2863876589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0094b0 con 0x7f23bc164c00 2023-06-09T11:12:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c1b5b700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23bc06f2a0 0x7f23bc151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c135a700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23bc160940 0x7f23bc0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c235c700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc06f880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009fd0 tx=0x7f23b400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:26.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23b27fc700 1 -- 172.21.15.78:0/2863876589 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40096e0 con 0x7f23bc164c00 2023-06-09T11:12:26.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23b27fc700 1 -- 172.21.15.78:0/2863876589 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b400eed0 con 0x7f23bc164c00 2023-06-09T11:12:26.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23b27fc700 1 -- 172.21.15.78:0/2863876589 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b400ca70 con 0x7f23bc164c00 2023-06-09T11:12:26.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.264+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc1650c0 con 0x7f23bc164c00 2023-06-09T11:12:26.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.268+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc0add50 con 0x7f23bc164c00 2023-06-09T11:12:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.268+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc161d20 con 0x7f23bc164c00 2023-06-09T11:12:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.268+0000 7f23b27fc700 1 -- 172.21.15.78:0/2863876589 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23b400cbf0 con 0x7f23bc164c00 2023-06-09T11:12:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.272+0000 7f23b27fc700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23a0066320 0x7f23a00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.272+0000 7f23b27fc700 1 -- 172.21.15.78:0/2863876589 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23b4083e80 con 0x7f23bc164c00 2023-06-09T11:12:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.272+0000 7f23c1b5b700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23a0066320 0x7f23a00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.272+0000 7f23c1b5b700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23a0066320 0x7f23a00687d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001560 tx=0x7f23b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:26.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.276+0000 7f23b27fc700 1 -- 172.21.15.78:0/2863876589 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f23b4051260 con 0x7f23bc164c00 2023-06-09T11:12:26.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.488+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f23bc0741c0 con 0x7f23bc164c00 2023-06-09T11:12:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.488+0000 7f23b27fc700 1 -- 172.21.15.78:0/2863876589 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f23b4017070 con 0x7f23bc164c00 2023-06-09T11:12:26.496 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T11:12:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23a0066320 msgr2=0x7f23a00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23a0066320 0x7f23a00687d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001560 tx=0x7f23b8009040 comp rx=0 tx=0).stop 2023-06-09T11:12:26.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 msgr2=0x7f23bc06f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:26.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc06f880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009fd0 tx=0x7f23b400ec90 comp rx=0 tx=0).stop 2023-06-09T11:12:26.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 shutdown_connections 2023-06-09T11:12:26.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23a0066320 0x7f23a00687d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc164c00 0x7f23bc06f880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23bc160940 0x7f23bc0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.492+0000 7f23c2b5d700 1 --2- 172.21.15.78:0/2863876589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23bc06f2a0 0x7f23bc151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:26.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.496+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 >> 172.21.15.78:0/2863876589 conn(0x7f23bc0cf670 msgr2=0x7f23bc15b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:26.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.496+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 shutdown_connections 2023-06-09T11:12:26.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:26.496+0000 7f23c2b5d700 1 -- 172.21.15.78:0/2863876589 wait complete. 2023-06-09T11:12:26.522 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T11:12:26.523 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T11:12:26.523 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-06-09T11:12:26.523 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T11:12:26.523 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T11:12:26.523 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T11:12:26.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T11:12:26.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T11:12:26.524 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T11:12:26.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.525 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-06-09T11:12:26.543 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:26.546 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T11:12:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T11:12:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-06-09T11:12:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-06-09T11:12:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:26.546 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T11:12:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:88:f1:7a:29 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T11:12:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:26.547 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T11:12:26.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.548 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:26.548 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:26.548 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-06-09T11:12:26.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-06-09T11:12:26.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-06-09T11:12:26.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T11:12:26.549 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:26.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.695 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T11:12:26.731 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-06-09T11:12:26.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.734 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-06-09T11:12:26.830 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-06-09T11:12:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T11:12:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T11:12:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T11:12:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T11:12:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T11:12:26.831 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T11:12:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T11:12:26.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.832 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:26.833 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:26.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T11:12:26.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T11:12:26.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T11:12:26.834 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:26.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.971 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-06-09T11:12:26.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:26.986 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-06-09T11:12:27.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:27.049 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:27.049 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:27.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T11:12:27.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-09T11:12:27.050 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:27.165 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-09T11:12:27.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:27.166 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:27.166 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:27.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-09T11:12:27.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T11:12:27.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-09T11:12:27.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-09T11:12:27.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-09T11:12:27.168 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:27.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:27.335 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:27.335 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:27.336 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-06-09T11:12:27.336 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T11:12:27.336 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:27.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:27.407 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T11:12:27.421 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T11:12:27.422 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:27.422 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T11:12:27.482 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-09T11:12:27.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:27.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:27.623 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:27.623 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:27.763 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:27.763 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:27.763 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-06-09T11:12:27.763 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 0@a733ef11-cd5d-4be5-8773-23eabcf05e48.cephfs=/ 2023-06-09T11:12:27.764 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.78:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-06-09T11:12:27.770 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T11:12:27.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:27.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T11:12:27.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:27.802 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:27.893 INFO:teuthology.orchestra.run.smithi078.stdout:client4659 2023-06-09T11:12:27.894 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:27.894 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:27.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:27.955 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:28.037 INFO:teuthology.orchestra.run.smithi078.stdout:client4659 2023-06-09T11:12:28.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:28.038 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:28.126 INFO:teuthology.orchestra.run.smithi078.stdout:client4659 2023-06-09T11:12:28.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:28.127 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a733ef11-cd5d-4be5-8773-23eabcf05e48.client4659/status') 2023-06-09T11:12:28.215 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4659 (3)192.168.0.1:0/2648838077 2023-06-09T11:12:28.216 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2023-06-09T11:12:28.216 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2023-06-09T11:12:28.217 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2023-06-09T11:12:28.217 INFO:teuthology.orchestra.run.smithi078.stderr:69 bytes copied, 0.00014406 s, 479 kB/s 2023-06-09T11:12:28.218 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-06-09T11:12:28.219 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T11:12:28.219 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T11:12:28.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T11:12:28.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ee29f700 1 Processor -- start 2023-06-09T11:12:28.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ee29f700 1 -- start start 2023-06-09T11:12:28.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ee29f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e8164c00 0x7fd6e80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:28.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ee29f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd6e806f2a0 0x7fd6e806dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:28.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ee29f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80adb00 con 0x7fd6e8160940 2023-06-09T11:12:28.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ee29f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e81653a0 con 0x7fd6e806f2a0 2023-06-09T11:12:28.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ee29f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e806ba70 con 0x7fd6e8164c00 2023-06-09T11:12:28.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ed29d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd6e8160940 0x7fd6e81644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37304/0 (socket says 172.21.15.78:37304) 2023-06-09T11:12:28.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6ed29d700 1 -- 172.21.15.78:0/45657618 learned_addr learned my addr 172.21.15.78:0/45657618 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:28.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6eca9c700 1 --2- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e8164c00 0x7fd6e80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:28.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.432+0000 7fd6eda9e700 1 --2- 172.21.15.78:0/45657618 >> v2:172.21.15.187:3300/0 conn(0x7fd6e806f2a0 0x7fd6e806dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:28.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6dffff700 1 -- 172.21.15.78:0/45657618 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949939551 0 0) 0x7fd6e80adb00 con 0x7fd6e8160940 2023-06-09T11:12:28.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6dffff700 1 -- 172.21.15.78:0/45657618 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d40035d0 con 0x7fd6e8160940 2023-06-09T11:12:28.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6eda9e700 1 -- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e8164c00 msgr2=0x7fd6e80ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:28.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6eda9e700 1 --2- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e8164c00 0x7fd6e80ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6eda9e700 1 -- 172.21.15.78:0/45657618 >> v1:172.21.15.78:6789/0 conn(0x7fd6e8160940 legacy=0x7fd6e81644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:28.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6eda9e700 1 -- 172.21.15.78:0/45657618 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80ccb10 con 0x7fd6e806f2a0 2023-06-09T11:12:28.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6eda9e700 1 --2- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806f2a0 0x7fd6e806dfa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009dc0 tx=0x7fd6e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b06072485666d7b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:28.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6dffff700 1 -- 172.21.15.78:0/45657618 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000e070 con 0x7fd6e806f2a0 2023-06-09T11:12:28.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6dffff700 1 -- 172.21.15.78:0/45657618 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e000bae0 con 0x7fd6e806f2a0 2023-06-09T11:12:28.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6dffff700 1 -- 172.21.15.78:0/45657618 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000be90 con 0x7fd6e806f2a0 2023-06-09T11:12:28.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 -- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806f2a0 msgr2=0x7fd6e806dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:28.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806f2a0 0x7fd6e806dfa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009dc0 tx=0x7fd6e000b330 comp rx=0 tx=0).stop 2023-06-09T11:12:28.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 -- 172.21.15.78:0/45657618 shutdown_connections 2023-06-09T11:12:28.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806f2a0 0x7fd6e806dfa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/45657618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e8164c00 0x7fd6e80ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 -- 172.21.15.78:0/45657618 >> 172.21.15.78:0/45657618 conn(0x7fd6e80cf670 msgr2=0x7fd6e80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:28.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 -- 172.21.15.78:0/45657618 shutdown_connections 2023-06-09T11:12:28.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.436+0000 7fd6ee29f700 1 -- 172.21.15.78:0/45657618 wait complete. 2023-06-09T11:12:28.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 Processor -- start 2023-06-09T11:12:28.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 -- start start 2023-06-09T11:12:28.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e806f2a0 0x7fd6e815e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:28.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6e8160940 0x7fd6e81f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:28.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e8164c00 0x7fd6e815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:28.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81f6180 con 0x7fd6e8160940 2023-06-09T11:12:28.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e815f630 con 0x7fd6e8164c00 2023-06-09T11:12:28.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ee29f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e815a5f0 con 0x7fd6e806f2a0 2023-06-09T11:12:28.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6e8160940 0x7fd6e81f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:28.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6e8160940 0x7fd6e81f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55980/0 (socket says 172.21.15.78:55980) 2023-06-09T11:12:28.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 -- 172.21.15.78:0/3491627641 learned_addr learned my addr 172.21.15.78:0/3491627641 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:28.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eda9e700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e8164c00 0x7fd6e815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:28.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ed29d700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e806f2a0 0x7fd6e815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 -- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e806f2a0 msgr2=0x7fd6e815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e806f2a0 0x7fd6e815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 -- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e8164c00 msgr2=0x7fd6e815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e8164c00 0x7fd6e815ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eca9c700 1 -- 172.21.15.78:0/3491627641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009a70 con 0x7fd6e8160940 2023-06-09T11:12:28.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6eda9e700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e8164c00 0x7fd6e815ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:28.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.440+0000 7fd6ed29d700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e806f2a0 0x7fd6e815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:28.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6eca9c700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6e8160940 0x7fd6e81f5c40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800e840 tx=0x7fd6d800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:28.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6ddffb700 1 -- 172.21.15.78:0/3491627641 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80095a0 con 0x7fd6e8160940 2023-06-09T11:12:28.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6ddffb700 1 -- 172.21.15.78:0/3491627641 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8013680 con 0x7fd6e8160940 2023-06-09T11:12:28.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e81650c0 con 0x7fd6e8160940 2023-06-09T11:12:28.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6ddffb700 1 -- 172.21.15.78:0/3491627641 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8013a30 con 0x7fd6e8160940 2023-06-09T11:12:28.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e80add50 con 0x7fd6e8160940 2023-06-09T11:12:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e8161d20 con 0x7fd6e8160940 2023-06-09T11:12:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.444+0000 7fd6ddffb700 1 -- 172.21.15.78:0/3491627641 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6d8013b90 con 0x7fd6e8160940 2023-06-09T11:12:28.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.448+0000 7fd6ddffb700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6cc0662f0 0x7fd6cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.448+0000 7fd6ddffb700 1 -- 172.21.15.78:0/3491627641 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6d8083c90 con 0x7fd6e8160940 2023-06-09T11:12:28.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.448+0000 7fd6ed29d700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6cc0662f0 0x7fd6cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:28.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.448+0000 7fd6ed29d700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6cc0662f0 0x7fd6cc0687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40011e0 tx=0x7fd6e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:28.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.452+0000 7fd6ddffb700 1 -- 172.21.15.78:0/3491627641 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd6d8054b00 con 0x7fd6e8160940 2023-06-09T11:12:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.656+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6e80741c0 con 0x7fd6e8160940 2023-06-09T11:12:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.656+0000 7fd6ddffb700 1 -- 172.21.15.78:0/3491627641 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd6d8054690 con 0x7fd6e8160940 2023-06-09T11:12:28.664 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T11:12:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6cc0662f0 msgr2=0x7fd6cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6cc0662f0 0x7fd6cc0687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40011e0 tx=0x7fd6e4009040 comp rx=0 tx=0).stop 2023-06-09T11:12:28.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6e8160940 msgr2=0x7fd6e81f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6e8160940 0x7fd6e81f5c40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800e840 tx=0x7fd6d800ec00 comp rx=0 tx=0).stop 2023-06-09T11:12:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 shutdown_connections 2023-06-09T11:12:28.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd6cc0662f0 0x7fd6cc0687a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e8164c00 0x7fd6e815ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6e8160940 0x7fd6e81f5c40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 --2- 172.21.15.78:0/3491627641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e806f2a0 0x7fd6e815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 >> 172.21.15.78:0/3491627641 conn(0x7fd6e80cf670 msgr2=0x7fd6e806d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 shutdown_connections 2023-06-09T11:12:28.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:28.660+0000 7fd6ee29f700 1 -- 172.21.15.78:0/3491627641 wait complete. 2023-06-09T11:12:28.691 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T11:12:28.691 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T11:12:28.691 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-06-09T11:12:28.692 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-09T11:12:28.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T11:12:28.692 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T11:12:28.692 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T11:12:28.693 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T11:12:28.693 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-09T11:12:28.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:28.694 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-06-09T11:12:28.712 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:28.712 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:28.713 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:28.713 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:28.713 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:28.713 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:28.713 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-06-09T11:12:28.713 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:28.713 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:28.714 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-06-09T11:12:28.714 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:28.714 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:28.714 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T11:12:28.714 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:28.715 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T11:12:28.715 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42366sec preferred_lft 42366sec 2023-06-09T11:12:28.715 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-06-09T11:12:28.715 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:28.716 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T11:12:28.716 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:88:f1:7a:29 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:28.716 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T11:12:28.716 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:28.716 INFO:teuthology.orchestra.run.smithi078.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T11:12:28.716 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 2e:9b:44:13:81:46 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T11:12:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::1cbe:4ff:fe40:4dc5/64 scope link 2023-06-09T11:12:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:28.717 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T11:12:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 2e:9b:44:13:81:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T11:12:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::2c9b:44ff:fe13:8146/64 scope link tentative 2023-06-09T11:12:28.718 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:28.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:28.718 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T11:12:28.793 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-06-09T11:12:28.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:28.796 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-06-09T11:12:28.859 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-06-09T11:12:28.860 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T11:12:28.860 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T11:12:28.860 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T11:12:28.860 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T11:12:28.860 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T11:12:28.861 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T11:12:28.861 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T11:12:28.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:28.862 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:28.862 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:28.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T11:12:28.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T11:12:28.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T11:12:28.863 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:28.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:28.993 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-06-09T11:12:29.006 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T11:12:29.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.008 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-06-09T11:12:29.066 INFO:teuthology.orchestra.run.smithi078.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-09T11:12:29.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.067 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:29.068 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:29.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T11:12:29.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-09T11:12:29.068 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:29.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T11:12:29.219 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.220 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T11:12:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 52:9e:3d:27:1e:56 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T11:12:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T11:12:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::509e:3dff:fe27:1e56/64 scope link 2023-06-09T11:12:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T11:12:29.303 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:29.303 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:29.303 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:29.304 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.304 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:29.304 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.304 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T11:12:29.304 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 52:9e:3d:27:1e:56 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T11:12:29.304 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T11:12:29.304 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.305 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::509e:3dff:fe27:1e56/64 scope link 2023-06-09T11:12:29.305 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:29.307 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-09T11:12:29.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.308 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:29.309 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:29.309 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-09T11:12:29.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T11:12:29.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-09T11:12:29.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-09T11:12:29.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-09T11:12:29.311 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:29.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.497 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:12:29.498 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:12:29.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.1 up 2023-06-09T11:12:29.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T11:12:29.499 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:12:29.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:29.568 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-09T11:12:29.583 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-09T11:12:29.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:29.584 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-09T11:12:29.643 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-06-09T11:12:29.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:29.774 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:29.775 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:29.800 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:29.801 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:29.801 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-06-09T11:12:29.801 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 2@a733ef11-cd5d-4be5-8773-23eabcf05e48.cephfs=/ 2023-06-09T11:12:29.801 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.78:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-06-09T11:12:29.806 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T11:12:29.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-09T11:12:29.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.838 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:29.911 INFO:teuthology.orchestra.run.smithi078.stdout:client4723 2023-06-09T11:12:29.912 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:29.912 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:29.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:29.971 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:30.039 INFO:teuthology.orchestra.run.smithi078.stdout:client4723 2023-06-09T11:12:30.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:30.040 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:30.106 INFO:teuthology.orchestra.run.smithi078.stdout:client4723 2023-06-09T11:12:30.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:30.107 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a733ef11-cd5d-4be5-8773-23eabcf05e48.client4723/status') 2023-06-09T11:12:30.188 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4723 (3)172.21.15.78:0/1008790769 2023-06-09T11:12:30.189 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2023-06-09T11:12:30.189 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2023-06-09T11:12:30.189 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2023-06-09T11:12:30.189 INFO:teuthology.orchestra.run.smithi078.stderr:70 bytes copied, 0.000163919 s, 427 kB/s 2023-06-09T11:12:30.191 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-06-09T11:12:30.192 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T11:12:30.192 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T11:12:30.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T11:12:30.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623ea28700 1 Processor -- start 2023-06-09T11:12:30.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623ea28700 1 -- start start 2023-06-09T11:12:30.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623ea28700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f623806fc80 0x7f6238070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:30.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623ea28700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f623815c880 0x7f623806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:30.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623ea28700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62380c87a0 con 0x7f62380c7cb0 2023-06-09T11:12:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623ea28700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6238070590 con 0x7f623806fc80 2023-06-09T11:12:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623ea28700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62380c81e0 con 0x7f623815c880 2023-06-09T11:12:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623da26700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f623806fc80 0x7f6238070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:30.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623da26700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f623806fc80 0x7f6238070050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55990/0 (socket says 172.21.15.78:55990) 2023-06-09T11:12:30.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623da26700 1 -- 172.21.15.78:0/661769296 learned_addr learned my addr 172.21.15.78:0/661769296 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:30.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623d225700 1 --2- 172.21.15.78:0/661769296 >> v2:172.21.15.187:3300/0 conn(0x7f623815c880 0x7f623806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:30.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623da26700 1 -- 172.21.15.78:0/661769296 >> v2:172.21.15.187:3300/0 conn(0x7f623815c880 msgr2=0x7f623806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:30.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623da26700 1 --2- 172.21.15.78:0/661769296 >> v2:172.21.15.187:3300/0 conn(0x7f623815c880 0x7f623806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623da26700 1 -- 172.21.15.78:0/661769296 >> v1:172.21.15.187:6789/0 conn(0x7f62380c7cb0 legacy=0x7f623806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.396+0000 7f623da26700 1 -- 172.21.15.78:0/661769296 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380c84c0 con 0x7f623806fc80 2023-06-09T11:12:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623da26700 1 --2- 172.21.15.78:0/661769296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238070050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6234009910 tx=0x7f6234009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ac04d8223755ff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ca24700 1 -- 172.21.15.78:0/661769296 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400ba20 con 0x7f623806fc80 2023-06-09T11:12:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ca24700 1 -- 172.21.15.78:0/661769296 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400bb80 con 0x7f623806fc80 2023-06-09T11:12:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ca24700 1 -- 172.21.15.78:0/661769296 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234009e60 con 0x7f623806fc80 2023-06-09T11:12:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 -- 172.21.15.78:0/661769296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 msgr2=0x7f6238070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 --2- 172.21.15.78:0/661769296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238070050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6234009910 tx=0x7f6234009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 -- 172.21.15.78:0/661769296 shutdown_connections 2023-06-09T11:12:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 --2- 172.21.15.78:0/661769296 >> v2:172.21.15.187:3300/0 conn(0x7f623815c880 0x7f623806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 --2- 172.21.15.78:0/661769296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238070050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 -- 172.21.15.78:0/661769296 >> 172.21.15.78:0/661769296 conn(0x7f62380cf870 msgr2=0x7f62380cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 -- 172.21.15.78:0/661769296 shutdown_connections 2023-06-09T11:12:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.400+0000 7f623ea28700 1 -- 172.21.15.78:0/661769296 wait complete. 2023-06-09T11:12:30.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 Processor -- start 2023-06-09T11:12:30.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 -- start start 2023-06-09T11:12:30.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:30.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380c7cb0 0x7f62380d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:30.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f623815c880 0x7f623815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:30.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62381f5ff0 con 0x7f623806fc80 2023-06-09T11:12:30.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62380d18d0 con 0x7f62380c7cb0 2023-06-09T11:12:30.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62381f5230 con 0x7f623815c880 2023-06-09T11:12:30.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:30.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55998/0 (socket says 172.21.15.78:55998) 2023-06-09T11:12:30.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 -- 172.21.15.78:0/1169059622 learned_addr learned my addr 172.21.15.78:0/1169059622 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:30.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623d225700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380c7cb0 0x7f62380d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:30.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623e227700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f623815c880 0x7f623815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:30.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 -- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f623815c880 msgr2=0x7f623815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:30.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f623815c880 0x7f623815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 -- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380c7cb0 msgr2=0x7f62380d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:30.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380c7cb0 0x7f62380d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 -- 172.21.15.78:0/1169059622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234009570 con 0x7f623806fc80 2023-06-09T11:12:30.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623da26700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238156ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62380b5b00 tx=0x7f6234004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:30.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f622e7fc700 1 -- 172.21.15.78:0/1169059622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234004310 con 0x7f623806fc80 2023-06-09T11:12:30.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f622e7fc700 1 -- 172.21.15.78:0/1169059622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623401f070 con 0x7f623806fc80 2023-06-09T11:12:30.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623806a350 con 0x7f623806fc80 2023-06-09T11:12:30.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f622e7fc700 1 -- 172.21.15.78:0/1169059622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340036c0 con 0x7f623806fc80 2023-06-09T11:12:30.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.404+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623806a070 con 0x7f623806fc80 2023-06-09T11:12:30.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.408+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623806e490 con 0x7f623806fc80 2023-06-09T11:12:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.408+0000 7f622e7fc700 1 -- 172.21.15.78:0/1169059622 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6234021030 con 0x7f623806fc80 2023-06-09T11:12:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.408+0000 7f622e7fc700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f621c0662f0 0x7f621c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.412+0000 7f622e7fc700 1 -- 172.21.15.78:0/1169059622 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6234085100 con 0x7f623806fc80 2023-06-09T11:12:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.412+0000 7f623d225700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f621c0662f0 0x7f621c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.412+0000 7f623d225700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f621c0662f0 0x7f621c0687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f622800b9d0 tx=0x7f6228008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.416+0000 7f622e7fc700 1 -- 172.21.15.78:0/1169059622 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6234052690 con 0x7f623806fc80 2023-06-09T11:12:30.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.620+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f62380741c0 con 0x7f623806fc80 2023-06-09T11:12:30.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.620+0000 7f622e7fc700 1 -- 172.21.15.78:0/1169059622 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6234055cb0 con 0x7f623806fc80 2023-06-09T11:12:30.629 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T11:12:30.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f621c0662f0 msgr2=0x7f621c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:30.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f621c0662f0 0x7f621c0687a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f622800b9d0 tx=0x7f6228008040 comp rx=0 tx=0).stop 2023-06-09T11:12:30.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 msgr2=0x7f6238156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238156ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62380b5b00 tx=0x7f6234004770 comp rx=0 tx=0).stop 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 shutdown_connections 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f621c0662f0 0x7f621c0687a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f623815c880 0x7f623815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380c7cb0 0x7f62380d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 --2- 172.21.15.78:0/1169059622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f623806fc80 0x7f6238156ac0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 >> 172.21.15.78:0/1169059622 conn(0x7f62380cf870 msgr2=0x7f62380cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:30.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 shutdown_connections 2023-06-09T11:12:30.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:30.624+0000 7f623ea28700 1 -- 172.21.15.78:0/1169059622 wait complete. 2023-06-09T11:12:30.654 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T11:12:30.655 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T11:12:30.655 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-06-09T11:12:30.655 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-09T11:12:30.655 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T11:12:30.655 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T11:12:30.656 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T11:12:30.656 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T11:12:30.656 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-09T11:12:30.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:30.657 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-06-09T11:12:30.675 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:30.676 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:30.676 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:30.676 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:30.676 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:30.676 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:30.677 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:30.678 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T11:12:30.678 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:30.678 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T11:12:30.678 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-06-09T11:12:30.678 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-06-09T11:12:30.678 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:30.679 INFO:teuthology.orchestra.run.smithi187.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T11:12:30.679 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 02:42:a2:03:84:45 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:30.679 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T11:12:30.679 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:30.680 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T11:12:30.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:30.680 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:30.681 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:30.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2023-06-09T11:12:30.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2023-06-09T11:12:30.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2023-06-09T11:12:30.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T11:12:30.682 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:30.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:30.820 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T11:12:30.856 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-06-09T11:12:30.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:30.859 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-06-09T11:12:30.933 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-06-09T11:12:30.933 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T11:12:30.933 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T11:12:30.934 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T11:12:30.934 INFO:teuthology.orchestra.run.smithi187.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T11:12:30.934 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T11:12:30.934 INFO:teuthology.orchestra.run.smithi187.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T11:12:30.934 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T11:12:30.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:30.935 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:30.935 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:30.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T11:12:30.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T11:12:30.936 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T11:12:30.936 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:31.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.064 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-06-09T11:12:31.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.083 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-06-09T11:12:31.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.148 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:31.148 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:31.149 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T11:12:31.149 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-09T11:12:31.149 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:31.262 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-09T11:12:31.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.263 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:31.263 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:31.263 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-09T11:12:31.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T11:12:31.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-09T11:12:31.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-09T11:12:31.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-09T11:12:31.265 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:31.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.437 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:31.437 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:31.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-06-09T11:12:31.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T11:12:31.438 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:31.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:31.507 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-09T11:12:31.524 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-09T11:12:31.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:31.525 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-09T11:12:31.586 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-06-09T11:12:31.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.586 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:31.718 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:31.719 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:31.849 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:31.850 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:31.850 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-06-09T11:12:31.850 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@a733ef11-cd5d-4be5-8773-23eabcf05e48.cephfs=/ 2023-06-09T11:12:31.850 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.78:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-06-09T11:12:31.855 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T11:12:31.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-09T11:12:31.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:31.885 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:31.959 INFO:teuthology.orchestra.run.smithi187.stdout:client4674 2023-06-09T11:12:31.960 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:31.960 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:32.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:32.021 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:32.090 INFO:teuthology.orchestra.run.smithi187.stdout:client4674 2023-06-09T11:12:32.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:32.091 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:32.155 INFO:teuthology.orchestra.run.smithi187.stdout:client4674 2023-06-09T11:12:32.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:32.156 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a733ef11-cd5d-4be5-8773-23eabcf05e48.client4674/status') 2023-06-09T11:12:32.242 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4674 (3)172.21.15.187:0/3421072046 2023-06-09T11:12:32.243 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2023-06-09T11:12:32.243 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2023-06-09T11:12:32.243 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2023-06-09T11:12:32.243 INFO:teuthology.orchestra.run.smithi187.stderr:71 bytes copied, 0.000160671 s, 442 kB/s 2023-06-09T11:12:32.245 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-06-09T11:12:32.246 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T11:12:32.246 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T11:12:32.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T11:12:32.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.416+0000 7f45fb62d700 1 Processor -- start 2023-06-09T11:12:32.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.416+0000 7f45fb62d700 1 -- start start 2023-06-09T11:12:32.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45fb62d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 0x7f45f4165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45fb62d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40cc810 con 0x7f45f406dfe0 2023-06-09T11:12:32.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45fb62d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f4160ff0 con 0x7f45f40c1ce0 2023-06-09T11:12:32.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45fb62d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40cca60 con 0x7f45f4160c20 2023-06-09T11:12:32.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f9bca700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f45f406dfe0 0x7f45f406fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37312/0 (socket says 172.21.15.78:37312) 2023-06-09T11:12:32.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f9bca700 1 -- 172.21.15.78:0/2384807896 learned_addr learned my addr 172.21.15.78:0/2384807896 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f93c9700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 0x7f45f4165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913290873 0 0) 0x7f45f40cc810 con 0x7f45f406dfe0 2023-06-09T11:12:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e00035d0 con 0x7f45f406dfe0 2023-06-09T11:12:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255532671 0 0) 0x7f45f4160ff0 con 0x7f45f40c1ce0 2023-06-09T11:12:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f40cc810 con 0x7f45f40c1ce0 2023-06-09T11:12:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975012116 0 0) 0x7f45e00035d0 con 0x7f45f406dfe0 2023-06-09T11:12:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 msgr2=0x7f45f4165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 0x7f45f4165160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 >> v1:172.21.15.187:6789/0 conn(0x7f45f40c1ce0 legacy=0x7f45f406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40ccd40 con 0x7f45f406dfe0 2023-06-09T11:12:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f45ec0019f0 con 0x7f45f406dfe0 2023-06-09T11:12:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 >> v1:172.21.15.78:6789/0 conn(0x7f45f406dfe0 legacy=0x7f45f406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45e0003be0 0x7f45e0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45e0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 0x7f45e0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40cca60 con 0x7f45e0004870 2023-06-09T11:12:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e000bb10 con 0x7f45e0003be0 2023-06-09T11:12:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e000bcd0 con 0x7f45f4160c20 2023-06-09T11:12:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f8bc8700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45e0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f9bca700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 0x7f45e0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f93c9700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45e0003be0 0x7f45e0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f8bc8700 1 -- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 msgr2=0x7f45e0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:32.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f8bc8700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f4160c20 0x7f45e0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f8bc8700 1 -- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45e0003be0 msgr2=0x7f45e0003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f8bc8700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45e0003be0 0x7f45e0003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.420+0000 7f45f8bc8700 1 -- 172.21.15.78:0/2384807896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00035d0 con 0x7f45e0004870 2023-06-09T11:12:32.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45f8bc8700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45e0004ce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f45e4001960 tx=0x7f45e00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983cf71434115121 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:32.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4001450 con 0x7f45e0004870 2023-06-09T11:12:32.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40052f0 con 0x7f45e0004870 2023-06-09T11:12:32.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45ebfff700 1 -- 172.21.15.78:0/2384807896 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40036a0 con 0x7f45e0004870 2023-06-09T11:12:32.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45fb62d700 1 -- 172.21.15.78:0/2384807896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 msgr2=0x7f45e0004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:32.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45fb62d700 1 --2- 172.21.15.78:0/2384807896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45e0004ce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f45e4001960 tx=0x7f45e00058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45f9bca700 1 -- 172.21.15.78:0/2384807896 reap_dead start 2023-06-09T11:12:32.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45fb62d700 1 -- 172.21.15.78:0/2384807896 shutdown_connections 2023-06-09T11:12:32.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45fb62d700 1 -- 172.21.15.78:0/2384807896 >> 172.21.15.78:0/2384807896 conn(0x7f45f40b1480 msgr2=0x7f45f40cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:32.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45fb62d700 1 -- 172.21.15.78:0/2384807896 shutdown_connections 2023-06-09T11:12:32.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.424+0000 7f45fb62d700 1 -- 172.21.15.78:0/2384807896 wait complete. 2023-06-09T11:12:32.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 Processor -- start 2023-06-09T11:12:32.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 -- start start 2023-06-09T11:12:32.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45f41624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f41516c0 0x7f45f40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f40b4370 0x7f45f40c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40b47e0 con 0x7f45e0004870 2023-06-09T11:12:32.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4151b30 con 0x7f45f41516c0 2023-06-09T11:12:32.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c59e0 con 0x7f45f40b4370 2023-06-09T11:12:32.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45f41624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45f41624c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56008/0 (socket says 172.21.15.78:56008) 2023-06-09T11:12:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 -- 172.21.15.78:0/1677779811 learned_addr learned my addr 172.21.15.78:0/1677779811 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f8bc8700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f41516c0 0x7f45f40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f9bca700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f40b4370 0x7f45f40c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 -- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f40b4370 msgr2=0x7f45f40c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f40b4370 0x7f45f40c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 -- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f41516c0 msgr2=0x7f45f40b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f41516c0 0x7f45f40b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 -- 172.21.15.78:0/1677779811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40cd300 con 0x7f45e0004870 2023-06-09T11:12:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45f93c9700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45f41624c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45f0011a50 tx=0x7f45f0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45e9ffb700 1 -- 172.21.15.78:0/1677779811 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000f8e0 con 0x7f45e0004870 2023-06-09T11:12:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45e9ffb700 1 -- 172.21.15.78:0/1677779811 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f000fa40 con 0x7f45e0004870 2023-06-09T11:12:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.428+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40cd020 con 0x7f45e0004870 2023-06-09T11:12:32.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.432+0000 7f45e9ffb700 1 -- 172.21.15.78:0/1677779811 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000fdf0 con 0x7f45e0004870 2023-06-09T11:12:32.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.432+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f406eaa0 con 0x7f45e0004870 2023-06-09T11:12:32.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.432+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f40741c0 con 0x7f45e0004870 2023-06-09T11:12:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.432+0000 7f45e9ffb700 1 -- 172.21.15.78:0/1677779811 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45f0014440 con 0x7f45e0004870 2023-06-09T11:12:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.436+0000 7f45e9ffb700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45d80662f0 0x7f45d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.436+0000 7f45e9ffb700 1 -- 172.21.15.78:0/1677779811 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45f0084230 con 0x7f45e0004870 2023-06-09T11:12:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.436+0000 7f45f8bc8700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45d80662f0 0x7f45d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.436+0000 7f45f8bc8700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45d80662f0 0x7f45d80687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f45f4158380 tx=0x7f45e400a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:32.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.444+0000 7f45e9ffb700 1 -- 172.21.15.78:0/1677779811 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f45f0051780 con 0x7f45e0004870 2023-06-09T11:12:32.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.648+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45f41557d0 con 0x7f45e0004870 2023-06-09T11:12:32.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.648+0000 7f45e9ffb700 1 -- 172.21.15.78:0/1677779811 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f45f0054da0 con 0x7f45e0004870 2023-06-09T11:12:32.656 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T11:12:32.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45d80662f0 msgr2=0x7f45d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:32.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45d80662f0 0x7f45d80687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f45f4158380 tx=0x7f45e400a000 comp rx=0 tx=0).stop 2023-06-09T11:12:32.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 msgr2=0x7f45f41624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:32.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45f41624c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45f0011a50 tx=0x7f45f0011d60 comp rx=0 tx=0).stop 2023-06-09T11:12:32.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 shutdown_connections 2023-06-09T11:12:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45d80662f0 0x7f45d80687a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45f40b4370 0x7f45f40c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45f41516c0 0x7f45f40b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 --2- 172.21.15.78:0/1677779811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e0004870 0x7f45f41624c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 >> 172.21.15.78:0/1677779811 conn(0x7f45f40b1480 msgr2=0x7f45f40b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 shutdown_connections 2023-06-09T11:12:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:32.652+0000 7f45fb62d700 1 -- 172.21.15.78:0/1677779811 wait complete. 2023-06-09T11:12:32.680 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T11:12:32.681 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T11:12:32.681 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-06-09T11:12:32.681 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-09T11:12:32.681 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T11:12:32.681 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T11:12:32.682 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T11:12:32.682 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T11:12:32.682 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-09T11:12:32.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:32.683 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-06-09T11:12:32.700 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:32.701 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:32.701 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:32.702 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:32.702 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:32.702 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:32.702 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:32.702 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:32.702 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-06-09T11:12:32.702 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:32.703 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:32.703 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-06-09T11:12:32.703 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:12:32.703 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:32.703 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T11:12:32.703 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:32.703 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 02:42:a2:03:84:45 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:32.704 INFO:teuthology.orchestra.run.smithi187.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T11:12:32.705 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether ba:81:f3:f1:ff:30 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:12:32.705 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T11:12:32.705 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:32.705 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::3450:92ff:fe3b:628/64 scope link tentative 2023-06-09T11:12:32.705 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:32.705 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T11:12:32.705 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether ba:81:f3:f1:ff:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T11:12:32.706 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::b881:f3ff:fef1:ff30/64 scope link tentative 2023-06-09T11:12:32.706 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:32.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:32.707 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T11:12:32.788 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-06-09T11:12:32.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:32.792 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-06-09T11:12:32.855 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-06-09T11:12:32.855 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T11:12:32.855 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T11:12:32.855 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T11:12:32.856 INFO:teuthology.orchestra.run.smithi187.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T11:12:32.856 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T11:12:32.856 INFO:teuthology.orchestra.run.smithi187.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T11:12:32.856 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T11:12:32.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:32.857 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:32.857 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:32.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T11:12:32.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T11:12:32.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T11:12:32.858 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:32.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.000 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-06-09T11:12:33.016 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-09T11:12:33.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.019 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-06-09T11:12:33.083 INFO:teuthology.orchestra.run.smithi187.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-09T11:12:33.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.085 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:33.085 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:33.085 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-09T11:12:33.085 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-09T11:12:33.086 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:33.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.202 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T11:12:33.237 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.239 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T11:12:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether ce:ec:0e:7c:61:ed brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T11:12:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T11:12:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ccec:eff:fe7c:61ed/64 scope link 2023-06-09T11:12:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.241 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T11:12:33.320 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:12:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:12:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:12:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-06-09T11:12:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.322 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T11:12:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether ce:ec:0e:7c:61:ed brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T11:12:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T11:12:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ccec:eff:fe7c:61ed/64 scope link 2023-06-09T11:12:33.323 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:12:33.324 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-09T11:12:33.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.325 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:33.326 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:33.326 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-09T11:12:33.326 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T11:12:33.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-09T11:12:33.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-09T11:12:33.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-09T11:12:33.328 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:33.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.525 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-06-09T11:12:33.526 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-06-09T11:12:33.526 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.1 up 2023-06-09T11:12:33.526 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T11:12:33.526 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-06-09T11:12:33.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:33.600 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-09T11:12:33.617 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-09T11:12:33.618 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:12:33.618 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-09T11:12:33.675 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-06-09T11:12:33.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.676 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:33.807 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:33.808 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:33.832 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:12:33.832 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:12:33.833 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-06-09T11:12:33.833 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 3@a733ef11-cd5d-4be5-8773-23eabcf05e48.cephfs=/ 2023-06-09T11:12:33.833 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.78:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-06-09T11:12:33.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T11:12:33.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.840 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-09T11:12:33.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:33.868 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:33.936 INFO:teuthology.orchestra.run.smithi187.stdout:client4683 2023-06-09T11:12:33.937 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:33.937 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:34.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:34.001 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:34.069 INFO:teuthology.orchestra.run.smithi187.stdout:client4683 2023-06-09T11:12:34.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:34.070 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:12:34.134 INFO:teuthology.orchestra.run.smithi187.stdout:client4683 2023-06-09T11:12:34.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:34.135 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a733ef11-cd5d-4be5-8773-23eabcf05e48.client4683/status') 2023-06-09T11:12:34.211 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4683 (3)172.21.15.187:0/3259701427 2023-06-09T11:12:34.212 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2023-06-09T11:12:34.212 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2023-06-09T11:12:34.212 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2023-06-09T11:12:34.212 INFO:teuthology.orchestra.run.smithi187.stderr:71 bytes copied, 0.000100833 s, 704 kB/s 2023-06-09T11:12:34.214 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-09T11:12:34.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:34.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.396+0000 7fa824b51700 1 Processor -- start 2023-06-09T11:12:34.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.396+0000 7fa824b51700 1 -- start start 2023-06-09T11:12:34.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa824b51700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 0x7fa820070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa824b51700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8200c87a0 con 0x7fa8200c7cb0 2023-06-09T11:12:34.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa824b51700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa820070590 con 0x7fa82015c880 2023-06-09T11:12:34.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa824b51700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82006e660 con 0x7fa82006fc80 2023-06-09T11:12:34.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa8200c7cb0 0x7fa82006a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37316/0 (socket says 172.21.15.78:37316) 2023-06-09T11:12:34.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81ffff700 1 -- 172.21.15.78:0/912095868 learned_addr learned my addr 172.21.15.78:0/912095868 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 0x7fa820070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806562171 0 0) 0x7fa8200c87a0 con 0x7fa8200c7cb0 2023-06-09T11:12:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8080035d0 con 0x7fa8200c7cb0 2023-06-09T11:12:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450310355 0 0) 0x7fa8080035d0 con 0x7fa8200c7cb0 2023-06-09T11:12:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 msgr2=0x7fa820070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 0x7fa820070050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 >> v1:172.21.15.187:6789/0 conn(0x7fa82015c880 legacy=0x7fa82006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200c81e0 con 0x7fa8200c7cb0 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7fa8180019f0 con 0x7fa8200c7cb0 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 >> v1:172.21.15.78:6789/0 conn(0x7fa8200c7cb0 legacy=0x7fa82006a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa808003a50 0x7fa808003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 0x7fa808004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa808004db0 0x7fa808005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82006e660 con 0x7fa808003a50 2023-06-09T11:12:34.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80800ba30 con 0x7fa808004db0 2023-06-09T11:12:34.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80800bbc0 con 0x7fa82006fc80 2023-06-09T11:12:34.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa808003a50 0x7fa808003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81ffff700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa808004db0 0x7fa808005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81effd700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 0x7fa808004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 -- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 msgr2=0x7fa808004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82006fc80 0x7fa808004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 -- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa808004db0 msgr2=0x7fa808005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa808004db0 0x7fa808005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 -- 172.21.15.78:0/912095868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080035d0 con 0x7fa808003a50 2023-06-09T11:12:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81ffff700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa808004db0 0x7fa808005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa808003a50 0x7fa808003e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa810009b70 tx=0x7fa8080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d7aa39a4765aea server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.400+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81000e6c0 con 0x7fa808003a50 2023-06-09T11:12:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81000e820 con 0x7fa808003a50 2023-06-09T11:12:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa81e7fc700 1 -- 172.21.15.78:0/912095868 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81000eb90 con 0x7fa808003a50 2023-06-09T11:12:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa824b51700 1 -- 172.21.15.78:0/912095868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa808003a50 msgr2=0x7fa808003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa824b51700 1 --2- 172.21.15.78:0/912095868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa808003a50 0x7fa808003e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa810009b70 tx=0x7fa8080058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa81ffff700 1 -- 172.21.15.78:0/912095868 reap_dead start 2023-06-09T11:12:34.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa824b51700 1 -- 172.21.15.78:0/912095868 shutdown_connections 2023-06-09T11:12:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa824b51700 1 -- 172.21.15.78:0/912095868 >> 172.21.15.78:0/912095868 conn(0x7fa8200cf870 msgr2=0x7fa8200cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa824b51700 1 -- 172.21.15.78:0/912095868 shutdown_connections 2023-06-09T11:12:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.404+0000 7fa824b51700 1 -- 172.21.15.78:0/912095868 wait complete. 2023-06-09T11:12:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 Processor -- start 2023-06-09T11:12:34.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 -- start start 2023-06-09T11:12:34.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa808003a50 0x7fa820159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82015fdb0 0x7fa8200cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8200b2080 0x7fa8200cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200ceb60 con 0x7fa8200b2080 2023-06-09T11:12:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820160580 con 0x7fa82015fdb0 2023-06-09T11:12:34.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa824b51700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa820160860 con 0x7fa808003a50 2023-06-09T11:12:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8200b2080 0x7fa8200cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8200b2080 0x7fa8200cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56032/0 (socket says 172.21.15.78:56032) 2023-06-09T11:12:34.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 -- 172.21.15.78:0/3654346846 learned_addr learned my addr 172.21.15.78:0/3654346846 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa808003a50 0x7fa820159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81effd700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82015fdb0 0x7fa8200cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 -- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa808003a50 msgr2=0x7fa820159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa808003a50 0x7fa820159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 -- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82015fdb0 msgr2=0x7fa8200cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82015fdb0 0x7fa8200cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 -- 172.21.15.78:0/3654346846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82006a070 con 0x7fa8200b2080 2023-06-09T11:12:34.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.408+0000 7fa81ffff700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8200b2080 0x7fa8200cbac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa82006f5d0 tx=0x7fa818001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:34.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.412+0000 7fa807fff700 1 -- 172.21.15.78:0/3654346846 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800e810 con 0x7fa8200b2080 2023-06-09T11:12:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.412+0000 7fa807fff700 1 -- 172.21.15.78:0/3654346846 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81800e9b0 con 0x7fa8200b2080 2023-06-09T11:12:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.412+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8200c84c0 con 0x7fa8200b2080 2023-06-09T11:12:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.412+0000 7fa807fff700 1 -- 172.21.15.78:0/3654346846 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800ed60 con 0x7fa8200b2080 2023-06-09T11:12:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.412+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82006a350 con 0x7fa8200b2080 2023-06-09T11:12:34.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.412+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8200741c0 con 0x7fa8200b2080 2023-06-09T11:12:34.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.416+0000 7fa807fff700 1 -- 172.21.15.78:0/3654346846 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa81801d460 con 0x7fa8200b2080 2023-06-09T11:12:34.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.416+0000 7fa807fff700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa80c066370 0x7fa80c068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.416+0000 7fa807fff700 1 -- 172.21.15.78:0/3654346846 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa818083e60 con 0x7fa8200b2080 2023-06-09T11:12:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.416+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa80c066370 0x7fa80c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.416+0000 7fa81f7fe700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa80c066370 0x7fa80c068820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8100090b0 tx=0x7fa81001e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:34.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.420+0000 7fa807fff700 1 -- 172.21.15.78:0/3654346846 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa818051350 con 0x7fa8200b2080 2023-06-09T11:12:34.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.592+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa82006ef40 con 0x7fa8200b2080 2023-06-09T11:12:34.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.596+0000 7fa807fff700 1 -- 172.21.15.78:0/3654346846 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7fa818054970 con 0x7fa8200b2080 2023-06-09T11:12:34.605 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:34.605 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:34.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa80c066370 msgr2=0x7fa80c068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa80c066370 0x7fa80c068820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8100090b0 tx=0x7fa81001e040 comp rx=0 tx=0).stop 2023-06-09T11:12:34.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8200b2080 msgr2=0x7fa8200cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8200b2080 0x7fa8200cbac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa82006f5d0 tx=0x7fa818001a80 comp rx=0 tx=0).stop 2023-06-09T11:12:34.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 shutdown_connections 2023-06-09T11:12:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa80c066370 0x7fa80c068820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8200b2080 0x7fa8200cbac0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82015fdb0 0x7fa8200cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 --2- 172.21.15.78:0/3654346846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa808003a50 0x7fa820159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 >> 172.21.15.78:0/3654346846 conn(0x7fa8200cf870 msgr2=0x7fa8200b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:34.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 shutdown_connections 2023-06-09T11:12:34.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.600+0000 7fa824b51700 1 -- 172.21.15.78:0/3654346846 wait complete. 2023-06-09T11:12:34.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:34.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.800+0000 7f533a6cf700 1 Processor -- start 2023-06-09T11:12:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.800+0000 7f533a6cf700 1 -- start start 2023-06-09T11:12:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.800+0000 7f533a6cf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5334160b60 0x7f533406ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f533a6cf700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f533406b360 0x7f533406fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f533a6cf700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53340cd470 con 0x7f5334160f30 2023-06-09T11:12:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f533a6cf700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53340cb070 con 0x7f533406b360 2023-06-09T11:12:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f533a6cf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340ccbd0 con 0x7f5334160b60 2023-06-09T11:12:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5334160b60 0x7f533406ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5334160b60 0x7f533406ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:48324/0 (socket says 172.21.15.78:48324) 2023-06-09T11:12:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 -- 172.21.15.78:0/3442965690 learned_addr learned my addr 172.21.15.78:0/3442965690 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5338c6c700 1 --2- 172.21.15.78:0/3442965690 >> v2:172.21.15.187:3300/0 conn(0x7f533406b360 0x7f533406fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 -- 172.21.15.78:0/3442965690 >> v2:172.21.15.187:3300/0 conn(0x7f533406b360 msgr2=0x7f533406fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 --2- 172.21.15.78:0/3442965690 >> v2:172.21.15.187:3300/0 conn(0x7f533406b360 0x7f533406fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 -- 172.21.15.78:0/3442965690 >> v1:172.21.15.187:6789/0 conn(0x7f5334160f30 legacy=0x7f53340c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 -- 172.21.15.78:0/3442965690 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340cceb0 con 0x7f5334160b60 2023-06-09T11:12:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f5333fff700 1 --2- 172.21.15.78:0/3442965690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5334160b60 0x7f533406ae20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5324009910 tx=0x7f5324009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d389c357a4cba744 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:34.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f53337fe700 1 -- 172.21.15.78:0/3442965690 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324011830 con 0x7f5334160b60 2023-06-09T11:12:34.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f53337fe700 1 -- 172.21.15.78:0/3442965690 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324011990 con 0x7f5334160b60 2023-06-09T11:12:34.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.804+0000 7f53337fe700 1 -- 172.21.15.78:0/3442965690 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324011d40 con 0x7f5334160b60 2023-06-09T11:12:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 -- 172.21.15.78:0/3442965690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5334160b60 msgr2=0x7f533406ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 --2- 172.21.15.78:0/3442965690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5334160b60 0x7f533406ae20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5324009910 tx=0x7f5324009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 -- 172.21.15.78:0/3442965690 shutdown_connections 2023-06-09T11:12:34.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 --2- 172.21.15.78:0/3442965690 >> v2:172.21.15.187:3300/0 conn(0x7f533406b360 0x7f533406fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 --2- 172.21.15.78:0/3442965690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5334160b60 0x7f533406ae20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 -- 172.21.15.78:0/3442965690 >> 172.21.15.78:0/3442965690 conn(0x7f53340cf8b0 msgr2=0x7f53340cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:34.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 -- 172.21.15.78:0/3442965690 shutdown_connections 2023-06-09T11:12:34.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 -- 172.21.15.78:0/3442965690 wait complete. 2023-06-09T11:12:34.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.808+0000 7f533a6cf700 1 Processor -- start 2023-06-09T11:12:34.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 -- start start 2023-06-09T11:12:34.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f533406b360 0x7f53341f9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5334160b60 0x7f533414d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5334160f30 0x7f533415cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533415be00 con 0x7f5334160b60 2023-06-09T11:12:34.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533415c0e0 con 0x7f5334160f30 2023-06-09T11:12:34.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533415c3c0 con 0x7f533406b360 2023-06-09T11:12:34.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5334160b60 0x7f533414d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5334160b60 0x7f533414d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54344/0 (socket says 172.21.15.78:54344) 2023-06-09T11:12:34.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 -- 172.21.15.78:0/1023219267 learned_addr learned my addr 172.21.15.78:0/1023219267 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:34.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f5333fff700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f533406b360 0x7f53341f9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f5338c6c700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5334160f30 0x7f533415cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 -- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f533406b360 msgr2=0x7f53341f9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f533406b360 0x7f53341f9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 -- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5334160f30 msgr2=0x7f533415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:34.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5334160f30 0x7f533415cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:34.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 -- 172.21.15.78:0/1023219267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009570 con 0x7f5334160b60 2023-06-09T11:12:34.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f532b7fe700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5334160b60 0x7f533414d030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c500 tx=0x7f531c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:34.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f53317fa700 1 -- 172.21.15.78:0/1023219267 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0052d0 con 0x7f5334160b60 2023-06-09T11:12:34.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533406f9b0 con 0x7f5334160b60 2023-06-09T11:12:34.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f53317fa700 1 -- 172.21.15.78:0/1023219267 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c005430 con 0x7f5334160b60 2023-06-09T11:12:34.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.812+0000 7f53317fa700 1 -- 172.21.15.78:0/1023219267 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0055a0 con 0x7f5334160b60 2023-06-09T11:12:34.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.816+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53340cd190 con 0x7f5334160b60 2023-06-09T11:12:34.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.816+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53340cc7f0 con 0x7f5334160b60 2023-06-09T11:12:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.816+0000 7f53317fa700 1 -- 172.21.15.78:0/1023219267 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f531c0038e0 con 0x7f5334160b60 2023-06-09T11:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.820+0000 7f53317fa700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f53140662f0 0x7f53140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.820+0000 7f53317fa700 1 -- 172.21.15.78:0/1023219267 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f531c0831a0 con 0x7f5334160b60 2023-06-09T11:12:34.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.820+0000 7f5333fff700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f53140662f0 0x7f53140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:34.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.820+0000 7f5333fff700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f53140662f0 0x7f53140687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5324000c00 tx=0x7f5324008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:34.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.824+0000 7f53317fa700 1 -- 172.21.15.78:0/1023219267 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f531c050500 con 0x7f5334160b60 2023-06-09T11:12:35.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.996+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53340741c0 con 0x7f5334160b60 2023-06-09T11:12:35.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:34.996+0000 7f53317fa700 1 -- 172.21.15.78:0/1023219267 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f531c053b20 con 0x7f5334160b60 2023-06-09T11:12:35.005 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:35.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f53140662f0 msgr2=0x7f53140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f53140662f0 0x7f53140687a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5324000c00 tx=0x7f5324008030 comp rx=0 tx=0).stop 2023-06-09T11:12:35.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5334160b60 msgr2=0x7f533414d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5334160b60 0x7f533414d030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c500 tx=0x7f531c00c810 comp rx=0 tx=0).stop 2023-06-09T11:12:35.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 shutdown_connections 2023-06-09T11:12:35.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f53140662f0 0x7f53140687a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5334160f30 0x7f533415cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5334160b60 0x7f533414d030 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 --2- 172.21.15.78:0/1023219267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f533406b360 0x7f53341f9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 >> 172.21.15.78:0/1023219267 conn(0x7f53340cf8b0 msgr2=0x7f5334160150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 shutdown_connections 2023-06-09T11:12:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.000+0000 7f533a6cf700 1 -- 172.21.15.78:0/1023219267 wait complete. 2023-06-09T11:12:35.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:35.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.200+0000 7f2db960a700 1 Processor -- start 2023-06-09T11:12:35.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.200+0000 7f2db960a700 1 -- start start 2023-06-09T11:12:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db960a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2db40cb530 0x7f2db40ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db960a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db4070ac0 con 0x7f2db40ae220 2023-06-09T11:12:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db960a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db406fa20 con 0x7f2db406e5c0 2023-06-09T11:12:35.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db960a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db40706a0 con 0x7f2db40cb530 2023-06-09T11:12:35.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db27fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2db40ae220 0x7f2db406deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48326/0 (socket says 172.21.15.78:48326) 2023-06-09T11:12:35.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db27fc700 1 -- 172.21.15.78:0/4101706977 learned_addr learned my addr 172.21.15.78:0/4101706977 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db2ffd700 1 --2- 172.21.15.78:0/4101706977 >> v2:172.21.15.187:3300/0 conn(0x7f2db40cb530 0x7f2db40ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314719935 0 0) 0x7f2db4070ac0 con 0x7f2db40ae220 2023-06-09T11:12:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.204+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d9c0034f0 con 0x7f2db40ae220 2023-06-09T11:12:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024171047 0 0) 0x7f2db406fa20 con 0x7f2db406e5c0 2023-06-09T11:12:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db4070ac0 con 0x7f2db406e5c0 2023-06-09T11:12:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1990486473 0 0) 0x7f2d9c0034f0 con 0x7f2db40ae220 2023-06-09T11:12:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 >> v2:172.21.15.187:3300/0 conn(0x7f2db40cb530 msgr2=0x7f2db40ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 --2- 172.21.15.78:0/4101706977 >> v2:172.21.15.187:3300/0 conn(0x7f2db40cb530 0x7f2db40ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 >> v1:172.21.15.187:6789/0 conn(0x7f2db406e5c0 legacy=0x7f2db40c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db406fd00 con 0x7f2db40ae220 2023-06-09T11:12:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f2da8001670 con 0x7f2db40ae220 2023-06-09T11:12:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 >> v1:172.21.15.78:6789/0 conn(0x7f2db40ae220 legacy=0x7f2db406deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c003ca0 0x7f2d9c004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c008ab0 0x7f2d9c00af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2d9c00daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40706a0 con 0x7f2d9c00b640 2023-06-09T11:12:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c00e3d0 con 0x7f2d9c003ca0 2023-06-09T11:12:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c00e590 con 0x7f2d9c008ab0 2023-06-09T11:12:35.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2d9c00daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db2ffd700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c003ca0 0x7f2d9c004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db27fc700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c008ab0 0x7f2d9c00af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 -- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c008ab0 msgr2=0x7f2d9c00af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:35.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9c008ab0 0x7f2d9c00af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 -- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c003ca0 msgr2=0x7f2d9c004090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9c003ca0 0x7f2d9c004090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 -- 172.21.15.78:0/4101706977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c0034f0 con 0x7f2d9c00b640 2023-06-09T11:12:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 -- 172.21.15.78:0/4101706977 reap_dead start 2023-06-09T11:12:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db37fe700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2d9c00daf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c2f0 tx=0x7f2d9c0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d57b4d55ce4ec8f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac001f30 con 0x7f2d9c00b640 2023-06-09T11:12:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac003a20 con 0x7f2d9c00b640 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db1ffb700 1 -- 172.21.15.78:0/4101706977 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac003dd0 con 0x7f2d9c00b640 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db960a700 1 -- 172.21.15.78:0/4101706977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 msgr2=0x7f2d9c00daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db960a700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2d9c00daf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c2f0 tx=0x7f2d9c0037a0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db960a700 1 -- 172.21.15.78:0/4101706977 shutdown_connections 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db960a700 1 --2- 172.21.15.78:0/4101706977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2d9c00daf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db960a700 1 -- 172.21.15.78:0/4101706977 >> 172.21.15.78:0/4101706977 conn(0x7f2db40cca20 msgr2=0x7f2db40cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db960a700 1 -- 172.21.15.78:0/4101706977 shutdown_connections 2023-06-09T11:12:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.208+0000 7f2db960a700 1 -- 172.21.15.78:0/4101706977 wait complete. 2023-06-09T11:12:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.212+0000 7f2db960a700 1 Processor -- start 2023-06-09T11:12:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.212+0000 7f2db960a700 1 -- start start 2023-06-09T11:12:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2db40ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2db40ce780 0x7f2db40c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2db40c50f0 0x7f2db40c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40cf8a0 con 0x7f2d9c00b640 2023-06-09T11:12:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40c5aa0 con 0x7f2db40ce780 2023-06-09T11:12:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40cf000 con 0x7f2db40c50f0 2023-06-09T11:12:35.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2db40ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2db40ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54376/0 (socket says 172.21.15.78:54376) 2023-06-09T11:12:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 -- 172.21.15.78:0/3375030219 learned_addr learned my addr 172.21.15.78:0/3375030219 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db27fc700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2db40ce780 0x7f2db40c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db37fe700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2db40c50f0 0x7f2db40c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 -- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2db40c50f0 msgr2=0x7f2db40c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2db40c50f0 0x7f2db40c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 -- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2db40ce780 msgr2=0x7f2db40c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2db40ce780 0x7f2db40c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 -- 172.21.15.78:0/3375030219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db40702c0 con 0x7f2d9c00b640 2023-06-09T11:12:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db2ffd700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2db40ce240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2da40119a0 tx=0x7f2da4011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/3375030219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400f750 con 0x7f2d9c00b640 2023-06-09T11:12:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/3375030219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400f8d0 con 0x7f2d9c00b640 2023-06-09T11:12:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/3375030219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400fc80 con 0x7f2d9c00b640 2023-06-09T11:12:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db406ffe0 con 0x7f2d9c00b640 2023-06-09T11:12:35.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.216+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db40ae770 con 0x7f2d9c00b640 2023-06-09T11:12:35.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.220+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db4067610 con 0x7f2d9c00b640 2023-06-09T11:12:35.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.220+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/3375030219 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2da4014440 con 0x7f2d9c00b640 2023-06-09T11:12:35.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.220+0000 7f2d9b7fe700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2da00662f0 0x7f2da00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.220+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/3375030219 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2da4084d80 con 0x7f2d9c00b640 2023-06-09T11:12:35.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.224+0000 7f2db27fc700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2da00662f0 0x7f2da00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.224+0000 7f2db27fc700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2da00662f0 0x7f2da00687a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2db41f55e0 tx=0x7f2da8007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:35.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.228+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/3375030219 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2da4055d00 con 0x7f2d9c00b640 2023-06-09T11:12:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.400+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2db40cfe10 con 0x7f2d9c00b640 2023-06-09T11:12:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.400+0000 7f2d9b7fe700 1 -- 172.21.15.78:0/3375030219 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2da4022020 con 0x7f2d9c00b640 2023-06-09T11:12:35.408 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2da00662f0 msgr2=0x7f2da00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2da00662f0 0x7f2da00687a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2db41f55e0 tx=0x7f2da8007040 comp rx=0 tx=0).stop 2023-06-09T11:12:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 msgr2=0x7f2db40ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2db40ce240 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2da40119a0 tx=0x7f2da4011cb0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 shutdown_connections 2023-06-09T11:12:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2da00662f0 0x7f2da00687a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2db40c50f0 0x7f2db40c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2db40ce780 0x7f2db40c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 --2- 172.21.15.78:0/3375030219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d9c00b640 0x7f2db40ce240 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 >> 172.21.15.78:0/3375030219 conn(0x7f2db40cca20 msgr2=0x7f2db40ac790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 shutdown_connections 2023-06-09T11:12:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.404+0000 7f2db960a700 1 -- 172.21.15.78:0/3375030219 wait complete. 2023-06-09T11:12:35.435 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:35.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.604+0000 7f78c22cb700 1 Processor -- start 2023-06-09T11:12:35.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.604+0000 7f78c22cb700 1 -- start start 2023-06-09T11:12:35.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f78bc158a70 0x7f78bc0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f78bc06ae70 0x7f78bc0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0cbe50 con 0x7f78bc0b2db0 2023-06-09T11:12:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0cc0f0 con 0x7f78bc158a70 2023-06-09T11:12:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0cc3d0 con 0x7f78bc06ae70 2023-06-09T11:12:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f78bc158a70 0x7f78bc0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f78bc158a70 0x7f78bc0b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54390/0 (socket says 172.21.15.78:54390) 2023-06-09T11:12:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 -- 172.21.15.78:0/999487377 learned_addr learned my addr 172.21.15.78:0/999487377 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c1aca700 1 --2- 172.21.15.78:0/999487377 >> v2:172.21.15.187:3300/0 conn(0x7f78bc06ae70 0x7f78bc0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 -- 172.21.15.78:0/999487377 >> v2:172.21.15.187:3300/0 conn(0x7f78bc06ae70 msgr2=0x7f78bc0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 --2- 172.21.15.78:0/999487377 >> v2:172.21.15.187:3300/0 conn(0x7f78bc06ae70 0x7f78bc0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 -- 172.21.15.78:0/999487377 >> v1:172.21.15.78:6789/0 conn(0x7f78bc0b2db0 legacy=0x7f78bc06a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 -- 172.21.15.78:0/999487377 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0cc6b0 con 0x7f78bc158a70 2023-06-09T11:12:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c1aca700 1 --2- 172.21.15.78:0/999487377 >> v2:172.21.15.187:3300/0 conn(0x7f78bc06ae70 0x7f78bc0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:35.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c12c9700 1 --2- 172.21.15.78:0/999487377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc0b2870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0b4120 tx=0x7f78b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9c53efd824746d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78b3fff700 1 -- 172.21.15.78:0/999487377 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800f8a0 con 0x7f78bc158a70 2023-06-09T11:12:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78b3fff700 1 -- 172.21.15.78:0/999487377 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800fa00 con 0x7f78bc158a70 2023-06-09T11:12:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78b3fff700 1 -- 172.21.15.78:0/999487377 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800fd90 con 0x7f78bc158a70 2023-06-09T11:12:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 -- 172.21.15.78:0/999487377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 msgr2=0x7f78bc0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 --2- 172.21.15.78:0/999487377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc0b2870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0b4120 tx=0x7f78b8009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 -- 172.21.15.78:0/999487377 shutdown_connections 2023-06-09T11:12:35.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 --2- 172.21.15.78:0/999487377 >> v2:172.21.15.187:3300/0 conn(0x7f78bc06ae70 0x7f78bc0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 --2- 172.21.15.78:0/999487377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc0b2870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.608+0000 7f78c22cb700 1 -- 172.21.15.78:0/999487377 >> 172.21.15.78:0/999487377 conn(0x7f78bc0b0780 msgr2=0x7f78bc0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:35.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.612+0000 7f78c22cb700 1 -- 172.21.15.78:0/999487377 shutdown_connections 2023-06-09T11:12:35.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.612+0000 7f78c22cb700 1 -- 172.21.15.78:0/999487377 wait complete. 2023-06-09T11:12:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.612+0000 7f78c22cb700 1 Processor -- start 2023-06-09T11:12:35.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.612+0000 7f78c22cb700 1 -- start start 2023-06-09T11:12:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc06ae70 0x7f78bc14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc0b2db0 0x7f78bc14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc151710 con 0x7f78bc158a70 2023-06-09T11:12:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1519f0 con 0x7f78bc0b2db0 2023-06-09T11:12:35.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc151cd0 con 0x7f78bc06ae70 2023-06-09T11:12:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54400/0 (socket says 172.21.15.78:54400) 2023-06-09T11:12:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 -- 172.21.15.78:0/3806089039 learned_addr learned my addr 172.21.15.78:0/3806089039 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c12c9700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc06ae70 0x7f78bc14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c0ac8700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc0b2db0 0x7f78bc14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 -- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc06ae70 msgr2=0x7f78bc14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc06ae70 0x7f78bc14a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 -- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc0b2db0 msgr2=0x7f78bc14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc0b2db0 0x7f78bc14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 -- 172.21.15.78:0/3806089039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009570 con 0x7f78bc158a70 2023-06-09T11:12:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c0ac8700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc0b2db0 0x7f78bc14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c1aca700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc150840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007ef0 tx=0x7f78b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78b1ffb700 1 -- 172.21.15.78:0/3806089039 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b400de90 con 0x7f78bc158a70 2023-06-09T11:12:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78b1ffb700 1 -- 172.21.15.78:0/3806089039 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b400f040 con 0x7f78bc158a70 2023-06-09T11:12:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78b1ffb700 1 -- 172.21.15.78:0/3806089039 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4015640 con 0x7f78bc158a70 2023-06-09T11:12:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc158fd0 con 0x7f78bc158a70 2023-06-09T11:12:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.616+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc158e40 con 0x7f78bc158a70 2023-06-09T11:12:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.620+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0b3330 con 0x7f78bc158a70 2023-06-09T11:12:35.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.620+0000 7f78b1ffb700 1 -- 172.21.15.78:0/3806089039 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78b401e3b0 con 0x7f78bc158a70 2023-06-09T11:12:35.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.620+0000 7f78b1ffb700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f78a00662f0 0x7f78a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:35.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.620+0000 7f78b1ffb700 1 -- 172.21.15.78:0/3806089039 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78b4083e50 con 0x7f78bc158a70 2023-06-09T11:12:35.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.620+0000 7f78c12c9700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f78a00662f0 0x7f78a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.624+0000 7f78c12c9700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f78a00662f0 0x7f78a00687a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78b8000c00 tx=0x7f78b801b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:35.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.628+0000 7f78b1ffb700 1 -- 172.21.15.78:0/3806089039 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f78b40512c0 con 0x7f78bc158a70 2023-06-09T11:12:35.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.800+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78bc14b9e0 con 0x7f78bc158a70 2023-06-09T11:12:35.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.800+0000 7f78b1ffb700 1 -- 172.21.15.78:0/3806089039 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78b401a020 con 0x7f78bc158a70 2023-06-09T11:12:35.807 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f78a00662f0 msgr2=0x7f78a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f78a00662f0 0x7f78a00687a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78b8000c00 tx=0x7f78b801b040 comp rx=0 tx=0).stop 2023-06-09T11:12:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 msgr2=0x7f78bc150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc150840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78b4007ef0 tx=0x7f78b400d3b0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 shutdown_connections 2023-06-09T11:12:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f78a00662f0 0x7f78a00687a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78bc158a70 0x7f78bc150840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc0b2db0 0x7f78bc14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 --2- 172.21.15.78:0/3806089039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc06ae70 0x7f78bc14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 >> 172.21.15.78:0/3806089039 conn(0x7f78bc0b0780 msgr2=0x7f78bc0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 shutdown_connections 2023-06-09T11:12:35.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.804+0000 7f78c22cb700 1 -- 172.21.15.78:0/3806089039 wait complete. 2023-06-09T11:12:35.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:36.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde966bc700 1 Processor -- start 2023-06-09T11:12:36.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde966bc700 1 -- start start 2023-06-09T11:12:36.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde966bc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde90160f30 0x7fde900c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde966bc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fde900c2120 0x7fde9006fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde966bc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde900cd470 con 0x7fde90160b60 2023-06-09T11:12:36.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde966bc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900cb070 con 0x7fde90160f30 2023-06-09T11:12:36.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde966bc700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900c25a0 con 0x7fde900c2120 2023-06-09T11:12:36.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde8f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde90160f30 0x7fde900c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde8f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde90160f30 0x7fde900c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54402/0 (socket says 172.21.15.78:54402) 2023-06-09T11:12:36.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde8f7fe700 1 -- 172.21.15.78:0/3724411645 learned_addr learned my addr 172.21.15.78:0/3724411645 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:36.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde8ffff700 1 --1- 172.21.15.78:0/3724411645 >> v1:172.21.15.78:6789/0 conn(0x7fde90160b60 0x7fde9006ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48344/0 (socket says 172.21.15.78:48344) 2023-06-09T11:12:36.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:35.996+0000 7fde94c59700 1 --2- 172.21.15.78:0/3724411645 >> v2:172.21.15.187:3300/0 conn(0x7fde900c2120 0x7fde9006fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8f7fe700 1 -- 172.21.15.78:0/3724411645 >> v2:172.21.15.187:3300/0 conn(0x7fde900c2120 msgr2=0x7fde9006fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:36.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8f7fe700 1 --2- 172.21.15.78:0/3724411645 >> v2:172.21.15.187:3300/0 conn(0x7fde900c2120 0x7fde9006fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8f7fe700 1 -- 172.21.15.78:0/3724411645 >> v1:172.21.15.78:6789/0 conn(0x7fde90160b60 legacy=0x7fde9006ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8f7fe700 1 -- 172.21.15.78:0/3724411645 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde900ccbd0 con 0x7fde90160f30 2023-06-09T11:12:36.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8effd700 1 -- 172.21.15.78:0/3724411645 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957670022 0 0) 0x7fde900cd470 con 0x7fde90160b60 2023-06-09T11:12:36.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8f7fe700 1 --2- 172.21.15.78:0/3724411645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde900c1be0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde84009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982beefa7800b23 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8effd700 1 -- 172.21.15.78:0/3724411645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400ba20 con 0x7fde90160f30 2023-06-09T11:12:36.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8effd700 1 -- 172.21.15.78:0/3724411645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400bb80 con 0x7fde90160f30 2023-06-09T11:12:36.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde8effd700 1 -- 172.21.15.78:0/3724411645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84009e60 con 0x7fde90160f30 2023-06-09T11:12:36.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 -- 172.21.15.78:0/3724411645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 msgr2=0x7fde900c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 --2- 172.21.15.78:0/3724411645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde900c1be0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde84009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 -- 172.21.15.78:0/3724411645 shutdown_connections 2023-06-09T11:12:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 --2- 172.21.15.78:0/3724411645 >> v2:172.21.15.187:3300/0 conn(0x7fde900c2120 0x7fde9006fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 --2- 172.21.15.78:0/3724411645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde900c1be0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 -- 172.21.15.78:0/3724411645 >> 172.21.15.78:0/3724411645 conn(0x7fde900cf8b0 msgr2=0x7fde900cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 -- 172.21.15.78:0/3724411645 shutdown_connections 2023-06-09T11:12:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 -- 172.21.15.78:0/3724411645 wait complete. 2023-06-09T11:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.000+0000 7fde966bc700 1 Processor -- start 2023-06-09T11:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 -- start start 2023-06-09T11:12:36.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde900c2120 0x7fde90156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde90160b60 0x7fde9015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde9015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde901f9ef0 con 0x7fde90160f30 2023-06-09T11:12:36.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90157610 con 0x7fde900c2120 2023-06-09T11:12:36.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde901f95e0 con 0x7fde90160b60 2023-06-09T11:12:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde9015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde9015e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54410/0 (socket says 172.21.15.78:54410) 2023-06-09T11:12:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 -- 172.21.15.78:0/2018408822 learned_addr learned my addr 172.21.15.78:0/2018408822 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde8ffff700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde900c2120 0x7fde90156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 -- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde90160b60 msgr2=0x7fde9015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde90160b60 0x7fde9015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 -- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde900c2120 msgr2=0x7fde90156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde900c2120 0x7fde90156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 -- 172.21.15.78:0/2018408822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009570 con 0x7fde90160f30 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde8ffff700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde900c2120 0x7fde90156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde94c59700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde9015e5b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde8800d830 tx=0x7fde8800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde8cff9700 1 -- 172.21.15.78:0/2018408822 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880125f0 con 0x7fde90160f30 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde8cff9700 1 -- 172.21.15.78:0/2018408822 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88012770 con 0x7fde90160f30 2023-06-09T11:12:36.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde8cff9700 1 -- 172.21.15.78:0/2018408822 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88012b20 con 0x7fde90160f30 2023-06-09T11:12:36.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde900cd190 con 0x7fde90160f30 2023-06-09T11:12:36.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.004+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde900cceb0 con 0x7fde90160f30 2023-06-09T11:12:36.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.008+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9006f9b0 con 0x7fde90160f30 2023-06-09T11:12:36.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.008+0000 7fde8cff9700 1 -- 172.21.15.78:0/2018408822 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde88012c80 con 0x7fde90160f30 2023-06-09T11:12:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.012+0000 7fde8cff9700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fde7c0662f0 0x7fde7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.012+0000 7fde8cff9700 1 -- 172.21.15.78:0/2018408822 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde88084120 con 0x7fde90160f30 2023-06-09T11:12:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.012+0000 7fde8ffff700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fde7c0662f0 0x7fde7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.012+0000 7fde8ffff700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fde7c0662f0 0x7fde7c0687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde800012e0 tx=0x7fde80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.012+0000 7fde8cff9700 1 -- 172.21.15.78:0/2018408822 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fde880515b0 con 0x7fde90160f30 2023-06-09T11:12:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.184+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde9006a210 con 0x7fde90160f30 2023-06-09T11:12:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.184+0000 7fde8cff9700 1 -- 172.21.15.78:0/2018408822 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde88054bd0 con 0x7fde90160f30 2023-06-09T11:12:36.192 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fde7c0662f0 msgr2=0x7fde7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fde7c0662f0 0x7fde7c0687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde800012e0 tx=0x7fde80009040 comp rx=0 tx=0).stop 2023-06-09T11:12:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 msgr2=0x7fde9015e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde9015e5b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde8800d830 tx=0x7fde8800dbf0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 shutdown_connections 2023-06-09T11:12:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fde7c0662f0 0x7fde7c0687a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde90160f30 0x7fde9015e5b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde90160b60 0x7fde9015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 --2- 172.21.15.78:0/2018408822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde900c2120 0x7fde90156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 >> 172.21.15.78:0/2018408822 conn(0x7fde900cf8b0 msgr2=0x7fde901600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 shutdown_connections 2023-06-09T11:12:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.188+0000 7fde966bc700 1 -- 172.21.15.78:0/2018408822 wait complete. 2023-06-09T11:12:36.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:36.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f24a0346700 1 Processor -- start 2023-06-09T11:12:36.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f24a0346700 1 -- start start 2023-06-09T11:12:36.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f24a0346700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249806dfe0 0x7f249815a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f24a0346700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f249806e8f0 0x7f249806f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f24a0346700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2498071160 con 0x7f249815a4b0 2023-06-09T11:12:36.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f24a0346700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2498069ed0 con 0x7f249806e8f0 2023-06-09T11:12:36.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f24a0346700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24980b47a0 con 0x7f249806dfe0 2023-06-09T11:12:36.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f249e0e2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f249815a4b0 0x7f249806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48354/0 (socket says 172.21.15.78:48354) 2023-06-09T11:12:36.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f249e0e2700 1 -- 172.21.15.78:0/948831427 learned_addr learned my addr 172.21.15.78:0/948831427 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:36.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f249e8e3700 1 --2- 172.21.15.78:0/948831427 >> v2:172.21.15.78:3300/0 conn(0x7f249806e8f0 0x7f249806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f249d8e1700 1 --2- 172.21.15.78:0/948831427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249806dfe0 0x7f249815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f249d0e0700 1 -- 172.21.15.78:0/948831427 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511595220 0 0) 0x7f2498071160 con 0x7f249815a4b0 2023-06-09T11:12:36.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.380+0000 7f249d0e0700 1 -- 172.21.15.78:0/948831427 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24840035d0 con 0x7f249815a4b0 2023-06-09T11:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249e8e3700 1 -- 172.21.15.78:0/948831427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249806dfe0 msgr2=0x7f249815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249e8e3700 1 --2- 172.21.15.78:0/948831427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249806dfe0 0x7f249815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249e8e3700 1 -- 172.21.15.78:0/948831427 >> v1:172.21.15.78:6789/0 conn(0x7f249815a4b0 legacy=0x7f249806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249d0e0700 1 -- 172.21.15.78:0/948831427 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978355064 0 0) 0x7f24840035d0 con 0x7f249815a4b0 2023-06-09T11:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249e8e3700 1 -- 172.21.15.78:0/948831427 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249806a0e0 con 0x7f249806e8f0 2023-06-09T11:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249e8e3700 1 --2- 172.21.15.78:0/948831427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f249806f880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2490009850 tx=0x7f2490009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675e5e66ab976f67 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249d0e0700 1 -- 172.21.15.78:0/948831427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940019f0 con 0x7f249806e8f0 2023-06-09T11:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249d0e0700 1 -- 172.21.15.78:0/948831427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2490004030 con 0x7f249806e8f0 2023-06-09T11:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f249d0e0700 1 -- 172.21.15.78:0/948831427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900043a0 con 0x7f249806e8f0 2023-06-09T11:12:36.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 -- 172.21.15.78:0/948831427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 msgr2=0x7f249806f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 --2- 172.21.15.78:0/948831427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f249806f880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2490009850 tx=0x7f2490009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:36.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 -- 172.21.15.78:0/948831427 shutdown_connections 2023-06-09T11:12:36.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 --2- 172.21.15.78:0/948831427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f249806f880 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 --2- 172.21.15.78:0/948831427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249806dfe0 0x7f249815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 -- 172.21.15.78:0/948831427 >> 172.21.15.78:0/948831427 conn(0x7f24980b1480 msgr2=0x7f24980cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:36.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 -- 172.21.15.78:0/948831427 shutdown_connections 2023-06-09T11:12:36.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.384+0000 7f24a0346700 1 -- 172.21.15.78:0/948831427 wait complete. 2023-06-09T11:12:36.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 Processor -- start 2023-06-09T11:12:36.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 -- start start 2023-06-09T11:12:36.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249806dfe0 0x7f24980ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f24981f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249815a4b0 0x7f24981f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980ad7f0 con 0x7f249806e8f0 2023-06-09T11:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2498155910 con 0x7f249806dfe0 2023-06-09T11:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f24a0346700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c42e0 con 0x7f249815a4b0 2023-06-09T11:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f249d8e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f24981f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f249d8e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f24981f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54416/0 (socket says 172.21.15.78:54416) 2023-06-09T11:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f249d8e1700 1 -- 172.21.15.78:0/1279680153 learned_addr learned my addr 172.21.15.78:0/1279680153 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.388+0000 7f249e0e2700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249806dfe0 0x7f24980ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f249e8e3700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249815a4b0 0x7f24981f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f249d8e1700 1 -- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249815a4b0 msgr2=0x7f24981f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f249d8e1700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249815a4b0 0x7f24981f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f249d8e1700 1 -- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249806dfe0 msgr2=0x7f24980ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f249d8e1700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249806dfe0 0x7f24980ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f249d8e1700 1 -- 172.21.15.78:0/1279680153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900094b0 con 0x7f249806e8f0 2023-06-09T11:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f249d8e1700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f24981f5820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f248800e9a0 tx=0x7f248800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f248effd700 1 -- 172.21.15.78:0/1279680153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488009720 con 0x7f249806e8f0 2023-06-09T11:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f248effd700 1 -- 172.21.15.78:0/1279680153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248800c850 con 0x7f249806e8f0 2023-06-09T11:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249806a6a0 con 0x7f249806e8f0 2023-06-09T11:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f248effd700 1 -- 172.21.15.78:0/1279680153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800cc00 con 0x7f249806e8f0 2023-06-09T11:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249806a3c0 con 0x7f249806e8f0 2023-06-09T11:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.392+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249806abc0 con 0x7f249806e8f0 2023-06-09T11:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.396+0000 7f248effd700 1 -- 172.21.15.78:0/1279680153 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2488013470 con 0x7f249806e8f0 2023-06-09T11:12:36.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.396+0000 7f248effd700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f247c0662f0 0x7f247c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.396+0000 7f248effd700 1 -- 172.21.15.78:0/1279680153 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2488083e10 con 0x7f249806e8f0 2023-06-09T11:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.396+0000 7f249e0e2700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f247c0662f0 0x7f247c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.400+0000 7f249e0e2700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f247c0662f0 0x7f247c0687a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2494001560 tx=0x7f2494002120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.404+0000 7f248effd700 1 -- 172.21.15.78:0/1279680153 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2488087030 con 0x7f249806e8f0 2023-06-09T11:12:36.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.576+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24980741c0 con 0x7f249806e8f0 2023-06-09T11:12:36.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.576+0000 7f248effd700 1 -- 172.21.15.78:0/1279680153 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f2488017090 con 0x7f249806e8f0 2023-06-09T11:12:36.586 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:36.586 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:36.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f247c0662f0 msgr2=0x7f247c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f247c0662f0 0x7f247c0687a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2494001560 tx=0x7f2494002120 comp rx=0 tx=0).stop 2023-06-09T11:12:36.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 msgr2=0x7f24981f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f24981f5820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f248800e9a0 tx=0x7f248800ecb0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 shutdown_connections 2023-06-09T11:12:36.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f247c0662f0 0x7f247c0687a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249815a4b0 0x7f24981f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f249806e8f0 0x7f24981f5820 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 --2- 172.21.15.78:0/1279680153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249806dfe0 0x7f24980ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 >> 172.21.15.78:0/1279680153 conn(0x7f24980b1480 msgr2=0x7f24980afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:36.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 shutdown_connections 2023-06-09T11:12:36.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.580+0000 7f24a0346700 1 -- 172.21.15.78:0/1279680153 wait complete. 2023-06-09T11:12:36.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:36.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:36.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe8128ee700 1 Processor -- start 2023-06-09T11:12:36.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe8128ee700 1 -- start start 2023-06-09T11:12:36.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe8128ee700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe80c0c9980 0x7fe80c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe8128ee700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0705f0 con 0x7fe80c0cbdb0 2023-06-09T11:12:36.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe8128ee700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c071190 con 0x7fe80c15a7c0 2023-06-09T11:12:36.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe8128ee700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c06fa20 con 0x7fe80c0c9980 2023-06-09T11:12:36.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe810e8b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe80c0c9980 0x7fe80c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe810e8b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe80c0c9980 0x7fe80c0b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54430/0 (socket says 172.21.15.78:54430) 2023-06-09T11:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.784+0000 7fe810e8b700 1 -- 172.21.15.78:0/3038938130 learned_addr learned my addr 172.21.15.78:0/3038938130 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe810e8b700 1 -- 172.21.15.78:0/3038938130 >> v1:172.21.15.187:6789/0 conn(0x7fe80c15a7c0 legacy=0x7fe80c070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe810e8b700 1 -- 172.21.15.78:0/3038938130 >> v1:172.21.15.78:6789/0 conn(0x7fe80c0cbdb0 legacy=0x7fe80c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe810e8b700 1 -- 172.21.15.78:0/3038938130 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c15ab90 con 0x7fe80c0c9980 2023-06-09T11:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe810e8b700 1 --2- 172.21.15.78:0/3038938130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c0b1af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe804009910 tx=0x7fe804009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1029351fc2596c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe80b7fe700 1 -- 172.21.15.78:0/3038938130 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400ba60 con 0x7fe80c0c9980 2023-06-09T11:12:36.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe80b7fe700 1 -- 172.21.15.78:0/3038938130 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400bbc0 con 0x7fe80c0c9980 2023-06-09T11:12:36.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe80b7fe700 1 -- 172.21.15.78:0/3038938130 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804009e60 con 0x7fe80c0c9980 2023-06-09T11:12:36.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe8128ee700 1 -- 172.21.15.78:0/3038938130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 msgr2=0x7fe80c0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe8128ee700 1 --2- 172.21.15.78:0/3038938130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c0b1af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe804009910 tx=0x7fe804009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:36.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe8128ee700 1 -- 172.21.15.78:0/3038938130 shutdown_connections 2023-06-09T11:12:36.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe8128ee700 1 --2- 172.21.15.78:0/3038938130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c0b1af0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe8128ee700 1 -- 172.21.15.78:0/3038938130 >> 172.21.15.78:0/3038938130 conn(0x7fe80c0cf8b0 msgr2=0x7fe80c0cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:36.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe8128ee700 1 -- 172.21.15.78:0/3038938130 shutdown_connections 2023-06-09T11:12:36.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.788+0000 7fe8128ee700 1 -- 172.21.15.78:0/3038938130 wait complete. 2023-06-09T11:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.792+0000 7fe8128ee700 1 Processor -- start 2023-06-09T11:12:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.792+0000 7fe8128ee700 1 -- start start 2023-06-09T11:12:36.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe80c0cbdb0 0x7fe80c0c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe80c15a7c0 0x7fe80c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c1527d0 con 0x7fe80c0c9980 2023-06-09T11:12:36.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c151bc0 con 0x7fe80c0cbdb0 2023-06-09T11:12:36.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c151ea0 con 0x7fe80c15a7c0 2023-06-09T11:12:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54436/0 (socket says 172.21.15.78:54436) 2023-06-09T11:12:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 -- 172.21.15.78:0/678153519 learned_addr learned my addr 172.21.15.78:0/678153519 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe810e8b700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe80c15a7c0 0x7fe80c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8037fe700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe80c0cbdb0 0x7fe80c0c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 -- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe80c15a7c0 msgr2=0x7fe80c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe80c15a7c0 0x7fe80c0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 -- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe80c0cbdb0 msgr2=0x7fe80c0c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe80c0cbdb0 0x7fe80c0c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 -- 172.21.15.78:0/678153519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009570 con 0x7fe80c0c9980 2023-06-09T11:12:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe80bfff700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c150920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00cbd0 tx=0x7fe7fc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8097fa700 1 -- 172.21.15.78:0/678153519 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc003c20 con 0x7fe80c0c9980 2023-06-09T11:12:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8097fa700 1 -- 172.21.15.78:0/678153519 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc003d80 con 0x7fe80c0c9980 2023-06-09T11:12:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8097fa700 1 -- 172.21.15.78:0/678153519 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00aae0 con 0x7fe80c0c9980 2023-06-09T11:12:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c06ffa0 con 0x7fe80c0c9980 2023-06-09T11:12:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.796+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c06fcc0 con 0x7fe80c0c9980 2023-06-09T11:12:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.800+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c070280 con 0x7fe80c0c9980 2023-06-09T11:12:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.800+0000 7fe8097fa700 1 -- 172.21.15.78:0/678153519 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7fc00ac40 con 0x7fe80c0c9980 2023-06-09T11:12:36.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.804+0000 7fe8097fa700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7ec0662f0 0x7fe7ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.804+0000 7fe8097fa700 1 -- 172.21.15.78:0/678153519 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7fc083c20 con 0x7fe80c0c9980 2023-06-09T11:12:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.804+0000 7fe8037fe700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7ec0662f0 0x7fe7ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.804+0000 7fe8037fe700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7ec0662f0 0x7fe7ec0687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0cac10 tx=0x7fe7f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.812+0000 7fe8097fa700 1 -- 172.21.15.78:0/678153519 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe7fc051130 con 0x7fe80c0c9980 2023-06-09T11:12:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.980+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe80c0741c0 con 0x7fe80c0c9980 2023-06-09T11:12:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8097fa700 1 -- 172.21.15.78:0/678153519 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7fc054750 con 0x7fe80c0c9980 2023-06-09T11:12:36.990 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7ec0662f0 msgr2=0x7fe7ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7ec0662f0 0x7fe7ec0687a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0cac10 tx=0x7fe7f4009040 comp rx=0 tx=0).stop 2023-06-09T11:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 msgr2=0x7fe80c150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c150920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00cbd0 tx=0x7fe7fc00cee0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 shutdown_connections 2023-06-09T11:12:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7ec0662f0 0x7fe7ec0687a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe80c15a7c0 0x7fe80c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe80c0cbdb0 0x7fe80c0c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 --2- 172.21.15.78:0/678153519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe80c0c9980 0x7fe80c150920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 >> 172.21.15.78:0/678153519 conn(0x7fe80c0cf8b0 msgr2=0x7fe80c0b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 shutdown_connections 2023-06-09T11:12:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:36.984+0000 7fe8128ee700 1 -- 172.21.15.78:0/678153519 wait complete. 2023-06-09T11:12:37.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.176+0000 7f231f59e700 1 Processor -- start 2023-06-09T11:12:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.176+0000 7f231f59e700 1 -- start start 2023-06-09T11:12:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.176+0000 7f231f59e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f23200b2110 0x7f2320069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.176+0000 7f231f59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232006a850 con 0x7f232015c780 2023-06-09T11:12:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.176+0000 7f231f59e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2320070a70 con 0x7f232006a410 2023-06-09T11:12:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.176+0000 7f231f59e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200c80d0 con 0x7f23200b2110 2023-06-09T11:12:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f232015c780 0x7f2320070290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48374/0 (socket says 172.21.15.78:48374) 2023-06-09T11:12:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 -- 172.21.15.78:0/112338738 learned_addr learned my addr 172.21.15.78:0/112338738 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f2317fff700 1 --2- 172.21.15.78:0/112338738 >> v2:172.21.15.187:3300/0 conn(0x7f23200b2110 0x7f2320069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675648399 0 0) 0x7f232006a850 con 0x7f232015c780 2023-06-09T11:12:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f230c0035d0 con 0x7f232015c780 2023-06-09T11:12:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609735357 0 0) 0x7f230c0035d0 con 0x7f232015c780 2023-06-09T11:12:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 >> v2:172.21.15.187:3300/0 conn(0x7f23200b2110 msgr2=0x7f2320069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 --2- 172.21.15.78:0/112338738 >> v2:172.21.15.187:3300/0 conn(0x7f23200b2110 0x7f2320069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 >> v1:172.21.15.187:6789/0 conn(0x7f232006a410 legacy=0x7f23200c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320070d50 con 0x7f232015c780 2023-06-09T11:12:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f2310001670 con 0x7f232015c780 2023-06-09T11:12:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 >> v1:172.21.15.78:6789/0 conn(0x7f232015c780 legacy=0x7f2320070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c003a20 0x7f230c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c004870 0x7f230c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230c005220 0x7f230c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200c80d0 con 0x7f230c003a20 2023-06-09T11:12:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c00c130 con 0x7f230c004870 2023-06-09T11:12:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c00c2f0 con 0x7f230c005220 2023-06-09T11:12:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c003a20 0x7f230c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f2317fff700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c004870 0x7f230c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231ed9d700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230c005220 0x7f230c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 -- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230c005220 msgr2=0x7f230c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:37.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230c005220 0x7f230c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 -- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c004870 msgr2=0x7f230c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c004870 0x7f230c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 -- 172.21.15.78:0/112338738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0035d0 con 0x7f230c003a20 2023-06-09T11:12:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231ed9d700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f230c005220 0x7f230c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231ed9d700 1 -- 172.21.15.78:0/112338738 reap_dead start 2023-06-09T11:12:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231e59c700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c003a20 0x7f230c003e30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f231000c320 tx=0x7f230c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2a7e26ccd71de7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.180+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310007c30 con 0x7f230c003a20 2023-06-09T11:12:37.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000ce80 con 0x7f230c003a20 2023-06-09T11:12:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231dd9b700 1 -- 172.21.15.78:0/112338738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310005bc0 con 0x7f230c003a20 2023-06-09T11:12:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231f59e700 1 -- 172.21.15.78:0/112338738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c003a20 msgr2=0x7f230c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231f59e700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c003a20 0x7f230c003e30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f231000c320 tx=0x7f230c0058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231f59e700 1 -- 172.21.15.78:0/112338738 shutdown_connections 2023-06-09T11:12:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231f59e700 1 --2- 172.21.15.78:0/112338738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f230c003a20 0x7f230c003e30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231f59e700 1 -- 172.21.15.78:0/112338738 >> 172.21.15.78:0/112338738 conn(0x7f23200d3aa0 msgr2=0x7f23200cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:37.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231f59e700 1 -- 172.21.15.78:0/112338738 shutdown_connections 2023-06-09T11:12:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.184+0000 7f231f59e700 1 -- 172.21.15.78:0/112338738 wait complete. 2023-06-09T11:12:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 Processor -- start 2023-06-09T11:12:37.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 -- start start 2023-06-09T11:12:37.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c003a20 0x7f23201f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2320160700 0x7f23201f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23200b80a0 0x7f23200d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23201f9cf0 con 0x7f2320160700 2023-06-09T11:12:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200c9ee0 con 0x7f230c003a20 2023-06-09T11:12:37.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23201f6e70 con 0x7f23200b80a0 2023-06-09T11:12:37.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2320160700 0x7f23201f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2320160700 0x7f23201f6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54454/0 (socket says 172.21.15.78:54454) 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 -- 172.21.15.78:0/1649664926 learned_addr learned my addr 172.21.15.78:0/1649664926 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231e59c700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c003a20 0x7f23201f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231ed9d700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23200b80a0 0x7f23200d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 -- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23200b80a0 msgr2=0x7f23200d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23200b80a0 0x7f23200d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 -- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c003a20 msgr2=0x7f23201f97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c003a20 0x7f23201f97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 -- 172.21.15.78:0/1649664926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200c82e0 con 0x7f2320160700 2023-06-09T11:12:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231ed9d700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23200b80a0 0x7f23200d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2317fff700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2320160700 0x7f23201f6930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2308011ad0 tx=0x7f2308011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2316ffd700 1 -- 172.21.15.78:0/1649664926 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800fa60 con 0x7f2320160700 2023-06-09T11:12:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2316ffd700 1 -- 172.21.15.78:0/1649664926 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800fbc0 con 0x7f2320160700 2023-06-09T11:12:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320071030 con 0x7f2320160700 2023-06-09T11:12:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f2316ffd700 1 -- 172.21.15.78:0/1649664926 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308014440 con 0x7f2320160700 2023-06-09T11:12:37.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.188+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320069ed0 con 0x7f2320160700 2023-06-09T11:12:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.192+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2320067610 con 0x7f2320160700 2023-06-09T11:12:37.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.192+0000 7f2316ffd700 1 -- 172.21.15.78:0/1649664926 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23080145a0 con 0x7f2320160700 2023-06-09T11:12:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.196+0000 7f2316ffd700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23000662f0 0x7f23000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.196+0000 7f2316ffd700 1 -- 172.21.15.78:0/1649664926 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2308084540 con 0x7f2320160700 2023-06-09T11:12:37.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.196+0000 7f231e59c700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23000662f0 0x7f23000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.196+0000 7f231e59c700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23000662f0 0x7f23000687a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2310000c00 tx=0x7f2310007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:37.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.200+0000 7f2316ffd700 1 -- 172.21.15.78:0/1649664926 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2308051890 con 0x7f2320160700 2023-06-09T11:12:37.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.372+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2320070740 con 0x7f2320160700 2023-06-09T11:12:37.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.372+0000 7f2316ffd700 1 -- 172.21.15.78:0/1649664926 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23080220a0 con 0x7f2320160700 2023-06-09T11:12:37.381 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:37.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23000662f0 msgr2=0x7f23000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23000662f0 0x7f23000687a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2310000c00 tx=0x7f2310007000 comp rx=0 tx=0).stop 2023-06-09T11:12:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2320160700 msgr2=0x7f23201f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2320160700 0x7f23201f6930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2308011ad0 tx=0x7f2308011e90 comp rx=0 tx=0).stop 2023-06-09T11:12:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 shutdown_connections 2023-06-09T11:12:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23000662f0 0x7f23000687a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23200b80a0 0x7f23200d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2320160700 0x7f23201f6930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 --2- 172.21.15.78:0/1649664926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f230c003a20 0x7f23201f97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 >> 172.21.15.78:0/1649664926 conn(0x7f23200d3aa0 msgr2=0x7f232006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 shutdown_connections 2023-06-09T11:12:37.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.376+0000 7f231f59e700 1 -- 172.21.15.78:0/1649664926 wait complete. 2023-06-09T11:12:37.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.576+0000 7f00d5a74700 1 Processor -- start 2023-06-09T11:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.576+0000 7f00d5a74700 1 -- start start 2023-06-09T11:12:37.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.576+0000 7f00d5a74700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f00d015c9f0 0x7f00d0160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.576+0000 7f00d5a74700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00d00d1380 0x7f00d00cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.576+0000 7f00d5a74700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d00cda60 con 0x7f00d006d790 2023-06-09T11:12:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.576+0000 7f00d5a74700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d0160d70 con 0x7f00d00d1380 2023-06-09T11:12:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.576+0000 7f00d5a74700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d0161050 con 0x7f00d015c9f0 2023-06-09T11:12:37.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00d00d1380 0x7f00d00cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f00d00d1380 0x7f00d00cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54466/0 (socket says 172.21.15.78:54466) 2023-06-09T11:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 -- 172.21.15.78:0/415632259 learned_addr learned my addr 172.21.15.78:0/415632259 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cf7fe700 1 --2- 172.21.15.78:0/415632259 >> v2:172.21.15.187:3300/0 conn(0x7f00d015c9f0 0x7f00d0160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 -- 172.21.15.78:0/415632259 >> v2:172.21.15.187:3300/0 conn(0x7f00d015c9f0 msgr2=0x7f00d0160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 --2- 172.21.15.78:0/415632259 >> v2:172.21.15.187:3300/0 conn(0x7f00d015c9f0 0x7f00d0160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 -- 172.21.15.78:0/415632259 >> v1:172.21.15.187:6789/0 conn(0x7f00d006d790 legacy=0x7f00d00d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 -- 172.21.15.78:0/415632259 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d0161330 con 0x7f00d00d1380 2023-06-09T11:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00cffff700 1 --2- 172.21.15.78:0/415632259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d00d1380 0x7f00d00cdef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00d006c320 tx=0x7f00c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b0956b01824003 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:37.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00ce7fc700 1 -- 172.21.15.78:0/415632259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800e070 con 0x7f00d00d1380 2023-06-09T11:12:37.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00ce7fc700 1 -- 172.21.15.78:0/415632259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c800b910 con 0x7f00d00d1380 2023-06-09T11:12:37.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00ce7fc700 1 -- 172.21.15.78:0/415632259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800bcc0 con 0x7f00d00d1380 2023-06-09T11:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 -- 172.21.15.78:0/415632259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d00d1380 msgr2=0x7f00d00cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 --2- 172.21.15.78:0/415632259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d00d1380 0x7f00d00cdef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00d006c320 tx=0x7f00c800b330 comp rx=0 tx=0).stop 2023-06-09T11:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 -- 172.21.15.78:0/415632259 shutdown_connections 2023-06-09T11:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 --2- 172.21.15.78:0/415632259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d00d1380 0x7f00d00cdef0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 --2- 172.21.15.78:0/415632259 >> v2:172.21.15.187:3300/0 conn(0x7f00d015c9f0 0x7f00d0160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 -- 172.21.15.78:0/415632259 >> 172.21.15.78:0/415632259 conn(0x7f00d00b4c90 msgr2=0x7f00d00b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 -- 172.21.15.78:0/415632259 shutdown_connections 2023-06-09T11:12:37.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.580+0000 7f00d5a74700 1 -- 172.21.15.78:0/415632259 wait complete. 2023-06-09T11:12:37.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 Processor -- start 2023-06-09T11:12:37.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 -- start start 2023-06-09T11:12:37.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d006d790 0x7f00d00b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00d00d1380 0x7f00d01f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00d015c9f0 0x7f00d00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d015fe70 con 0x7f00d006d790 2023-06-09T11:12:37.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d015f660 con 0x7f00d00d1380 2023-06-09T11:12:37.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.584+0000 7f00d5a74700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00b8cf0 con 0x7f00d015c9f0 2023-06-09T11:12:37.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d006d790 0x7f00d00b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d006d790 0x7f00d00b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54482/0 (socket says 172.21.15.78:54482) 2023-06-09T11:12:37.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 -- 172.21.15.78:0/3050052294 learned_addr learned my addr 172.21.15.78:0/3050052294 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:37.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00ceffd700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00d00d1380 0x7f00d01f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cffff700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00d015c9f0 0x7f00d00ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 -- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00d015c9f0 msgr2=0x7f00d00ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00d015c9f0 0x7f00d00ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 -- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00d00d1380 msgr2=0x7f00d01f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00d00d1380 0x7f00d01f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 -- 172.21.15.78:0/3050052294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8009b30 con 0x7f00d006d790 2023-06-09T11:12:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00cf7fe700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d006d790 0x7f00d00b87b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00c000e840 tx=0x7f00c000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00b7fff700 1 -- 172.21.15.78:0/3050052294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00095a0 con 0x7f00d006d790 2023-06-09T11:12:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00b7fff700 1 -- 172.21.15.78:0/3050052294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c000c690 con 0x7f00d006d790 2023-06-09T11:12:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d015cdc0 con 0x7f00d006d790 2023-06-09T11:12:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00b7fff700 1 -- 172.21.15.78:0/3050052294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000ca00 con 0x7f00d006d790 2023-06-09T11:12:37.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.588+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d00cd6f0 con 0x7f00d006d790 2023-06-09T11:12:37.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.592+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d0160a60 con 0x7f00d006d790 2023-06-09T11:12:37.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.592+0000 7f00b7fff700 1 -- 172.21.15.78:0/3050052294 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00c000cb60 con 0x7f00d006d790 2023-06-09T11:12:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.592+0000 7f00b7fff700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f00bc0662f0 0x7f00bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.592+0000 7f00b7fff700 1 -- 172.21.15.78:0/3050052294 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00c0083ce0 con 0x7f00d006d790 2023-06-09T11:12:37.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.596+0000 7f00ceffd700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f00bc0662f0 0x7f00bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.596+0000 7f00ceffd700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f00bc0662f0 0x7f00bc0687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00d006e510 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.600+0000 7f00b7fff700 1 -- 172.21.15.78:0/3050052294 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f00c0051160 con 0x7f00d006d790 2023-06-09T11:12:37.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00d00741c0 con 0x7f00d006d790 2023-06-09T11:12:37.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00b7fff700 1 -- 172.21.15.78:0/3050052294 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00c0017020 con 0x7f00d006d790 2023-06-09T11:12:37.783 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:37.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f00bc0662f0 msgr2=0x7f00bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f00bc0662f0 0x7f00bc0687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00d006e510 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2023-06-09T11:12:37.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d006d790 msgr2=0x7f00d00b87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d006d790 0x7f00d00b87b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00c000e840 tx=0x7f00c000ec00 comp rx=0 tx=0).stop 2023-06-09T11:12:37.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 shutdown_connections 2023-06-09T11:12:37.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f00bc0662f0 0x7f00bc0687a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00d015c9f0 0x7f00d00ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00d00d1380 0x7f00d01f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 --2- 172.21.15.78:0/3050052294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00d006d790 0x7f00d00b87b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.776+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 >> 172.21.15.78:0/3050052294 conn(0x7f00d00b4c90 msgr2=0x7f00d015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:37.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.780+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 shutdown_connections 2023-06-09T11:12:37.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.780+0000 7f00d5a74700 1 -- 172.21.15.78:0/3050052294 wait complete. 2023-06-09T11:12:37.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.980+0000 7fc1b645a700 1 Processor -- start 2023-06-09T11:12:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.980+0000 7fc1b645a700 1 -- start start 2023-06-09T11:12:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.980+0000 7fc1b645a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1b0158a70 0x7fc1b00b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.980+0000 7fc1b645a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b006ae70 0x7fc1b00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.980+0000 7fc1b645a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00cbe50 con 0x7fc1b00b2db0 2023-06-09T11:12:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.980+0000 7fc1b645a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b00cc0f0 con 0x7fc1b0158a70 2023-06-09T11:12:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.980+0000 7fc1b645a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00cc3d0 con 0x7fc1b006ae70 2023-06-09T11:12:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5458700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1b0158a70 0x7fc1b00b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b4c57700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc1b00b2db0 0x7fc1b006a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:35470/0 (socket says 172.21.15.78:35470) 2023-06-09T11:12:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b4c57700 1 -- 172.21.15.78:0/932552073 learned_addr learned my addr 172.21.15.78:0/932552073 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5458700 1 --2- 172.21.15.78:0/932552073 >> v2:172.21.15.78:3300/0 conn(0x7fc1b0158a70 0x7fc1b00b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54492/0 (socket says 172.21.15.78:54492) 2023-06-09T11:12:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5c59700 1 --2- 172.21.15.78:0/932552073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b006ae70 0x7fc1b00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5458700 1 -- 172.21.15.78:0/932552073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b006ae70 msgr2=0x7fc1b00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5458700 1 --2- 172.21.15.78:0/932552073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b006ae70 0x7fc1b00ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5458700 1 -- 172.21.15.78:0/932552073 >> v1:172.21.15.187:6789/0 conn(0x7fc1b00b2db0 legacy=0x7fc1b006a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1a7fff700 1 -- 172.21.15.78:0/932552073 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114947899 0 0) 0x7fc1b00cbe50 con 0x7fc1b00b2db0 2023-06-09T11:12:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5458700 1 -- 172.21.15.78:0/932552073 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00cc6b0 con 0x7fc1b0158a70 2023-06-09T11:12:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b5458700 1 --2- 172.21.15.78:0/932552073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b00b2870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00a9f0 tx=0x7fc1ac00ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d68cc69a0e9cee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1a7fff700 1 -- 172.21.15.78:0/932552073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac00cb70 con 0x7fc1b0158a70 2023-06-09T11:12:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1a7fff700 1 -- 172.21.15.78:0/932552073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac00ae90 con 0x7fc1b0158a70 2023-06-09T11:12:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1a7fff700 1 -- 172.21.15.78:0/932552073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac018400 con 0x7fc1b0158a70 2023-06-09T11:12:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b645a700 1 -- 172.21.15.78:0/932552073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 msgr2=0x7fc1b00b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.984+0000 7fc1b645a700 1 --2- 172.21.15.78:0/932552073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b00b2870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00a9f0 tx=0x7fc1ac00ad00 comp rx=0 tx=0).stop 2023-06-09T11:12:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 -- 172.21.15.78:0/932552073 shutdown_connections 2023-06-09T11:12:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 --2- 172.21.15.78:0/932552073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b006ae70 0x7fc1b00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 --2- 172.21.15.78:0/932552073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b00b2870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 -- 172.21.15.78:0/932552073 >> 172.21.15.78:0/932552073 conn(0x7fc1b00b0780 msgr2=0x7fc1b00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 -- 172.21.15.78:0/932552073 shutdown_connections 2023-06-09T11:12:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 -- 172.21.15.78:0/932552073 wait complete. 2023-06-09T11:12:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 Processor -- start 2023-06-09T11:12:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.988+0000 7fc1b645a700 1 -- start start 2023-06-09T11:12:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b006ae70 0x7fc1b014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b00b2db0 0x7fc1b015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b01591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b014dd20 con 0x7fc1b0158a70 2023-06-09T11:12:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01e2560 con 0x7fc1b006ae70 2023-06-09T11:12:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01e2840 con 0x7fc1b00b2db0 2023-06-09T11:12:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b01591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b01591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54502/0 (socket says 172.21.15.78:54502) 2023-06-09T11:12:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 -- 172.21.15.78:0/582295789 learned_addr learned my addr 172.21.15.78:0/582295789 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5458700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b006ae70 0x7fc1b014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b4c57700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b00b2db0 0x7fc1b015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 -- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b00b2db0 msgr2=0x7fc1b015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b00b2db0 0x7fc1b015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 -- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b006ae70 msgr2=0x7fc1b014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b006ae70 0x7fc1b014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 -- 172.21.15.78:0/582295789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac00a650 con 0x7fc1b0158a70 2023-06-09T11:12:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b5c59700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b01591d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800efc0 tx=0x7fc1a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1a5ffb700 1 -- 172.21.15.78:0/582295789 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800cd40 con 0x7fc1b0158a70 2023-06-09T11:12:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1a5ffb700 1 -- 172.21.15.78:0/582295789 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a800f040 con 0x7fc1b0158a70 2023-06-09T11:12:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1a5ffb700 1 -- 172.21.15.78:0/582295789 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80146c0 con 0x7fc1b0158a70 2023-06-09T11:12:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b0158fd0 con 0x7fc1b0158a70 2023-06-09T11:12:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.992+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b0158e40 con 0x7fc1b0158a70 2023-06-09T11:12:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.996+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b00b3330 con 0x7fc1b0158a70 2023-06-09T11:12:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.996+0000 7fc1a5ffb700 1 -- 172.21.15.78:0/582295789 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1a8014820 con 0x7fc1b0158a70 2023-06-09T11:12:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.996+0000 7fc1a5ffb700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc1940662f0 0x7fc1940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:37.996+0000 7fc1a5ffb700 1 -- 172.21.15.78:0/582295789 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1a8084950 con 0x7fc1b0158a70 2023-06-09T11:12:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.000+0000 7fc1b5458700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc1940662f0 0x7fc1940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.000+0000 7fc1b5458700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc1940662f0 0x7fc1940687a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00a1c0 tx=0x7fc1ac01b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.004+0000 7fc1a5ffb700 1 -- 172.21.15.78:0/582295789 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc1a8051e60 con 0x7fc1b0158a70 2023-06-09T11:12:38.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.176+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1b0159ee0 con 0x7fc1b0158a70 2023-06-09T11:12:38.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.176+0000 7fc1a5ffb700 1 -- 172.21.15.78:0/582295789 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1b0159ee0 con 0x7fc1b0158a70 2023-06-09T11:12:38.183 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:38.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc1940662f0 msgr2=0x7fc1940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc1940662f0 0x7fc1940687a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00a1c0 tx=0x7fc1ac01b040 comp rx=0 tx=0).stop 2023-06-09T11:12:38.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 msgr2=0x7fc1b01591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b01591d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800efc0 tx=0x7fc1a800c3a0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 shutdown_connections 2023-06-09T11:12:38.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc1940662f0 0x7fc1940687a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1b0158a70 0x7fc1b01591d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1b00b2db0 0x7fc1b015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 --2- 172.21.15.78:0/582295789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b006ae70 0x7fc1b014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 >> 172.21.15.78:0/582295789 conn(0x7fc1b00b0780 msgr2=0x7fc1b00cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:38.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 shutdown_connections 2023-06-09T11:12:38.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.180+0000 7fc1b645a700 1 -- 172.21.15.78:0/582295789 wait complete. 2023-06-09T11:12:38.214 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.380+0000 7f139f59e700 1 Processor -- start 2023-06-09T11:12:38.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.380+0000 7f139f59e700 1 -- start start 2023-06-09T11:12:38.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13a0160940 0x7f13a00ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139f59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139f59e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00adb00 con 0x7f13a006f2a0 2023-06-09T11:12:38.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139f59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a01653a0 con 0x7f13a0160940 2023-06-09T11:12:38.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139f59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a006ba70 con 0x7f13a0164c00 2023-06-09T11:12:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13a0160940 0x7f13a00ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13a0160940 0x7f13a00ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54506/0 (socket says 172.21.15.78:54506) 2023-06-09T11:12:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 -- 172.21.15.78:0/3410388976 learned_addr learned my addr 172.21.15.78:0/3410388976 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139ed9d700 1 --2- 172.21.15.78:0/3410388976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a006dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 -- 172.21.15.78:0/3410388976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 msgr2=0x7f13a006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 --2- 172.21.15.78:0/3410388976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a006dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 -- 172.21.15.78:0/3410388976 >> v1:172.21.15.187:6789/0 conn(0x7f13a006f2a0 legacy=0x7f13a01644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 -- 172.21.15.78:0/3410388976 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00ccb10 con 0x7f13a0160940 2023-06-09T11:12:38.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.384+0000 7f139e59c700 1 --2- 172.21.15.78:0/3410388976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a00ce4a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1390009940 tx=0x7f1390009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b4c15bc3326400 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139d59a700 1 -- 172.21.15.78:0/3410388976 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000ba20 con 0x7f13a0160940 2023-06-09T11:12:38.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139d59a700 1 -- 172.21.15.78:0/3410388976 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1390009e90 con 0x7f13a0160940 2023-06-09T11:12:38.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139d59a700 1 -- 172.21.15.78:0/3410388976 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000bda0 con 0x7f13a0160940 2023-06-09T11:12:38.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 -- 172.21.15.78:0/3410388976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 msgr2=0x7f13a00ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 --2- 172.21.15.78:0/3410388976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a00ce4a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1390009940 tx=0x7f1390009c50 comp rx=0 tx=0).stop 2023-06-09T11:12:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 -- 172.21.15.78:0/3410388976 shutdown_connections 2023-06-09T11:12:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 --2- 172.21.15.78:0/3410388976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a006dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 --2- 172.21.15.78:0/3410388976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a00ce4a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 -- 172.21.15.78:0/3410388976 >> 172.21.15.78:0/3410388976 conn(0x7f13a00cf670 msgr2=0x7f13a00cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 -- 172.21.15.78:0/3410388976 shutdown_connections 2023-06-09T11:12:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.388+0000 7f139f59e700 1 -- 172.21.15.78:0/3410388976 wait complete. 2023-06-09T11:12:38.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 Processor -- start 2023-06-09T11:12:38.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 -- start start 2023-06-09T11:12:38.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13a006f2a0 0x7f13a00b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a0155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00b4800 con 0x7f13a0160940 2023-06-09T11:12:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00b3c80 con 0x7f13a006f2a0 2023-06-09T11:12:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00b3f60 con 0x7f13a0164c00 2023-06-09T11:12:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54510/0 (socket says 172.21.15.78:54510) 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 -- 172.21.15.78:0/3193818237 learned_addr learned my addr 172.21.15.78:0/3193818237 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139e59c700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13a006f2a0 0x7f13a00b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139ed9d700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a0155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 -- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 msgr2=0x7f13a0155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a0155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 -- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13a006f2a0 msgr2=0x7f13a00b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13a006f2a0 0x7f13a00b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 -- 172.21.15.78:0/3193818237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390009570 con 0x7f13a0160940 2023-06-09T11:12:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139dd9b700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a015adf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f138800c500 tx=0x7f138800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f1396ffd700 1 -- 172.21.15.78:0/3193818237 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880052d0 con 0x7f13a0160940 2023-06-09T11:12:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f1396ffd700 1 -- 172.21.15.78:0/3193818237 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388005430 con 0x7f13a0160940 2023-06-09T11:12:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a01650c0 con 0x7f13a0160940 2023-06-09T11:12:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.392+0000 7f1396ffd700 1 -- 172.21.15.78:0/3193818237 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880055a0 con 0x7f13a0160940 2023-06-09T11:12:38.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.396+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a00add50 con 0x7f13a0160940 2023-06-09T11:12:38.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.396+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a0161d20 con 0x7f13a0160940 2023-06-09T11:12:38.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.396+0000 7f1396ffd700 1 -- 172.21.15.78:0/3193818237 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13880038e0 con 0x7f13a0160940 2023-06-09T11:12:38.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.400+0000 7f1396ffd700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f13800662f0 0x7f13800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.400+0000 7f1396ffd700 1 -- 172.21.15.78:0/3193818237 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13880830d0 con 0x7f13a0160940 2023-06-09T11:12:38.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.400+0000 7f139e59c700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f13800662f0 0x7f13800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.400+0000 7f139e59c700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f13800662f0 0x7f13800687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f1390008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.404+0000 7f1396ffd700 1 -- 172.21.15.78:0/3193818237 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1388050540 con 0x7f13a0160940 2023-06-09T11:12:38.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.580+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13a00ae4d0 con 0x7f13a0160940 2023-06-09T11:12:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f1396ffd700 1 -- 172.21.15.78:0/3193818237 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f13a00ae4d0 con 0x7f13a0160940 2023-06-09T11:12:38.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:38.591 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f13800662f0 msgr2=0x7f13800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f13800662f0 0x7f13800687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f1390008030 comp rx=0 tx=0).stop 2023-06-09T11:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 msgr2=0x7f13a015adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a015adf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f138800c500 tx=0x7f138800c810 comp rx=0 tx=0).stop 2023-06-09T11:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 shutdown_connections 2023-06-09T11:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f13800662f0 0x7f13800687a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13a0164c00 0x7f13a0155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13a0160940 0x7f13a015adf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 --2- 172.21.15.78:0/3193818237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13a006f2a0 0x7f13a00b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.584+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 >> 172.21.15.78:0/3193818237 conn(0x7f13a00cf670 msgr2=0x7f13a00c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.588+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 shutdown_connections 2023-06-09T11:12:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.588+0000 7f139f59e700 1 -- 172.21.15.78:0/3193818237 wait complete. 2023-06-09T11:12:38.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:38.615 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.792+0000 7ff9ecd5d700 1 Processor -- start 2023-06-09T11:12:38.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.792+0000 7ff9ecd5d700 1 -- start start 2023-06-09T11:12:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.792+0000 7ff9ecd5d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff9e815a490 0x7ff9e806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.792+0000 7ff9ecd5d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e80cd5e0 con 0x7ff9e80ade90 2023-06-09T11:12:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.792+0000 7ff9ecd5d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e80cd810 con 0x7ff9e80ce5b0 2023-06-09T11:12:38.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.792+0000 7ff9ecd5d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e8069ed0 con 0x7ff9e815a490 2023-06-09T11:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e6ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff9e80ade90 0x7ff9e806ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48378/0 (socket says 172.21.15.78:48378) 2023-06-09T11:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e6ffd700 1 -- 172.21.15.78:0/2781783884 learned_addr learned my addr 172.21.15.78:0/2781783884 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e77fe700 1 --2- 172.21.15.78:0/2781783884 >> v2:172.21.15.187:3300/0 conn(0x7ff9e815a490 0x7ff9e806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536050221 0 0) 0x7ff9e80cd5e0 con 0x7ff9e80ade90 2023-06-09T11:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d40035d0 con 0x7ff9e80ade90 2023-06-09T11:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383457929 0 0) 0x7ff9e80cd810 con 0x7ff9e80ce5b0 2023-06-09T11:12:38.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e80cd5e0 con 0x7ff9e80ce5b0 2023-06-09T11:12:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3511965927 0 0) 0x7ff9d40035d0 con 0x7ff9e80ade90 2023-06-09T11:12:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e77fe700 1 -- 172.21.15.78:0/2781783884 >> v1:172.21.15.187:6789/0 conn(0x7ff9e80ce5b0 legacy=0x7ff9e80cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e77fe700 1 -- 172.21.15.78:0/2781783884 >> v1:172.21.15.78:6789/0 conn(0x7ff9e80ade90 legacy=0x7ff9e806ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e77fe700 1 -- 172.21.15.78:0/2781783884 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e806a0b0 con 0x7ff9e815a490 2023-06-09T11:12:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e77fe700 1 --2- 172.21.15.78:0/2781783884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e815a490 0x7ff9e806d690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009d90 tx=0x7ff9d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63bda691e110491c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800e070 con 0x7ff9e815a490 2023-06-09T11:12:38.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8003a40 con 0x7ff9e815a490 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9e67fc700 1 -- 172.21.15.78:0/2781783884 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0001670 con 0x7ff9e815a490 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/2781783884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e815a490 msgr2=0x7ff9e806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.796+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/2781783884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e815a490 0x7ff9e806d690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009d90 tx=0x7ff9d800b330 comp rx=0 tx=0).stop 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.800+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/2781783884 shutdown_connections 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.800+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/2781783884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e815a490 0x7ff9e806d690 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.800+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/2781783884 >> 172.21.15.78:0/2781783884 conn(0x7ff9e80b0780 msgr2=0x7ff9e80b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.800+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/2781783884 shutdown_connections 2023-06-09T11:12:38.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.800+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/2781783884 wait complete. 2023-06-09T11:12:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.800+0000 7ff9ecd5d700 1 Processor -- start 2023-06-09T11:12:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9ecd5d700 1 -- start start 2023-06-09T11:12:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9ecd5d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9e80ade90 0x7ff9e81f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9ecd5d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e80ce5b0 0x7ff9e814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9ecd5d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e815a490 0x7ff9e81584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9ecd5d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8156e20 con 0x7ff9e815a490 2023-06-09T11:12:38.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9ecd5d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8157100 con 0x7ff9e80ce5b0 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9ecd5d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81573e0 con 0x7ff9e80ade90 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e815a490 0x7ff9e81584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e815a490 0x7ff9e81584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54512/0 (socket says 172.21.15.78:54512) 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 -- 172.21.15.78:0/4060547400 learned_addr learned my addr 172.21.15.78:0/4060547400 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e77fe700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9e80ade90 0x7ff9e81f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e6ffd700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e80ce5b0 0x7ff9e814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 -- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9e80ade90 msgr2=0x7ff9e81f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9e80ade90 0x7ff9e81f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 -- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e80ce5b0 msgr2=0x7ff9e814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e80ce5b0 0x7ff9e814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 -- 172.21.15.78:0/4060547400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d8009a70 con 0x7ff9e815a490 2023-06-09T11:12:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e6ffd700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e80ce5b0 0x7ff9e814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.804+0000 7ff9e7fff700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e815a490 0x7ff9e81584c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c500 tx=0x7ff9e000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.808+0000 7ff9dffff700 1 -- 172.21.15.78:0/4060547400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00052d0 con 0x7ff9e815a490 2023-06-09T11:12:38.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.808+0000 7ff9dffff700 1 -- 172.21.15.78:0/4060547400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0005430 con 0x7ff9e815a490 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.808+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e806a670 con 0x7ff9e815a490 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.808+0000 7ff9dffff700 1 -- 172.21.15.78:0/4060547400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00055a0 con 0x7ff9e815a490 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.808+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e806a390 con 0x7ff9e815a490 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.808+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e806dbd0 con 0x7ff9e815a490 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.812+0000 7ff9dffff700 1 -- 172.21.15.78:0/4060547400 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9e00038e0 con 0x7ff9e815a490 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.812+0000 7ff9dffff700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9c80662f0 0x7ff9c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.812+0000 7ff9dffff700 1 -- 172.21.15.78:0/4060547400 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9e0083200 con 0x7ff9e815a490 2023-06-09T11:12:38.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.812+0000 7ff9e77fe700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9c80662f0 0x7ff9c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:38.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.816+0000 7ff9e77fe700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9c80662f0 0x7ff9c80687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8015040 tx=0x7ff9d8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:38.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.816+0000 7ff9dffff700 1 -- 172.21.15.78:0/4060547400 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff9e00506a0 con 0x7ff9e815a490 2023-06-09T11:12:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.984+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9e8067610 con 0x7ff9e815a490 2023-06-09T11:12:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9dffff700 1 -- 172.21.15.78:0/4060547400 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9e0053cc0 con 0x7ff9e815a490 2023-06-09T11:12:38.994 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9c80662f0 msgr2=0x7ff9c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9c80662f0 0x7ff9c80687a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8015040 tx=0x7ff9d8011000 comp rx=0 tx=0).stop 2023-06-09T11:12:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e815a490 msgr2=0x7ff9e81584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e815a490 0x7ff9e81584c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c500 tx=0x7ff9e000c810 comp rx=0 tx=0).stop 2023-06-09T11:12:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 shutdown_connections 2023-06-09T11:12:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9c80662f0 0x7ff9c80687a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e815a490 0x7ff9e81584c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9e80ce5b0 0x7ff9e814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 --2- 172.21.15.78:0/4060547400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9e80ade90 0x7ff9e81f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.988+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 >> 172.21.15.78:0/4060547400 conn(0x7ff9e80b0780 msgr2=0x7ff9e8155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.992+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 shutdown_connections 2023-06-09T11:12:39.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:38.992+0000 7ff9ecd5d700 1 -- 172.21.15.78:0/4060547400 wait complete. 2023-06-09T11:12:39.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:39.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.180+0000 7f7fcf59e700 1 Processor -- start 2023-06-09T11:12:39.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.180+0000 7f7fcf59e700 1 -- start start 2023-06-09T11:12:39.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcf59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fd015a160 0x7f7fd015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcf59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd00d26d0 0x7f7fd00d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcf59e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7fd0070890 0x7f7fd0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcf59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd0071250 con 0x7f7fd015a160 2023-06-09T11:12:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcf59e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd006d730 con 0x7f7fd0070890 2023-06-09T11:12:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcf59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd015a530 con 0x7f7fd00d26d0 2023-06-09T11:12:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fce59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fd015a160 0x7f7fd015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fce59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7fd015a160 0x7f7fd015cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54518/0 (socket says 172.21.15.78:54518) 2023-06-09T11:12:39.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fce59c700 1 -- 172.21.15.78:0/456862177 learned_addr learned my addr 172.21.15.78:0/456862177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:39.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcdd9b700 1 --2- 172.21.15.78:0/456862177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd00d26d0 0x7f7fd00d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fced9d700 1 --2- 172.21.15.78:0/456862177 >> v2:172.21.15.187:3300/0 conn(0x7f7fd0070890 0x7f7fd0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcdd9b700 1 -- 172.21.15.78:0/456862177 >> v2:172.21.15.187:3300/0 conn(0x7f7fd0070890 msgr2=0x7f7fd0070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:39.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcdd9b700 1 --2- 172.21.15.78:0/456862177 >> v2:172.21.15.187:3300/0 conn(0x7f7fd0070890 0x7f7fd0070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcdd9b700 1 -- 172.21.15.78:0/456862177 >> v2:172.21.15.78:3300/0 conn(0x7f7fd015a160 msgr2=0x7f7fd015cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:39.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcdd9b700 1 --2- 172.21.15.78:0/456862177 >> v2:172.21.15.78:3300/0 conn(0x7f7fd015a160 0x7f7fd015cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.184+0000 7f7fcdd9b700 1 -- 172.21.15.78:0/456862177 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd015d180 con 0x7f7fd00d26d0 2023-06-09T11:12:39.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcdd9b700 1 --2- 172.21.15.78:0/456862177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd00d26d0 0x7f7fd00d0a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00d0970 tx=0x7f7fc4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61aa45fa5d319ad server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcd59a700 1 -- 172.21.15.78:0/456862177 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4011830 con 0x7f7fd00d26d0 2023-06-09T11:12:39.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcd59a700 1 -- 172.21.15.78:0/456862177 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc4011990 con 0x7f7fd00d26d0 2023-06-09T11:12:39.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcd59a700 1 -- 172.21.15.78:0/456862177 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4011d20 con 0x7f7fd00d26d0 2023-06-09T11:12:39.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 -- 172.21.15.78:0/456862177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd00d26d0 msgr2=0x7f7fd00d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/456862177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd00d26d0 0x7f7fd00d0a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00d0970 tx=0x7f7fc4009b30 comp rx=0 tx=0).stop 2023-06-09T11:12:39.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 -- 172.21.15.78:0/456862177 shutdown_connections 2023-06-09T11:12:39.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/456862177 >> v2:172.21.15.187:3300/0 conn(0x7f7fd0070890 0x7f7fd0070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/456862177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd00d26d0 0x7f7fd00d0a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/456862177 >> v2:172.21.15.78:3300/0 conn(0x7f7fd015a160 0x7f7fd015cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 -- 172.21.15.78:0/456862177 >> 172.21.15.78:0/456862177 conn(0x7f7fd00cf930 msgr2=0x7f7fd00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:39.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 -- 172.21.15.78:0/456862177 shutdown_connections 2023-06-09T11:12:39.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.188+0000 7f7fcf59e700 1 -- 172.21.15.78:0/456862177 wait complete. 2023-06-09T11:12:39.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 Processor -- start 2023-06-09T11:12:39.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 -- start start 2023-06-09T11:12:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fd0070890 0x7f7fd00b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fd00d26d0 0x7f7fd0148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd015a160 0x7f7fd01572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0148750 con 0x7f7fd00d26d0 2023-06-09T11:12:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0157800 con 0x7f7fd0070890 2023-06-09T11:12:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcf59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0157aa0 con 0x7f7fd015a160 2023-06-09T11:12:39.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fd00d26d0 0x7f7fd0148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fd00d26d0 0x7f7fd0148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54524/0 (socket says 172.21.15.78:54524) 2023-06-09T11:12:39.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 -- 172.21.15.78:0/2017772752 learned_addr learned my addr 172.21.15.78:0/2017772752 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fce59c700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fd0070890 0x7f7fd00b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fced9d700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd015a160 0x7f7fd01572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 -- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd015a160 msgr2=0x7f7fd01572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd015a160 0x7f7fd01572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 -- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fd0070890 msgr2=0x7f7fd00b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fd0070890 0x7f7fd00b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 -- 172.21.15.78:0/2017772752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40094b0 con 0x7f7fd00d26d0 2023-06-09T11:12:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.192+0000 7f7fcdd9b700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fd00d26d0 0x7f7fd0148210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40090b0 tx=0x7f7fc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.196+0000 7f7fbeffd700 1 -- 172.21.15.78:0/2017772752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4004300 con 0x7f7fd00d26d0 2023-06-09T11:12:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.196+0000 7f7fbeffd700 1 -- 172.21.15.78:0/2017772752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc401f070 con 0x7f7fd00d26d0 2023-06-09T11:12:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.196+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd015d740 con 0x7f7fd00d26d0 2023-06-09T11:12:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.196+0000 7f7fbeffd700 1 -- 172.21.15.78:0/2017772752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc40036c0 con 0x7f7fd00d26d0 2023-06-09T11:12:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.196+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd015d460 con 0x7f7fd00d26d0 2023-06-09T11:12:39.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.196+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd015da20 con 0x7f7fd00d26d0 2023-06-09T11:12:39.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.200+0000 7f7fbeffd700 1 -- 172.21.15.78:0/2017772752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fc4021030 con 0x7f7fd00d26d0 2023-06-09T11:12:39.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.200+0000 7f7fbeffd700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb00662f0 0x7f7fb00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.200+0000 7f7fbeffd700 1 -- 172.21.15.78:0/2017772752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fc4084f30 con 0x7f7fd00d26d0 2023-06-09T11:12:39.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.200+0000 7f7fce59c700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb00662f0 0x7f7fb00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.200+0000 7f7fce59c700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb00662f0 0x7f7fb00687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0006d70 tx=0x7f7fc00092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.204+0000 7f7fbeffd700 1 -- 172.21.15.78:0/2017772752 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7fc40523a0 con 0x7f7fd00d26d0 2023-06-09T11:12:39.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.380+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7fd0067610 con 0x7f7fd00d26d0 2023-06-09T11:12:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.380+0000 7f7fbeffd700 1 -- 172.21.15.78:0/2017772752 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7fc40559c0 con 0x7f7fd00d26d0 2023-06-09T11:12:39.389 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb00662f0 msgr2=0x7f7fb00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb00662f0 0x7f7fb00687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0006d70 tx=0x7f7fc00092e0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fd00d26d0 msgr2=0x7f7fd0148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fd00d26d0 0x7f7fd0148210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40090b0 tx=0x7f7fc4004770 comp rx=0 tx=0).stop 2023-06-09T11:12:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 shutdown_connections 2023-06-09T11:12:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7fb00662f0 0x7f7fb00687a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fd015a160 0x7f7fd01572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7fd00d26d0 0x7f7fd0148210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 --2- 172.21.15.78:0/2017772752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fd0070890 0x7f7fd00b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 >> 172.21.15.78:0/2017772752 conn(0x7f7fd00cf930 msgr2=0x7f7fd00c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 shutdown_connections 2023-06-09T11:12:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.384+0000 7f7fcf59e700 1 -- 172.21.15.78:0/2017772752 wait complete. 2023-06-09T11:12:39.413 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:39.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.580+0000 7f3837326700 1 Processor -- start 2023-06-09T11:12:39.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.580+0000 7f3837326700 1 -- start start 2023-06-09T11:12:39.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3837326700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3830160b60 0x7f383006ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3837326700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38300cd470 con 0x7f3830160f30 2023-06-09T11:12:39.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3837326700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38300ccbd0 con 0x7f383006b360 2023-06-09T11:12:39.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3837326700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300cb070 con 0x7f3830160b60 2023-06-09T11:12:39.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f38350c2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3830160b60 0x7f383006ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f38348c1700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3830160f30 0x7f38300c1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48394/0 (socket says 172.21.15.78:48394) 2023-06-09T11:12:39.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f38348c1700 1 -- 172.21.15.78:0/3082019223 learned_addr learned my addr 172.21.15.78:0/3082019223 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3827fff700 1 -- 172.21.15.78:0/3082019223 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284411792 0 0) 0x7f38300cd470 con 0x7f3830160f30 2023-06-09T11:12:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3827fff700 1 -- 172.21.15.78:0/3082019223 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f381c0035d0 con 0x7f3830160f30 2023-06-09T11:12:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f38350c2700 1 -- 172.21.15.78:0/3082019223 >> v1:172.21.15.187:6789/0 conn(0x7f383006b360 legacy=0x7f383006fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3827fff700 1 -- 172.21.15.78:0/3082019223 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395020564 0 0) 0x7f38300ccbd0 con 0x7f383006b360 2023-06-09T11:12:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f38350c2700 1 -- 172.21.15.78:0/3082019223 >> v1:172.21.15.78:6789/0 conn(0x7f3830160f30 legacy=0x7f38300c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f38350c2700 1 -- 172.21.15.78:0/3082019223 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300cceb0 con 0x7f3830160b60 2023-06-09T11:12:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f38350c2700 1 --2- 172.21.15.78:0/3082019223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383006ae20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f382c009880 tx=0x7f382c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1823996332886d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3827fff700 1 -- 172.21.15.78:0/3082019223 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c011830 con 0x7f3830160b60 2023-06-09T11:12:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3827fff700 1 -- 172.21.15.78:0/3082019223 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c011990 con 0x7f3830160b60 2023-06-09T11:12:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.584+0000 7f3827fff700 1 -- 172.21.15.78:0/3082019223 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c011d20 con 0x7f3830160b60 2023-06-09T11:12:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.588+0000 7f3837326700 1 -- 172.21.15.78:0/3082019223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 msgr2=0x7f383006ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.588+0000 7f3837326700 1 --2- 172.21.15.78:0/3082019223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383006ae20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f382c009880 tx=0x7f382c009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.588+0000 7f3837326700 1 -- 172.21.15.78:0/3082019223 shutdown_connections 2023-06-09T11:12:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.588+0000 7f3837326700 1 --2- 172.21.15.78:0/3082019223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383006ae20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.588+0000 7f3837326700 1 -- 172.21.15.78:0/3082019223 >> 172.21.15.78:0/3082019223 conn(0x7f38300cf8b0 msgr2=0x7f38300cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.588+0000 7f3837326700 1 -- 172.21.15.78:0/3082019223 shutdown_connections 2023-06-09T11:12:39.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.588+0000 7f3837326700 1 -- 172.21.15.78:0/3082019223 wait complete. 2023-06-09T11:12:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 Processor -- start 2023-06-09T11:12:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 -- start start 2023-06-09T11:12:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f383006b360 0x7f38301f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3830160f30 0x7f383014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c7e50 con 0x7f3830160b60 2023-06-09T11:12:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383014f9f0 con 0x7f3830160f30 2023-06-09T11:12:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3837326700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c74b0 con 0x7f383006b360 2023-06-09T11:12:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383014ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54534/0 (socket says 172.21.15.78:54534) 2023-06-09T11:12:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 -- 172.21.15.78:0/3114168566 learned_addr learned my addr 172.21.15.78:0/3114168566 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38350c2700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f383006b360 0x7f38301f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38358c3700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3830160f30 0x7f383014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 -- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f383006b360 msgr2=0x7f38301f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f383006b360 0x7f38301f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 -- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3830160f30 msgr2=0x7f383014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3830160f30 0x7f383014f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 -- 172.21.15.78:0/3114168566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c0094b0 con 0x7f3830160b60 2023-06-09T11:12:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38358c3700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3830160f30 0x7f383014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f38348c1700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383014ecb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f382000c430 tx=0x7f382000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.592+0000 7f3825ffb700 1 -- 172.21.15.78:0/3114168566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820005d90 con 0x7f3830160b60 2023-06-09T11:12:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.596+0000 7f3825ffb700 1 -- 172.21.15.78:0/3114168566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200070d0 con 0x7f3830160b60 2023-06-09T11:12:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.596+0000 7f3825ffb700 1 -- 172.21.15.78:0/3114168566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820007480 con 0x7f3830160b60 2023-06-09T11:12:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.596+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383006f9b0 con 0x7f3830160b60 2023-06-09T11:12:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.596+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38300cd190 con 0x7f3830160b60 2023-06-09T11:12:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.596+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38300cc7f0 con 0x7f3830160b60 2023-06-09T11:12:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.596+0000 7f3825ffb700 1 -- 172.21.15.78:0/3114168566 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38200075e0 con 0x7f3830160b60 2023-06-09T11:12:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.600+0000 7f3825ffb700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38140662f0 0x7f38140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.600+0000 7f3825ffb700 1 -- 172.21.15.78:0/3114168566 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38200831d0 con 0x7f3830160b60 2023-06-09T11:12:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.600+0000 7f38350c2700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38140662f0 0x7f38140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.600+0000 7f38350c2700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38140662f0 0x7f38140687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f382c0090b0 tx=0x7f382c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.608+0000 7f3825ffb700 1 -- 172.21.15.78:0/3114168566 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f38200505b0 con 0x7f3830160b60 2023-06-09T11:12:39.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.772+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38300741c0 con 0x7f3830160b60 2023-06-09T11:12:39.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.772+0000 7f3825ffb700 1 -- 172.21.15.78:0/3114168566 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3820053bd0 con 0x7f3830160b60 2023-06-09T11:12:39.781 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:39.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38140662f0 msgr2=0x7f38140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38140662f0 0x7f38140687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f382c0090b0 tx=0x7f382c008030 comp rx=0 tx=0).stop 2023-06-09T11:12:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 msgr2=0x7f383014ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383014ecb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f382000c430 tx=0x7f382000c740 comp rx=0 tx=0).stop 2023-06-09T11:12:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 shutdown_connections 2023-06-09T11:12:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f38140662f0 0x7f38140687a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3830160f30 0x7f383014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3830160b60 0x7f383014ecb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 --2- 172.21.15.78:0/3114168566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f383006b360 0x7f38301f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 >> 172.21.15.78:0/3114168566 conn(0x7f38300cf8b0 msgr2=0x7f38301e94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:39.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 shutdown_connections 2023-06-09T11:12:39.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.776+0000 7f3837326700 1 -- 172.21.15.78:0/3114168566 wait complete. 2023-06-09T11:12:39.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.976+0000 7faa2966d700 1 Processor -- start 2023-06-09T11:12:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.976+0000 7faa2966d700 1 -- start start 2023-06-09T11:12:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa2966d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faa24146c50 0x7faa240b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa2966d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa24161610 0x7faa2406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa2966d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2406a070 con 0x7faa2406b6e0 2023-06-09T11:12:39.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa2966d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2406a310 con 0x7faa24161610 2023-06-09T11:12:39.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa2966d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2406a5f0 con 0x7faa24146c50 2023-06-09T11:12:39.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa24161610 0x7faa2406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faa24161610 0x7faa2406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54536/0 (socket says 172.21.15.78:54536) 2023-06-09T11:12:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 -- 172.21.15.78:0/840881334 learned_addr learned my addr 172.21.15.78:0/840881334 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:39.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa23fff700 1 --2- 172.21.15.78:0/840881334 >> v2:172.21.15.187:3300/0 conn(0x7faa24146c50 0x7faa240b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 -- 172.21.15.78:0/840881334 >> v2:172.21.15.187:3300/0 conn(0x7faa24146c50 msgr2=0x7faa240b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 --2- 172.21.15.78:0/840881334 >> v2:172.21.15.187:3300/0 conn(0x7faa24146c50 0x7faa240b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 -- 172.21.15.78:0/840881334 >> v1:172.21.15.78:6789/0 conn(0x7faa2406b6e0 legacy=0x7faa24160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 -- 172.21.15.78:0/840881334 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2406a8d0 con 0x7faa24161610 2023-06-09T11:12:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa28e6c700 1 --2- 172.21.15.78:0/840881334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa24161610 0x7faa2406d690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa2406bb70 tx=0x7faa1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd41ee7792197813 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa22ffd700 1 -- 172.21.15.78:0/840881334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00e070 con 0x7faa24161610 2023-06-09T11:12:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa22ffd700 1 -- 172.21.15.78:0/840881334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c00b910 con 0x7faa24161610 2023-06-09T11:12:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa22ffd700 1 -- 172.21.15.78:0/840881334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00bcc0 con 0x7faa24161610 2023-06-09T11:12:39.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa2966d700 1 -- 172.21.15.78:0/840881334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa24161610 msgr2=0x7faa2406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.980+0000 7faa2966d700 1 --2- 172.21.15.78:0/840881334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa24161610 0x7faa2406d690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa2406bb70 tx=0x7faa1c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- 172.21.15.78:0/840881334 shutdown_connections 2023-06-09T11:12:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 --2- 172.21.15.78:0/840881334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa24161610 0x7faa2406d690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 --2- 172.21.15.78:0/840881334 >> v2:172.21.15.187:3300/0 conn(0x7faa24146c50 0x7faa240b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- 172.21.15.78:0/840881334 >> 172.21.15.78:0/840881334 conn(0x7faa240b0780 msgr2=0x7faa240b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- 172.21.15.78:0/840881334 shutdown_connections 2023-06-09T11:12:39.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- 172.21.15.78:0/840881334 wait complete. 2023-06-09T11:12:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 Processor -- start 2023-06-09T11:12:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- start start 2023-06-09T11:12:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2406b6e0 0x7faa2415e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa24146c50 0x7faa241f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa24161610 0x7faa240c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa241f6eb0 con 0x7faa2406b6e0 2023-06-09T11:12:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa241f68f0 con 0x7faa24161610 2023-06-09T11:12:39.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa2966d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa241f6bd0 con 0x7faa24146c50 2023-06-09T11:12:39.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa23fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2406b6e0 0x7faa2415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa23fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2406b6e0 0x7faa2415e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54548/0 (socket says 172.21.15.78:54548) 2023-06-09T11:12:39.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.984+0000 7faa23fff700 1 -- 172.21.15.78:0/81697554 learned_addr learned my addr 172.21.15.78:0/81697554 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:39.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa237fe700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa24146c50 0x7faa241f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa28e6c700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa24161610 0x7faa240c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa23fff700 1 -- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa24146c50 msgr2=0x7faa241f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa23fff700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa24146c50 0x7faa241f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa23fff700 1 -- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa24161610 msgr2=0x7faa240c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa23fff700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa24161610 0x7faa240c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa23fff700 1 -- 172.21.15.78:0/81697554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c009b30 con 0x7faa2406b6e0 2023-06-09T11:12:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa23fff700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2406b6e0 0x7faa2415e980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa1400e9d0 tx=0x7faa1400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa20ff9700 1 -- 172.21.15.78:0/81697554 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14009720 con 0x7faa2406b6e0 2023-06-09T11:12:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa20ff9700 1 -- 172.21.15.78:0/81697554 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1400c850 con 0x7faa2406b6e0 2023-06-09T11:12:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2406b0d0 con 0x7faa2406b6e0 2023-06-09T11:12:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa20ff9700 1 -- 172.21.15.78:0/81697554 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400cbc0 con 0x7faa2406b6e0 2023-06-09T11:12:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2406abb0 con 0x7faa2406b6e0 2023-06-09T11:12:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.988+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa24067610 con 0x7faa2406b6e0 2023-06-09T11:12:39.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.992+0000 7faa20ff9700 1 -- 172.21.15.78:0/81697554 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa1400cd20 con 0x7faa2406b6e0 2023-06-09T11:12:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.992+0000 7faa20ff9700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7faa100662f0 0x7faa100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.992+0000 7faa20ff9700 1 -- 172.21.15.78:0/81697554 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa14083ea0 con 0x7faa2406b6e0 2023-06-09T11:12:39.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.992+0000 7faa237fe700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7faa100662f0 0x7faa100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:39.992+0000 7faa237fe700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7faa100662f0 0x7faa100687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa240b2d10 tx=0x7faa18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:40.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.000+0000 7faa20ff9700 1 -- 172.21.15.78:0/81697554 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faa14054db0 con 0x7faa2406b6e0 2023-06-09T11:12:40.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.172+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa240b2a20 con 0x7faa2406b6e0 2023-06-09T11:12:40.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.172+0000 7faa20ff9700 1 -- 172.21.15.78:0/81697554 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa140170a0 con 0x7faa2406b6e0 2023-06-09T11:12:40.180 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:40.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7faa100662f0 msgr2=0x7faa100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7faa100662f0 0x7faa100687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa240b2d10 tx=0x7faa18009040 comp rx=0 tx=0).stop 2023-06-09T11:12:40.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2406b6e0 msgr2=0x7faa2415e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2406b6e0 0x7faa2415e980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa1400e9d0 tx=0x7faa1400ed90 comp rx=0 tx=0).stop 2023-06-09T11:12:40.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 shutdown_connections 2023-06-09T11:12:40.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7faa100662f0 0x7faa100687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa24161610 0x7faa240c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa24146c50 0x7faa241f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 --2- 172.21.15.78:0/81697554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2406b6e0 0x7faa2415e980 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 >> 172.21.15.78:0/81697554 conn(0x7faa240b0780 msgr2=0x7faa24163640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:40.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 shutdown_connections 2023-06-09T11:12:40.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.176+0000 7faa2966d700 1 -- 172.21.15.78:0/81697554 wait complete. 2023-06-09T11:12:40.207 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:40.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.372+0000 7f896aa76700 1 Processor -- start 2023-06-09T11:12:40.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.372+0000 7f896aa76700 1 -- start start 2023-06-09T11:12:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.372+0000 7f896aa76700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896406fc80 0x7f8964070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.372+0000 7f896aa76700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f89640c7cb0 0x7f896406a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.372+0000 7f896aa76700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89640c87a0 con 0x7f896415c880 2023-06-09T11:12:40.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.372+0000 7f896aa76700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896406e660 con 0x7f89640c7cb0 2023-06-09T11:12:40.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.372+0000 7f896aa76700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8964070590 con 0x7f896406fc80 2023-06-09T11:12:40.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969a74700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896406fc80 0x7f8964070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896a275700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f89640c7cb0 0x7f896406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969273700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f896415c880 0x7f896406df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:35502/0 (socket says 172.21.15.78:35502) 2023-06-09T11:12:40.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969273700 1 -- 172.21.15.78:0/3464288349 learned_addr learned my addr 172.21.15.78:0/3464288349 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:40.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969a74700 1 -- 172.21.15.78:0/3464288349 >> v2:172.21.15.187:3300/0 conn(0x7f89640c7cb0 msgr2=0x7f896406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:40.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969a74700 1 --2- 172.21.15.78:0/3464288349 >> v2:172.21.15.187:3300/0 conn(0x7f89640c7cb0 0x7f896406a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969a74700 1 -- 172.21.15.78:0/3464288349 >> v1:172.21.15.187:6789/0 conn(0x7f896415c880 legacy=0x7f896406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969a74700 1 -- 172.21.15.78:0/3464288349 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640c81e0 con 0x7f896406fc80 2023-06-09T11:12:40.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896a275700 1 --2- 172.21.15.78:0/3464288349 >> v2:172.21.15.187:3300/0 conn(0x7f89640c7cb0 0x7f896406a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:40.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8969a74700 1 --2- 172.21.15.78:0/3464288349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896406fc80 0x7f8964070050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8960009850 tx=0x7f8960009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101d346b9a46890 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8968a72700 1 -- 172.21.15.78:0/3464288349 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960011830 con 0x7f896406fc80 2023-06-09T11:12:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8968a72700 1 -- 172.21.15.78:0/3464288349 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8960011990 con 0x7f896406fc80 2023-06-09T11:12:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f8968a72700 1 -- 172.21.15.78:0/3464288349 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960011d40 con 0x7f896406fc80 2023-06-09T11:12:40.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 -- 172.21.15.78:0/3464288349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896406fc80 msgr2=0x7f8964070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 --2- 172.21.15.78:0/3464288349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896406fc80 0x7f8964070050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8960009850 tx=0x7f8960009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 -- 172.21.15.78:0/3464288349 shutdown_connections 2023-06-09T11:12:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 --2- 172.21.15.78:0/3464288349 >> v2:172.21.15.187:3300/0 conn(0x7f89640c7cb0 0x7f896406a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 --2- 172.21.15.78:0/3464288349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896406fc80 0x7f8964070050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 -- 172.21.15.78:0/3464288349 >> 172.21.15.78:0/3464288349 conn(0x7f89640cf870 msgr2=0x7f89640cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 -- 172.21.15.78:0/3464288349 shutdown_connections 2023-06-09T11:12:40.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.376+0000 7f896aa76700 1 -- 172.21.15.78:0/3464288349 wait complete. 2023-06-09T11:12:40.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 Processor -- start 2023-06-09T11:12:40.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 -- start start 2023-06-09T11:12:40.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f896406fc80 0x7f89640d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640c7cb0 0x7f896408a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896415c880 0x7f896408aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896408a8c0 con 0x7f896406fc80 2023-06-09T11:12:40.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896415dcd0 con 0x7f89640c7cb0 2023-06-09T11:12:40.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f896aa76700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896415df90 con 0x7f896415c880 2023-06-09T11:12:40.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f8969a74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f896406fc80 0x7f89640d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f8969a74700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f896406fc80 0x7f89640d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54558/0 (socket says 172.21.15.78:54558) 2023-06-09T11:12:40.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.380+0000 7f8969a74700 1 -- 172.21.15.78:0/3937212549 learned_addr learned my addr 172.21.15.78:0/3937212549 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:40.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f8969273700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640c7cb0 0x7f896408a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f896a275700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896415c880 0x7f896408aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f8969a74700 1 -- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896415c880 msgr2=0x7f896408aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f8969a74700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896415c880 0x7f896408aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f8969a74700 1 -- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640c7cb0 msgr2=0x7f896408a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f8969a74700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640c7cb0 0x7f896408a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f8969a74700 1 -- 172.21.15.78:0/3937212549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009a70 con 0x7f896406fc80 2023-06-09T11:12:40.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f8969a74700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f896406fc80 0x7f89640d1d20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89600090b0 tx=0x7f8960004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:40.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f895a7fc700 1 -- 172.21.15.78:0/3937212549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960004570 con 0x7f896406fc80 2023-06-09T11:12:40.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f895a7fc700 1 -- 172.21.15.78:0/3937212549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896001f070 con 0x7f896406fc80 2023-06-09T11:12:40.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89600094b0 con 0x7f896406fc80 2023-06-09T11:12:40.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f895a7fc700 1 -- 172.21.15.78:0/3937212549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960003900 con 0x7f896406fc80 2023-06-09T11:12:40.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896406a070 con 0x7f896406fc80 2023-06-09T11:12:40.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.384+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640c84c0 con 0x7f896406fc80 2023-06-09T11:12:40.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.388+0000 7f895a7fc700 1 -- 172.21.15.78:0/3937212549 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8960021030 con 0x7f896406fc80 2023-06-09T11:12:40.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.388+0000 7f895a7fc700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89480662f0 0x7f89480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.388+0000 7f895a7fc700 1 -- 172.21.15.78:0/3937212549 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8960085080 con 0x7f896406fc80 2023-06-09T11:12:40.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.388+0000 7f8969273700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89480662f0 0x7f89480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.388+0000 7f8969273700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89480662f0 0x7f89480687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89640d1c50 tx=0x7f8954009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:40.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.392+0000 7f895a7fc700 1 -- 172.21.15.78:0/3937212549 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8960052590 con 0x7f896406fc80 2023-06-09T11:12:40.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.564+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f896406a350 con 0x7f896406fc80 2023-06-09T11:12:40.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f895a7fc700 1 -- 172.21.15.78:0/3937212549 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f8960055bb0 con 0x7f896406fc80 2023-06-09T11:12:40.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:40.576 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:40.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89480662f0 msgr2=0x7f89480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89480662f0 0x7f89480687a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89640d1c50 tx=0x7f8954009040 comp rx=0 tx=0).stop 2023-06-09T11:12:40.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f896406fc80 msgr2=0x7f89640d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f896406fc80 0x7f89640d1d20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89600090b0 tx=0x7f8960004770 comp rx=0 tx=0).stop 2023-06-09T11:12:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 shutdown_connections 2023-06-09T11:12:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89480662f0 0x7f89480687a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f896415c880 0x7f896408aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640c7cb0 0x7f896408a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 --2- 172.21.15.78:0/3937212549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f896406fc80 0x7f89640d1d20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 >> 172.21.15.78:0/3937212549 conn(0x7f89640cf870 msgr2=0x7f896415bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 shutdown_connections 2023-06-09T11:12:40.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.568+0000 7f896aa76700 1 -- 172.21.15.78:0/3937212549 wait complete. 2023-06-09T11:12:40.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:40.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:40.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.768+0000 7f2fa759e700 1 Processor -- start 2023-06-09T11:12:40.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.768+0000 7f2fa759e700 1 -- start start 2023-06-09T11:12:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fa815cb30 0x7f2fa80d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa8070890 0x7f2fa8070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa759e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa8071210 con 0x7f2fa815a160 2023-06-09T11:12:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa806d730 con 0x7f2fa815cb30 2023-06-09T11:12:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa815a530 con 0x7f2fa8070890 2023-06-09T11:12:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fa815cb30 0x7f2fa80d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fa815cb30 0x7f2fa80d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54572/0 (socket says 172.21.15.78:54572) 2023-06-09T11:12:40.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/3866794572 learned_addr learned my addr 172.21.15.78:0/3866794572 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:40.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa6d9d700 1 --2- 172.21.15.78:0/3866794572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa8070890 0x7f2fa8070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/3866794572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa8070890 msgr2=0x7f2fa8070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:40.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 --2- 172.21.15.78:0/3866794572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa8070890 0x7f2fa8070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/3866794572 >> v1:172.21.15.187:6789/0 conn(0x7f2fa815a160 legacy=0x7f2fa80d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/3866794572 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa815d180 con 0x7f2fa815cb30 2023-06-09T11:12:40.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa5d9b700 1 --2- 172.21.15.78:0/3866794572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815cb30 0x7f2fa80d0a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009910 tx=0x7f2f9c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f3420ddb21a1b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:40.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa559a700 1 -- 172.21.15.78:0/3866794572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00ba60 con 0x7f2fa815cb30 2023-06-09T11:12:40.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa559a700 1 -- 172.21.15.78:0/3866794572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c00bbc0 con 0x7f2fa815cb30 2023-06-09T11:12:40.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa559a700 1 -- 172.21.15.78:0/3866794572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c009e60 con 0x7f2fa815cb30 2023-06-09T11:12:40.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa759e700 1 -- 172.21.15.78:0/3866794572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815cb30 msgr2=0x7f2fa80d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.772+0000 7f2fa759e700 1 --2- 172.21.15.78:0/3866794572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815cb30 0x7f2fa80d0a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009910 tx=0x7f2f9c009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:40.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.776+0000 7f2fa759e700 1 -- 172.21.15.78:0/3866794572 shutdown_connections 2023-06-09T11:12:40.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.776+0000 7f2fa759e700 1 --2- 172.21.15.78:0/3866794572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa8070890 0x7f2fa8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.776+0000 7f2fa759e700 1 --2- 172.21.15.78:0/3866794572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815cb30 0x7f2fa80d0a80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.776+0000 7f2fa759e700 1 -- 172.21.15.78:0/3866794572 >> 172.21.15.78:0/3866794572 conn(0x7f2fa80cf930 msgr2=0x7f2fa80cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:40.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.776+0000 7f2fa759e700 1 -- 172.21.15.78:0/3866794572 shutdown_connections 2023-06-09T11:12:40.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.776+0000 7f2fa759e700 1 -- 172.21.15.78:0/3866794572 wait complete. 2023-06-09T11:12:40.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 Processor -- start 2023-06-09T11:12:40.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 -- start start 2023-06-09T11:12:40.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fa8070890 0x7f2fa8158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815a160 0x7f2fa814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa815cb30 0x7f2fa81541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8158e40 con 0x7f2fa815a160 2023-06-09T11:12:40.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8158690 con 0x7f2fa8070890 2023-06-09T11:12:40.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8156d80 con 0x7f2fa815cb30 2023-06-09T11:12:40.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815a160 0x7f2fa814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815a160 0x7f2fa814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54582/0 (socket says 172.21.15.78:54582) 2023-06-09T11:12:40.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/2370791414 learned_addr learned my addr 172.21.15.78:0/2370791414 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:40.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fa8070890 0x7f2fa8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa6d9d700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa815cb30 0x7f2fa81541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa815cb30 msgr2=0x7f2fa81541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa815cb30 0x7f2fa81541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fa8070890 msgr2=0x7f2fa8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fa8070890 0x7f2fa8158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 -- 172.21.15.78:0/2370791414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c009570 con 0x7f2fa815a160 2023-06-09T11:12:40.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa5d9b700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815a160 0x7f2fa814fa80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c000c00 tx=0x7f2f9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:40.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2f96ffd700 1 -- 172.21.15.78:0/2370791414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c004500 con 0x7f2fa815a160 2023-06-09T11:12:40.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2f96ffd700 1 -- 172.21.15.78:0/2370791414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0036c0 con 0x7f2fa815a160 2023-06-09T11:12:40.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2f96ffd700 1 -- 172.21.15.78:0/2370791414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c003a50 con 0x7f2fa815a160 2023-06-09T11:12:40.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.780+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa815d740 con 0x7f2fa815a160 2023-06-09T11:12:40.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.784+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa815d460 con 0x7f2fa815a160 2023-06-09T11:12:40.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.784+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa815da20 con 0x7f2fa815a160 2023-06-09T11:12:40.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.784+0000 7f2f96ffd700 1 -- 172.21.15.78:0/2370791414 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f9c003bb0 con 0x7f2fa815a160 2023-06-09T11:12:40.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.788+0000 7f2f96ffd700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2f880662f0 0x7f2f880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:40.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.788+0000 7f2f96ffd700 1 -- 172.21.15.78:0/2370791414 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f9c021030 con 0x7f2fa815a160 2023-06-09T11:12:40.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.788+0000 7f2fa659c700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2f880662f0 0x7f2f880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:40.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.788+0000 7f2fa659c700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2f880662f0 0x7f2f880687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000f60 tx=0x7f2f98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:40.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.792+0000 7f2f96ffd700 1 -- 172.21.15.78:0/2370791414 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2f9c052730 con 0x7f2fa815a160 2023-06-09T11:12:40.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.968+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fa8067610 con 0x7f2fa815a160 2023-06-09T11:12:40.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.968+0000 7f2f96ffd700 1 -- 172.21.15.78:0/2370791414 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f9c003e60 con 0x7f2fa815a160 2023-06-09T11:12:40.975 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:40.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2f880662f0 msgr2=0x7f2f880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2f880662f0 0x7f2f880687a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2f98000f60 tx=0x7f2f98009040 comp rx=0 tx=0).stop 2023-06-09T11:12:40.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815a160 msgr2=0x7f2fa814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:40.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815a160 0x7f2fa814fa80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c000c00 tx=0x7f2f9c004770 comp rx=0 tx=0).stop 2023-06-09T11:12:40.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 shutdown_connections 2023-06-09T11:12:40.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2f880662f0 0x7f2f880687a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fa815cb30 0x7f2fa81541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa815a160 0x7f2fa814fa80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 --2- 172.21.15.78:0/2370791414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fa8070890 0x7f2fa8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:40.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 >> 172.21.15.78:0/2370791414 conn(0x7f2fa80cf930 msgr2=0x7f2fa80c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:40.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 shutdown_connections 2023-06-09T11:12:40.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:40.972+0000 7f2fa759e700 1 -- 172.21.15.78:0/2370791414 wait complete. 2023-06-09T11:12:41.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:41.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0c53d2700 1 Processor -- start 2023-06-09T11:12:41.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0c53d2700 1 -- start start 2023-06-09T11:12:41.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0c53d2700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb0c00cbdb0 0x7fb0c00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0c53d2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c00705f0 con 0x7fb0c015a7c0 2023-06-09T11:12:41.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0c53d2700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c0071190 con 0x7fb0c006aee0 2023-06-09T11:12:41.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0c53d2700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c006fa20 con 0x7fb0c00cbdb0 2023-06-09T11:12:41.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0beffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb0c015a7c0 0x7fb0c0070a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48404/0 (socket says 172.21.15.78:48404) 2023-06-09T11:12:41.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0beffd700 1 -- 172.21.15.78:0/3973547227 learned_addr learned my addr 172.21.15.78:0/3973547227 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:41.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.176+0000 7fb0b7fff700 1 --2- 172.21.15.78:0/3973547227 >> v2:172.21.15.187:3300/0 conn(0x7fb0c00cbdb0 0x7fb0c00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.180+0000 7fb0b7fff700 1 -- 172.21.15.78:0/3973547227 >> v1:172.21.15.187:6789/0 conn(0x7fb0c006aee0 legacy=0x7fb0c00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.180+0000 7fb0b7fff700 1 -- 172.21.15.78:0/3973547227 >> v1:172.21.15.78:6789/0 conn(0x7fb0c015a7c0 legacy=0x7fb0c0070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.180+0000 7fb0b7fff700 1 -- 172.21.15.78:0/3973547227 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c015ab90 con 0x7fb0c00cbdb0 2023-06-09T11:12:41.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.180+0000 7fb0b7fff700 1 --2- 172.21.15.78:0/3973547227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c00c9270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009850 tx=0x7fb0a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b2e8fa48f147dc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0be7fc700 1 -- 172.21.15.78:0/3973547227 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011830 con 0x7fb0c00cbdb0 2023-06-09T11:12:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0be7fc700 1 -- 172.21.15.78:0/3973547227 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8011990 con 0x7fb0c00cbdb0 2023-06-09T11:12:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0be7fc700 1 -- 172.21.15.78:0/3973547227 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011d20 con 0x7fb0c00cbdb0 2023-06-09T11:12:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0c53d2700 1 -- 172.21.15.78:0/3973547227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 msgr2=0x7fb0c00c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/3973547227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c00c9270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009850 tx=0x7fb0a8009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:41.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0c53d2700 1 -- 172.21.15.78:0/3973547227 shutdown_connections 2023-06-09T11:12:41.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/3973547227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c00c9270 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0c53d2700 1 -- 172.21.15.78:0/3973547227 >> 172.21.15.78:0/3973547227 conn(0x7fb0c00cf8b0 msgr2=0x7fb0c00cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:41.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0c53d2700 1 -- 172.21.15.78:0/3973547227 shutdown_connections 2023-06-09T11:12:41.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.184+0000 7fb0c53d2700 1 -- 172.21.15.78:0/3973547227 wait complete. 2023-06-09T11:12:41.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.188+0000 7fb0c53d2700 1 Processor -- start 2023-06-09T11:12:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.188+0000 7fb0c53d2700 1 -- start start 2023-06-09T11:12:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0c53d2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0c006aee0 0x7fb0c00c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0c53d2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c01563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0c53d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0c015a7c0 0x7fb0c00c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0c53d2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c00c6e70 con 0x7fb0c015a7c0 2023-06-09T11:12:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0c53d2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c00c70f0 con 0x7fb0c00cbdb0 2023-06-09T11:12:41.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0c53d2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c01f30c0 con 0x7fb0c006aee0 2023-06-09T11:12:41.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0c015a7c0 0x7fb0c00c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0c015a7c0 0x7fb0c00c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54592/0 (socket says 172.21.15.78:54592) 2023-06-09T11:12:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 -- 172.21.15.78:0/711461055 learned_addr learned my addr 172.21.15.78:0/711461055 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0beffd700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0c006aee0 0x7fb0c00c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0b7fff700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c01563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 -- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0c006aee0 msgr2=0x7fb0c00c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0c006aee0 0x7fb0c00c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 -- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 msgr2=0x7fb0c01563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c01563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 -- 172.21.15.78:0/711461055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80094b0 con 0x7fb0c015a7c0 2023-06-09T11:12:41.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0b7fff700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c01563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:41.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0bf7fe700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0c015a7c0 0x7fb0c00c6930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800cc50 tx=0x7fb0b800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0b77fe700 1 -- 172.21.15.78:0/711461055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8003c20 con 0x7fb0c015a7c0 2023-06-09T11:12:41.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0b77fe700 1 -- 172.21.15.78:0/711461055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b8003d80 con 0x7fb0c015a7c0 2023-06-09T11:12:41.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0b77fe700 1 -- 172.21.15.78:0/711461055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800aab0 con 0x7fb0c015a7c0 2023-06-09T11:12:41.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.192+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c006ffa0 con 0x7fb0c015a7c0 2023-06-09T11:12:41.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.196+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c006fcc0 con 0x7fb0c015a7c0 2023-06-09T11:12:41.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.196+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c0070280 con 0x7fb0c015a7c0 2023-06-09T11:12:41.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.200+0000 7fb0b77fe700 1 -- 172.21.15.78:0/711461055 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0b800ac10 con 0x7fb0c015a7c0 2023-06-09T11:12:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.200+0000 7fb0b77fe700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0a00662f0 0x7fb0a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.200+0000 7fb0b77fe700 1 -- 172.21.15.78:0/711461055 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0b8083d10 con 0x7fb0c015a7c0 2023-06-09T11:12:41.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.200+0000 7fb0beffd700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0a00662f0 0x7fb0a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.200+0000 7fb0beffd700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0a00662f0 0x7fb0a00687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005930 tx=0x7fb0b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.208+0000 7fb0b77fe700 1 -- 172.21.15.78:0/711461055 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb0b8089020 con 0x7fb0c015a7c0 2023-06-09T11:12:41.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.375+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb0c00741c0 con 0x7fb0c015a7c0 2023-06-09T11:12:41.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.375+0000 7fb0b77fe700 1 -- 172.21.15.78:0/711461055 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb0b8051100 con 0x7fb0c015a7c0 2023-06-09T11:12:41.386 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0a00662f0 msgr2=0x7fb0a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0a00662f0 0x7fb0a00687a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005930 tx=0x7fb0b0009040 comp rx=0 tx=0).stop 2023-06-09T11:12:41.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0c015a7c0 msgr2=0x7fb0c00c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0c015a7c0 0x7fb0c00c6930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800cc50 tx=0x7fb0b800cf60 comp rx=0 tx=0).stop 2023-06-09T11:12:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 shutdown_connections 2023-06-09T11:12:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb0a00662f0 0x7fb0a00687a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0c015a7c0 0x7fb0c00c6930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0c00cbdb0 0x7fb0c01563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 --2- 172.21.15.78:0/711461055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0c006aee0 0x7fb0c00c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 >> 172.21.15.78:0/711461055 conn(0x7fb0c00cf8b0 msgr2=0x7fb0c00b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:41.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 shutdown_connections 2023-06-09T11:12:41.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.379+0000 7fb0c53d2700 1 -- 172.21.15.78:0/711461055 wait complete. 2023-06-09T11:12:41.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f253a516700 1 Processor -- start 2023-06-09T11:12:41.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f253a516700 1 -- start start 2023-06-09T11:12:41.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f253a516700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f253406b6e0 0x7f2534160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f253a516700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2534161440 0x7f253406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f253a516700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253406a070 con 0x7f2534146c50 2023-06-09T11:12:41.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f253a516700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253406a310 con 0x7f253406b6e0 2023-06-09T11:12:41.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f253a516700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253406a5f0 con 0x7f2534161440 2023-06-09T11:12:41.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f2539514700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2534146c50 0x7f25340b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48416/0 (socket says 172.21.15.78:48416) 2023-06-09T11:12:41.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f2539514700 1 -- 172.21.15.78:0/1988311026 learned_addr learned my addr 172.21.15.78:0/1988311026 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:41.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f2538d13700 1 --2- 172.21.15.78:0/1988311026 >> v2:172.21.15.78:3300/0 conn(0x7f253406b6e0 0x7f2534160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.579+0000 7f2539d15700 1 --2- 172.21.15.78:0/1988311026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2534161440 0x7f253406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f2538d13700 1 -- 172.21.15.78:0/1988311026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2534161440 msgr2=0x7f253406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:41.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f2538d13700 1 --2- 172.21.15.78:0/1988311026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2534161440 0x7f253406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f2538d13700 1 -- 172.21.15.78:0/1988311026 >> v1:172.21.15.78:6789/0 conn(0x7f2534146c50 legacy=0x7f25340b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f2538d13700 1 -- 172.21.15.78:0/1988311026 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253406a8d0 con 0x7f253406b6e0 2023-06-09T11:12:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f2538d13700 1 --2- 172.21.15.78:0/1988311026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253406b6e0 0x7f2534160f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2524009850 tx=0x7f2524009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227c7fc92d6171c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f252bfff700 1 -- 172.21.15.78:0/1988311026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524011830 con 0x7f253406b6e0 2023-06-09T11:12:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f252bfff700 1 -- 172.21.15.78:0/1988311026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524011990 con 0x7f253406b6e0 2023-06-09T11:12:41.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f252bfff700 1 -- 172.21.15.78:0/1988311026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524011d40 con 0x7f253406b6e0 2023-06-09T11:12:41.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 -- 172.21.15.78:0/1988311026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253406b6e0 msgr2=0x7f2534160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 --2- 172.21.15.78:0/1988311026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253406b6e0 0x7f2534160f00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2524009850 tx=0x7f2524009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:41.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 -- 172.21.15.78:0/1988311026 shutdown_connections 2023-06-09T11:12:41.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 --2- 172.21.15.78:0/1988311026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2534161440 0x7f253406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 --2- 172.21.15.78:0/1988311026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253406b6e0 0x7f2534160f00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 -- 172.21.15.78:0/1988311026 >> 172.21.15.78:0/1988311026 conn(0x7f25340b0780 msgr2=0x7f25340b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:41.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 -- 172.21.15.78:0/1988311026 shutdown_connections 2023-06-09T11:12:41.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.583+0000 7f253a516700 1 -- 172.21.15.78:0/1988311026 wait complete. 2023-06-09T11:12:41.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 Processor -- start 2023-06-09T11:12:41.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 -- start start 2023-06-09T11:12:41.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253406b6e0 0x7f253415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2534146c50 0x7f253415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2534161440 0x7f2534145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340a8cf0 con 0x7f2534146c50 2023-06-09T11:12:41.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253415cd90 con 0x7f2534161440 2023-06-09T11:12:41.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f253a516700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253415c540 con 0x7f253406b6e0 2023-06-09T11:12:41.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2534146c50 0x7f253415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2534146c50 0x7f253415c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54610/0 (socket says 172.21.15.78:54610) 2023-06-09T11:12:41.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 -- 172.21.15.78:0/1817184736 learned_addr learned my addr 172.21.15.78:0/1817184736 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:41.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2539514700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253406b6e0 0x7f253415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2539d15700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2534161440 0x7f2534145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 -- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253406b6e0 msgr2=0x7f253415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253406b6e0 0x7f253415c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 -- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2534161440 msgr2=0x7f2534145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2534161440 0x7f2534145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.587+0000 7f2538d13700 1 -- 172.21.15.78:0/1817184736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25240094b0 con 0x7f2534146c50 2023-06-09T11:12:41.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.591+0000 7f2538d13700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2534146c50 0x7f253415c000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2524013000 tx=0x7f2524004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.591+0000 7f2529ffb700 1 -- 172.21.15.78:0/1817184736 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524004530 con 0x7f2534146c50 2023-06-09T11:12:41.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.591+0000 7f2529ffb700 1 -- 172.21.15.78:0/1817184736 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252401f070 con 0x7f2534146c50 2023-06-09T11:12:41.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.591+0000 7f2529ffb700 1 -- 172.21.15.78:0/1817184736 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524003900 con 0x7f2534146c50 2023-06-09T11:12:41.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.591+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25341618a0 con 0x7f2534146c50 2023-06-09T11:12:41.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.591+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253406abb0 con 0x7f2534146c50 2023-06-09T11:12:41.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.591+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253406b0d0 con 0x7f2534146c50 2023-06-09T11:12:41.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.595+0000 7f2529ffb700 1 -- 172.21.15.78:0/1817184736 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2524021030 con 0x7f2534146c50 2023-06-09T11:12:41.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.595+0000 7f2529ffb700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f25180662f0 0x7f25180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.595+0000 7f2529ffb700 1 -- 172.21.15.78:0/1817184736 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25240852b0 con 0x7f2534146c50 2023-06-09T11:12:41.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.595+0000 7f2539514700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f25180662f0 0x7f25180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.595+0000 7f2539514700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f25180662f0 0x7f25180687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2530005cb0 tx=0x7f2530009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.599+0000 7f2529ffb700 1 -- 172.21.15.78:0/1817184736 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2524052840 con 0x7f2534146c50 2023-06-09T11:12:41.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.775+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2534067610 con 0x7f2534146c50 2023-06-09T11:12:41.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.775+0000 7f2529ffb700 1 -- 172.21.15.78:0/1817184736 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2524055e60 con 0x7f2534146c50 2023-06-09T11:12:41.785 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:41.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f25180662f0 msgr2=0x7f25180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f25180662f0 0x7f25180687a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2530005cb0 tx=0x7f2530009040 comp rx=0 tx=0).stop 2023-06-09T11:12:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2534146c50 msgr2=0x7f253415c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2534146c50 0x7f253415c000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2524013000 tx=0x7f2524004770 comp rx=0 tx=0).stop 2023-06-09T11:12:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 shutdown_connections 2023-06-09T11:12:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f25180662f0 0x7f25180687a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2534161440 0x7f2534145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2534146c50 0x7f253415c000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 --2- 172.21.15.78:0/1817184736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253406b6e0 0x7f253415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 >> 172.21.15.78:0/1817184736 conn(0x7f25340b0780 msgr2=0x7f2534164bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:41.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 shutdown_connections 2023-06-09T11:12:41.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.779+0000 7f253a516700 1 -- 172.21.15.78:0/1817184736 wait complete. 2023-06-09T11:12:41.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:41.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.971+0000 7f45d0c8c700 1 Processor -- start 2023-06-09T11:12:41.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.975+0000 7f45d0c8c700 1 -- start start 2023-06-09T11:12:41.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.975+0000 7f45d0c8c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45cc070890 0x7f45cc070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.975+0000 7f45d0c8c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc06d730 con 0x7f45cc15cb30 2023-06-09T11:12:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.975+0000 7f45d0c8c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc0711d0 con 0x7f45cc15a160 2023-06-09T11:12:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.975+0000 7f45d0c8c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc0d1190 con 0x7f45cc070890 2023-06-09T11:12:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45cbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45cc070890 0x7f45cc070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45caffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f45cc15cb30 0x7f45cc0d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48424/0 (socket says 172.21.15.78:48424) 2023-06-09T11:12:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45caffd700 1 -- 172.21.15.78:0/4099915249 learned_addr learned my addr 172.21.15.78:0/4099915249 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45ca7fc700 1 -- 172.21.15.78:0/4099915249 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524412919 0 0) 0x7f45cc06d730 con 0x7f45cc15cb30 2023-06-09T11:12:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45ca7fc700 1 -- 172.21.15.78:0/4099915249 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b40035d0 con 0x7f45cc15cb30 2023-06-09T11:12:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45cbfff700 1 -- 172.21.15.78:0/4099915249 >> v1:172.21.15.187:6789/0 conn(0x7f45cc15a160 legacy=0x7f45cc0d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45cbfff700 1 -- 172.21.15.78:0/4099915249 >> v1:172.21.15.78:6789/0 conn(0x7f45cc15cb30 legacy=0x7f45cc0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45cbfff700 1 -- 172.21.15.78:0/4099915249 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc15a530 con 0x7f45cc070890 2023-06-09T11:12:41.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45cbfff700 1 --2- 172.21.15.78:0/4099915249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc070890 0x7f45cc070c90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009d90 tx=0x7f45c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d65eac826b0202 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45ca7fc700 1 -- 172.21.15.78:0/4099915249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400e070 con 0x7f45cc070890 2023-06-09T11:12:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45ca7fc700 1 -- 172.21.15.78:0/4099915249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c400bb20 con 0x7f45cc070890 2023-06-09T11:12:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45ca7fc700 1 -- 172.21.15.78:0/4099915249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400be90 con 0x7f45cc070890 2023-06-09T11:12:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45d0c8c700 1 -- 172.21.15.78:0/4099915249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc070890 msgr2=0x7f45cc070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/4099915249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc070890 0x7f45cc070c90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009d90 tx=0x7f45c400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45d0c8c700 1 -- 172.21.15.78:0/4099915249 shutdown_connections 2023-06-09T11:12:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/4099915249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc070890 0x7f45cc070c90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45d0c8c700 1 -- 172.21.15.78:0/4099915249 >> 172.21.15.78:0/4099915249 conn(0x7f45cc0cf930 msgr2=0x7f45cc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45d0c8c700 1 -- 172.21.15.78:0/4099915249 shutdown_connections 2023-06-09T11:12:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.979+0000 7f45d0c8c700 1 -- 172.21.15.78:0/4099915249 wait complete. 2023-06-09T11:12:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.983+0000 7f45d0c8c700 1 Processor -- start 2023-06-09T11:12:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.983+0000 7f45d0c8c700 1 -- start start 2023-06-09T11:12:41.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45cc070890 0x7f45cc157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc15a160 0x7f45cc14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45cc15cb30 0x7f45cc0b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:41.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc156f40 con 0x7f45cc15a160 2023-06-09T11:12:41.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc14eb10 con 0x7f45cc15cb30 2023-06-09T11:12:41.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0b88e0 con 0x7f45cc070890 2023-06-09T11:12:41.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc15a160 0x7f45cc14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc15a160 0x7f45cc14e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54640/0 (socket says 172.21.15.78:54640) 2023-06-09T11:12:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 -- 172.21.15.78:0/505633996 learned_addr learned my addr 172.21.15.78:0/505633996 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45cb7fe700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45cc070890 0x7f45cc157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45cbfff700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45cc15cb30 0x7f45cc0b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 -- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45cc070890 msgr2=0x7f45cc157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45cc070890 0x7f45cc157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 -- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45cc15cb30 msgr2=0x7f45cc0b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45cc15cb30 0x7f45cc0b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 -- 172.21.15.78:0/505633996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4009a70 con 0x7f45cc15a160 2023-06-09T11:12:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45cbfff700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45cc15cb30 0x7f45cc0b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45caffd700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc15a160 0x7f45cc14e5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f45c000c700 tx=0x7f45c000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45b3fff700 1 -- 172.21.15.78:0/505633996 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0005d90 con 0x7f45cc15a160 2023-06-09T11:12:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc15d460 con 0x7f45cc15a160 2023-06-09T11:12:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc15d180 con 0x7f45cc15a160 2023-06-09T11:12:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45b3fff700 1 -- 172.21.15.78:0/505633996 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c00070d0 con 0x7f45cc15a160 2023-06-09T11:12:41.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.987+0000 7f45b3fff700 1 -- 172.21.15.78:0/505633996 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0007440 con 0x7f45cc15a160 2023-06-09T11:12:41.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.991+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac005310 con 0x7f45cc15a160 2023-06-09T11:12:42.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.991+0000 7f45b3fff700 1 -- 172.21.15.78:0/505633996 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45c00075a0 con 0x7f45cc15a160 2023-06-09T11:12:42.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.991+0000 7f45b3fff700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45b80662f0 0x7f45b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:42.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.995+0000 7f45b3fff700 1 -- 172.21.15.78:0/505633996 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45c0083240 con 0x7f45cc15a160 2023-06-09T11:12:42.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.995+0000 7f45cb7fe700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45b80662f0 0x7f45b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:42.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.995+0000 7f45cb7fe700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45b80662f0 0x7f45b80687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45bc000f60 tx=0x7f45bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:41.999+0000 7f45b3fff700 1 -- 172.21.15.78:0/505633996 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f45c00506e0 con 0x7f45cc15a160 2023-06-09T11:12:42.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.171+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45ac005b40 con 0x7f45cc15a160 2023-06-09T11:12:42.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.171+0000 7f45b3fff700 1 -- 172.21.15.78:0/505633996 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45c0053d00 con 0x7f45cc15a160 2023-06-09T11:12:42.180 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:42.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45b80662f0 msgr2=0x7f45b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:42.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45b80662f0 0x7f45b80687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45bc000f60 tx=0x7f45bc009040 comp rx=0 tx=0).stop 2023-06-09T11:12:42.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc15a160 msgr2=0x7f45cc14e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:42.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc15a160 0x7f45cc14e5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f45c000c700 tx=0x7f45c000cac0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 shutdown_connections 2023-06-09T11:12:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f45b80662f0 0x7f45b80687a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45cc15cb30 0x7f45cc0b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45cc15a160 0x7f45cc14e5d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 --2- 172.21.15.78:0/505633996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45cc070890 0x7f45cc157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 >> 172.21.15.78:0/505633996 conn(0x7f45cc0cf930 msgr2=0x7f45cc06dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 shutdown_connections 2023-06-09T11:12:42.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.175+0000 7f45d0c8c700 1 -- 172.21.15.78:0/505633996 wait complete. 2023-06-09T11:12:42.217 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T11:12:42.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-09T11:12:42.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.387+0000 7f9b59964700 1 Processor -- start 2023-06-09T11:12:42.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.387+0000 7f9b59964700 1 -- start start 2023-06-09T11:12:42.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.387+0000 7f9b59964700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b54156f60 0x7f9b5406e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:42.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b540ce220 0x7f9b54159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:42.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5406e0f0 con 0x7f9b5406eac0 2023-06-09T11:12:42.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b54157330 con 0x7f9b540ce220 2023-06-09T11:12:42.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5415a460 con 0x7f9b54156f60 2023-06-09T11:12:42.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59163700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b540ce220 0x7f9b54159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:42.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b58962700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b54156f60 0x7f9b5406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:42.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b58962700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b54156f60 0x7f9b5406e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:48576/0 (socket says 172.21.15.78:48576) 2023-06-09T11:12:42.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b58962700 1 -- 172.21.15.78:0/417721583 learned_addr learned my addr 172.21.15.78:0/417721583 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b4bfff700 1 --1- 172.21.15.78:0/417721583 >> v1:172.21.15.78:6789/0 conn(0x7f9b5406eac0 0x7f9b540cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48436/0 (socket says 172.21.15.78:48436) 2023-06-09T11:12:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59163700 1 -- 172.21.15.78:0/417721583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b54156f60 msgr2=0x7f9b5406e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59163700 1 --2- 172.21.15.78:0/417721583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b54156f60 0x7f9b5406e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59163700 1 -- 172.21.15.78:0/417721583 >> v1:172.21.15.78:6789/0 conn(0x7f9b5406eac0 legacy=0x7f9b540cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:42.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59163700 1 -- 172.21.15.78:0/417721583 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5415a740 con 0x7f9b540ce220 2023-06-09T11:12:42.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59163700 1 --2- 172.21.15.78:0/417721583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ce220 0x7f9b54159850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009d90 tx=0x7f9b4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c856be3a4dfe98 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:42.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b4b7fe700 1 -- 172.21.15.78:0/417721583 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00e070 con 0x7f9b540ce220 2023-06-09T11:12:42.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b4b7fe700 1 -- 172.21.15.78:0/417721583 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00bb20 con 0x7f9b540ce220 2023-06-09T11:12:42.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b4b7fe700 1 -- 172.21.15.78:0/417721583 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c012430 con 0x7f9b540ce220 2023-06-09T11:12:42.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- 172.21.15.78:0/417721583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ce220 msgr2=0x7f9b54159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:42.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 --2- 172.21.15.78:0/417721583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ce220 0x7f9b54159850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009d90 tx=0x7f9b4c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:42.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- 172.21.15.78:0/417721583 shutdown_connections 2023-06-09T11:12:42.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 --2- 172.21.15.78:0/417721583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ce220 0x7f9b54159850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 --2- 172.21.15.78:0/417721583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b54156f60 0x7f9b5406e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- 172.21.15.78:0/417721583 >> 172.21.15.78:0/417721583 conn(0x7f9b540b1650 msgr2=0x7f9b540cee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:42.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- 172.21.15.78:0/417721583 shutdown_connections 2023-06-09T11:12:42.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.391+0000 7f9b59964700 1 -- 172.21.15.78:0/417721583 wait complete. 2023-06-09T11:12:42.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.395+0000 7f9b59964700 1 Processor -- start 2023-06-09T11:12:42.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.395+0000 7f9b59964700 1 -- start start 2023-06-09T11:12:42.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5406eac0 0x7f9b5414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:42.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b540ce220 0x7f9b540b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:42.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156f60 0x7f9b540b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540b2420 con 0x7f9b54156f60 2023-06-09T11:12:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5414ddd0 con 0x7f9b5406eac0 2023-06-09T11:12:42.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540b4530 con 0x7f9b540ce220 2023-06-09T11:12:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156f60 0x7f9b540b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156f60 0x7f9b540b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54650/0 (socket says 172.21.15.78:54650) 2023-06-09T11:12:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 -- 172.21.15.78:0/1191700950 learned_addr learned my addr 172.21.15.78:0/1191700950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b4bfff700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b540ce220 0x7f9b540b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:42.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b58962700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5406eac0 0x7f9b5414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 -- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b540ce220 msgr2=0x7f9b540b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b540ce220 0x7f9b540b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 -- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5406eac0 msgr2=0x7f9b5414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5406eac0 0x7f9b5414c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 -- 172.21.15.78:0/1191700950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c009a70 con 0x7f9b54156f60 2023-06-09T11:12:42.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59163700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156f60 0x7f9b540b3b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c014040 tx=0x7f9b4c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b497fa700 1 -- 172.21.15.78:0/1191700950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c012430 con 0x7f9b54156f60 2023-06-09T11:12:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5406dd80 con 0x7f9b54156f60 2023-06-09T11:12:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b497fa700 1 -- 172.21.15.78:0/1191700950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c020070 con 0x7f9b54156f60 2023-06-09T11:12:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b497fa700 1 -- 172.21.15.78:0/1191700950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0098f0 con 0x7f9b54156f60 2023-06-09T11:12:42.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.399+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5406daa0 con 0x7f9b54156f60 2023-06-09T11:12:42.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.403+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b540ccd00 con 0x7f9b54156f60 2023-06-09T11:12:42.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.403+0000 7f9b497fa700 1 -- 172.21.15.78:0/1191700950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b4c004040 con 0x7f9b54156f60 2023-06-09T11:12:42.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.403+0000 7f9b497fa700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9b400662f0 0x7f9b400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:42.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.403+0000 7f9b497fa700 1 -- 172.21.15.78:0/1191700950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b4c022070 con 0x7f9b54156f60 2023-06-09T11:12:42.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.407+0000 7f9b58962700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9b400662f0 0x7f9b400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:42.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.407+0000 7f9b58962700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9b400662f0 0x7f9b400687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009b50 tx=0x7f9b500092e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:42.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.411+0000 7f9b497fa700 1 -- 172.21.15.78:0/1191700950 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9b4c052d90 con 0x7f9b54156f60 2023-06-09T11:12:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:42.639+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f9b5406d6f0 con 0x7f9b54156f60 2023-06-09T11:12:43.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b497fa700 1 -- 172.21.15.78:0/1191700950 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v57) v1 ==== 147+0+0 (secure 0 0 0) 0x7f9b4c0563b0 con 0x7f9b54156f60 2023-06-09T11:12:43.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9b400662f0 msgr2=0x7f9b400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:43.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9b400662f0 0x7f9b400687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009b50 tx=0x7f9b500092e0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156f60 msgr2=0x7f9b540b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:43.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156f60 0x7f9b540b3b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c014040 tx=0x7f9b4c004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 shutdown_connections 2023-06-09T11:12:43.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9b400662f0 0x7f9b400687a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b54156f60 0x7f9b540b3b80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b540ce220 0x7f9b540b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 --2- 172.21.15.78:0/1191700950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5406eac0 0x7f9b5414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.335+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 >> 172.21.15.78:0/1191700950 conn(0x7f9b540b1650 msgr2=0x7f9b54150710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:43.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.339+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 shutdown_connections 2023-06-09T11:12:43.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.339+0000 7f9b59964700 1 -- 172.21.15.78:0/1191700950 wait complete. 2023-06-09T11:12:43.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-09T11:12:43.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.543+0000 7f700e55d700 1 Processor -- start 2023-06-09T11:12:43.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.543+0000 7f700e55d700 1 -- start start 2023-06-09T11:12:43.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700e55d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7008146c50 0x7f70080b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:43.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700e55d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f700806b6e0 0x7f7008160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:43.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700e55d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f7008164510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:43.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700e55d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700806a070 con 0x7f7008146c50 2023-06-09T11:12:43.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700e55d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700806a310 con 0x7f700806b6e0 2023-06-09T11:12:43.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700e55d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700806a5f0 con 0x7f7008161440 2023-06-09T11:12:43.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7008146c50 0x7f70080b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:43.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7008146c50 0x7f70080b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54666/0 (socket says 172.21.15.78:54666) 2023-06-09T11:12:43.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 -- 172.21.15.78:0/1179497966 learned_addr learned my addr 172.21.15.78:0/1179497966 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:43.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700dd5c700 1 --2- 172.21.15.78:0/1179497966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f7008164510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:43.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700cd5a700 1 --2- 172.21.15.78:0/1179497966 >> v2:172.21.15.187:3300/0 conn(0x7f700806b6e0 0x7f7008160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:43.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 -- 172.21.15.78:0/1179497966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 msgr2=0x7f7008164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:43.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 --2- 172.21.15.78:0/1179497966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f7008164510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 -- 172.21.15.78:0/1179497966 >> v2:172.21.15.187:3300/0 conn(0x7f700806b6e0 msgr2=0x7f7008160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:43.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 --2- 172.21.15.78:0/1179497966 >> v2:172.21.15.187:3300/0 conn(0x7f700806b6e0 0x7f7008160f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 -- 172.21.15.78:0/1179497966 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700806a8d0 con 0x7f7008146c50 2023-06-09T11:12:43.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f700d55b700 1 --2- 172.21.15.78:0/1179497966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7008146c50 0x7f70080b2590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70080b1740 tx=0x7f7004009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae1b1a603271246 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:43.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f6ffffff700 1 -- 172.21.15.78:0/1179497966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004011830 con 0x7f7008146c50 2023-06-09T11:12:43.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f6ffffff700 1 -- 172.21.15.78:0/1179497966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004011990 con 0x7f7008146c50 2023-06-09T11:12:43.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.547+0000 7f6ffffff700 1 -- 172.21.15.78:0/1179497966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004011d20 con 0x7f7008146c50 2023-06-09T11:12:43.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 -- 172.21.15.78:0/1179497966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7008146c50 msgr2=0x7f70080b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:43.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 --2- 172.21.15.78:0/1179497966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7008146c50 0x7f70080b2590 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70080b1740 tx=0x7f7004009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 -- 172.21.15.78:0/1179497966 shutdown_connections 2023-06-09T11:12:43.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 --2- 172.21.15.78:0/1179497966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f7008164510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 --2- 172.21.15.78:0/1179497966 >> v2:172.21.15.187:3300/0 conn(0x7f700806b6e0 0x7f7008160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 --2- 172.21.15.78:0/1179497966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7008146c50 0x7f70080b2590 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 -- 172.21.15.78:0/1179497966 >> 172.21.15.78:0/1179497966 conn(0x7f70080b0780 msgr2=0x7f70080b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:43.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 -- 172.21.15.78:0/1179497966 shutdown_connections 2023-06-09T11:12:43.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 -- 172.21.15.78:0/1179497966 wait complete. 2023-06-09T11:12:43.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 Processor -- start 2023-06-09T11:12:43.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.551+0000 7f700e55d700 1 -- start start 2023-06-09T11:12:43.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f700806b6e0 0x7f7008157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:43.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7008146c50 0x7f7008142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:43.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f700815f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:43.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7008157430 con 0x7f700806b6e0 2023-06-09T11:12:43.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700815cb90 con 0x7f7008146c50 2023-06-09T11:12:43.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7008156820 con 0x7f7008161440 2023-06-09T11:12:43.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f700806b6e0 0x7f7008157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:43.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f700806b6e0 0x7f7008157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54668/0 (socket says 172.21.15.78:54668) 2023-06-09T11:12:43.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 -- 172.21.15.78:0/602994062 learned_addr learned my addr 172.21.15.78:0/602994062 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:43.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700dd5c700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f700815f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700cd5a700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7008146c50 0x7f7008142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 -- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 msgr2=0x7f700815f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f700815f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 -- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7008146c50 msgr2=0x7f7008142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7008146c50 0x7f7008142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 -- 172.21.15.78:0/602994062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004009570 con 0x7f700806b6e0 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700dd5c700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f700815f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:43.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700d55b700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f700806b6e0 0x7f7008157b90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f70080b1840 tx=0x7f7004004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:43.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f6ffdffb700 1 -- 172.21.15.78:0/602994062 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040044d0 con 0x7f700806b6e0 2023-06-09T11:12:43.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f6ffdffb700 1 -- 172.21.15.78:0/602994062 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700401f070 con 0x7f700806b6e0 2023-06-09T11:12:43.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70081618a0 con 0x7f700806b6e0 2023-06-09T11:12:43.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f6ffdffb700 1 -- 172.21.15.78:0/602994062 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004003900 con 0x7f700806b6e0 2023-06-09T11:12:43.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.555+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700806abb0 con 0x7f700806b6e0 2023-06-09T11:12:43.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.559+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700806b0d0 con 0x7f700806b6e0 2023-06-09T11:12:43.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.559+0000 7f6ffdffb700 1 -- 172.21.15.78:0/602994062 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7004003a60 con 0x7f700806b6e0 2023-06-09T11:12:43.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.559+0000 7f6ffdffb700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6fec0662f0 0x7f6fec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:43.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.563+0000 7f6ffdffb700 1 -- 172.21.15.78:0/602994062 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7004021070 con 0x7f700806b6e0 2023-06-09T11:12:43.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.563+0000 7f700cd5a700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6fec0662f0 0x7f6fec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:43.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.563+0000 7f700cd5a700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6fec0662f0 0x7f6fec0687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7008159920 tx=0x7f6ff8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:43.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.567+0000 7f6ffdffb700 1 -- 172.21.15.78:0/602994062 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7004052620 con 0x7f700806b6e0 2023-06-09T11:12:43.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.747+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7008067610 con 0x7f700806b6e0 2023-06-09T11:12:43.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.755+0000 7f6ffdffb700 1 -- 172.21.15.78:0/602994062 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7004055c40 con 0x7f700806b6e0 2023-06-09T11:12:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6fec0662f0 msgr2=0x7f6fec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6fec0662f0 0x7f6fec0687a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7008159920 tx=0x7f6ff8008040 comp rx=0 tx=0).stop 2023-06-09T11:12:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f700806b6e0 msgr2=0x7f7008157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f700806b6e0 0x7f7008157b90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f70080b1840 tx=0x7f7004004770 comp rx=0 tx=0).stop 2023-06-09T11:12:43.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 shutdown_connections 2023-06-09T11:12:43.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6fec0662f0 0x7f6fec0687a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008161440 0x7f700815f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7008146c50 0x7f7008142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 --2- 172.21.15.78:0/602994062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f700806b6e0 0x7f7008157b90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 >> 172.21.15.78:0/602994062 conn(0x7f70080b0780 msgr2=0x7f70080b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 shutdown_connections 2023-06-09T11:12:43.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:43.759+0000 7f700e55d700 1 -- 172.21.15.78:0/602994062 wait complete. 2023-06-09T11:12:43.792 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-09T11:12:43.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T11:12:43.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T11:12:43.880 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-09T11:12:43.880 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:43.881 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:43.901 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:43.903 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:43.966 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:43.967 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:43.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:44.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.199+0000 7fb86b2d1700 1 Processor -- start 2023-06-09T11:12:44.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.199+0000 7fb86b2d1700 1 -- start start 2023-06-09T11:12:44.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb86b2d1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb864165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb86b2d1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640cc810 con 0x7fb8640c1ce0 2023-06-09T11:12:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb86b2d1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb864160ff0 con 0x7fb86406dfe0 2023-06-09T11:12:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb86b2d1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640cca60 con 0x7fb864160c20 2023-06-09T11:12:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb86886c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb8640c1ce0 0x7fb86406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48438/0 (socket says 172.21.15.78:48438) 2023-06-09T11:12:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb86886c700 1 -- 172.21.15.78:0/1479216363 learned_addr learned my addr 172.21.15.78:0/1479216363 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:44.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb86906d700 1 --2- 172.21.15.78:0/1479216363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb864165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb863fff700 1 -- 172.21.15.78:0/1479216363 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412084188 0 0) 0x7fb8640cc810 con 0x7fb8640c1ce0 2023-06-09T11:12:44.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.203+0000 7fb863fff700 1 -- 172.21.15.78:0/1479216363 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb84c0035d0 con 0x7fb8640c1ce0 2023-06-09T11:12:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb863fff700 1 -- 172.21.15.78:0/1479216363 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2727354601 0 0) 0x7fb84c0035d0 con 0x7fb8640c1ce0 2023-06-09T11:12:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86906d700 1 -- 172.21.15.78:0/1479216363 >> v1:172.21.15.187:6789/0 conn(0x7fb86406dfe0 legacy=0x7fb86406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86906d700 1 -- 172.21.15.78:0/1479216363 >> v1:172.21.15.78:6789/0 conn(0x7fb8640c1ce0 legacy=0x7fb86406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86906d700 1 -- 172.21.15.78:0/1479216363 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640ccd40 con 0x7fb864160c20 2023-06-09T11:12:44.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86906d700 1 --2- 172.21.15.78:0/1479216363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb864165160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb854009880 tx=0x7fb854009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ba3ccc02f4468e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb863fff700 1 -- 172.21.15.78:0/1479216363 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858001670 con 0x7fb864160c20 2023-06-09T11:12:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb863fff700 1 -- 172.21.15.78:0/1479216363 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854004030 con 0x7fb864160c20 2023-06-09T11:12:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb863fff700 1 -- 172.21.15.78:0/1479216363 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8540043c0 con 0x7fb864160c20 2023-06-09T11:12:44.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86b2d1700 1 -- 172.21.15.78:0/1479216363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 msgr2=0x7fb864165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/1479216363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb864165160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb854009880 tx=0x7fb854009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86b2d1700 1 -- 172.21.15.78:0/1479216363 shutdown_connections 2023-06-09T11:12:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/1479216363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb864165160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86b2d1700 1 -- 172.21.15.78:0/1479216363 >> 172.21.15.78:0/1479216363 conn(0x7fb8640b1480 msgr2=0x7fb8640cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86b2d1700 1 -- 172.21.15.78:0/1479216363 shutdown_connections 2023-06-09T11:12:44.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.207+0000 7fb86b2d1700 1 -- 172.21.15.78:0/1479216363 wait complete. 2023-06-09T11:12:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 Processor -- start 2023-06-09T11:12:44.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 -- start start 2023-06-09T11:12:44.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb86406dfe0 0x7fb8640c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8640c1ce0 0x7fb8640c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb8640c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c7950 con 0x7fb86406dfe0 2023-06-09T11:12:44.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8641fa760 con 0x7fb8640c1ce0 2023-06-09T11:12:44.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86b2d1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c3ac0 con 0x7fb864160c20 2023-06-09T11:12:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb86406dfe0 0x7fb8640c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb86406dfe0 0x7fb8640c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54672/0 (socket says 172.21.15.78:54672) 2023-06-09T11:12:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 -- 172.21.15.78:0/2984888191 learned_addr learned my addr 172.21.15.78:0/2984888191 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86886c700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8640c1ce0 0x7fb8640c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86986e700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb8640c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 -- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 msgr2=0x7fb8640c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb8640c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 -- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8640c1ce0 msgr2=0x7fb8640c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8640c1ce0 0x7fb8640c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 -- 172.21.15.78:0/2984888191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540094b0 con 0x7fb86406dfe0 2023-06-09T11:12:44.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86886c700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8640c1ce0 0x7fb8640c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:44.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.211+0000 7fb86906d700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb86406dfe0 0x7fb8640c7410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097d0 tx=0x7fb854004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:44.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.215+0000 7fb861ffb700 1 -- 172.21.15.78:0/2984888191 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854003d40 con 0x7fb86406dfe0 2023-06-09T11:12:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.215+0000 7fb861ffb700 1 -- 172.21.15.78:0/2984888191 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854011630 con 0x7fb86406dfe0 2023-06-09T11:12:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.215+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8640cd300 con 0x7fb86406dfe0 2023-06-09T11:12:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.215+0000 7fb861ffb700 1 -- 172.21.15.78:0/2984888191 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854003ea0 con 0x7fb86406dfe0 2023-06-09T11:12:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.215+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640cd020 con 0x7fb86406dfe0 2023-06-09T11:12:44.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.215+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86406eaa0 con 0x7fb86406dfe0 2023-06-09T11:12:44.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.219+0000 7fb861ffb700 1 -- 172.21.15.78:0/2984888191 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb854018050 con 0x7fb86406dfe0 2023-06-09T11:12:44.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.219+0000 7fb861ffb700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb8500662f0 0x7fb8500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.219+0000 7fb861ffb700 1 -- 172.21.15.78:0/2984888191 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb854084800 con 0x7fb86406dfe0 2023-06-09T11:12:44.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.219+0000 7fb86886c700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb8500662f0 0x7fb8500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.219+0000 7fb86886c700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb8500662f0 0x7fb8500687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb858001eb0 tx=0x7fb858001d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:44.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.223+0000 7fb861ffb700 1 -- 172.21.15.78:0/2984888191 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb854051d90 con 0x7fb86406dfe0 2023-06-09T11:12:44.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.403+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8640741c0 con 0x7fb86406dfe0 2023-06-09T11:12:44.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.403+0000 7fb861ffb700 1 -- 172.21.15.78:0/2984888191 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7fb8540553b0 con 0x7fb86406dfe0 2023-06-09T11:12:44.414 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:44.414 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:44.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb8500662f0 msgr2=0x7fb8500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb8500662f0 0x7fb8500687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb858001eb0 tx=0x7fb858001d20 comp rx=0 tx=0).stop 2023-06-09T11:12:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb86406dfe0 msgr2=0x7fb8640c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb86406dfe0 0x7fb8640c7410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb8540097d0 tx=0x7fb854004770 comp rx=0 tx=0).stop 2023-06-09T11:12:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 shutdown_connections 2023-06-09T11:12:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb8500662f0 0x7fb8500687a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb864160c20 0x7fb8640c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8640c1ce0 0x7fb8640c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 --2- 172.21.15.78:0/2984888191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb86406dfe0 0x7fb8640c7410 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 >> 172.21.15.78:0/2984888191 conn(0x7fb8640b1480 msgr2=0x7fb8640708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:44.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 shutdown_connections 2023-06-09T11:12:44.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.411+0000 7fb86b2d1700 1 -- 172.21.15.78:0/2984888191 wait complete. 2023-06-09T11:12:44.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:44.440 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:44.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.611+0000 7ff38882f700 1 Processor -- start 2023-06-09T11:12:44.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.611+0000 7ff38882f700 1 -- start start 2023-06-09T11:12:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.611+0000 7ff38882f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3840ce3d0 0x7ff38415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.611+0000 7ff38882f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38415d290 con 0x7ff384156d50 2023-06-09T11:12:44.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.611+0000 7ff38882f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840ce850 con 0x7ff3840b2da0 2023-06-09T11:12:44.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.611+0000 7ff38882f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff384159760 con 0x7ff3840ce3d0 2023-06-09T11:12:44.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff3837fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff384156d50 0x7ff384159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48452/0 (socket says 172.21.15.78:48452) 2023-06-09T11:12:44.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff3837fe700 1 -- 172.21.15.78:0/807742492 learned_addr learned my addr 172.21.15.78:0/807742492 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:44.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff382ffd700 1 --2- 172.21.15.78:0/807742492 >> v2:172.21.15.78:3300/0 conn(0x7ff3840ce3d0 0x7ff38415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff382ffd700 1 -- 172.21.15.78:0/807742492 >> v1:172.21.15.187:6789/0 conn(0x7ff3840b2da0 legacy=0x7ff3840b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff3827fc700 1 -- 172.21.15.78:0/807742492 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133548461 0 0) 0x7ff38415d290 con 0x7ff384156d50 2023-06-09T11:12:44.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff382ffd700 1 -- 172.21.15.78:0/807742492 >> v1:172.21.15.78:6789/0 conn(0x7ff384156d50 legacy=0x7ff384159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff382ffd700 1 -- 172.21.15.78:0/807742492 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38415d4c0 con 0x7ff3840ce3d0 2023-06-09T11:12:44.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff382ffd700 1 --2- 172.21.15.78:0/807742492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3840ce3d0 0x7ff38415cd50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff378009850 tx=0x7ff378009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449e2296c16a4ffc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:44.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff3827fc700 1 -- 172.21.15.78:0/807742492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37800f8a0 con 0x7ff3840ce3d0 2023-06-09T11:12:44.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff3827fc700 1 -- 172.21.15.78:0/807742492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37800fa00 con 0x7ff3840ce3d0 2023-06-09T11:12:44.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff3827fc700 1 -- 172.21.15.78:0/807742492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37800fd90 con 0x7ff3840ce3d0 2023-06-09T11:12:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff38882f700 1 -- 172.21.15.78:0/807742492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3840ce3d0 msgr2=0x7ff38415cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff38882f700 1 --2- 172.21.15.78:0/807742492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3840ce3d0 0x7ff38415cd50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff378009850 tx=0x7ff378009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:44.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff38882f700 1 -- 172.21.15.78:0/807742492 shutdown_connections 2023-06-09T11:12:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff38882f700 1 --2- 172.21.15.78:0/807742492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3840ce3d0 0x7ff38415cd50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.615+0000 7ff38882f700 1 -- 172.21.15.78:0/807742492 >> 172.21.15.78:0/807742492 conn(0x7ff3840b0780 msgr2=0x7ff3840b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.619+0000 7ff38882f700 1 -- 172.21.15.78:0/807742492 shutdown_connections 2023-06-09T11:12:44.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.619+0000 7ff38882f700 1 -- 172.21.15.78:0/807742492 wait complete. 2023-06-09T11:12:44.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.619+0000 7ff38882f700 1 Processor -- start 2023-06-09T11:12:44.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.619+0000 7ff38882f700 1 -- start start 2023-06-09T11:12:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3840b2da0 0x7ff3840c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3840ce3d0 0x7ff3841526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff384156d50 0x7ff384152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384153150 con 0x7ff384156d50 2023-06-09T11:12:44.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841488e0 con 0x7ff3840ce3d0 2023-06-09T11:12:44.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff384151910 con 0x7ff3840b2da0 2023-06-09T11:12:44.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff384156d50 0x7ff384152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff384156d50 0x7ff384152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54688/0 (socket says 172.21.15.78:54688) 2023-06-09T11:12:44.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 -- 172.21.15.78:0/2877208343 learned_addr learned my addr 172.21.15.78:0/2877208343 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:44.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff382ffd700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3840ce3d0 0x7ff3841526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff3837fe700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3840b2da0 0x7ff3840c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 -- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3840b2da0 msgr2=0x7ff3840c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3840b2da0 0x7ff3840c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 -- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3840ce3d0 msgr2=0x7ff3841526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3840ce3d0 0x7ff3841526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 -- 172.21.15.78:0/2877208343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780094b0 con 0x7ff384156d50 2023-06-09T11:12:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff383fff700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff384156d50 0x7ff384152c10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00cbc0 tx=0x7ff37c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:44.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff36bfff700 1 -- 172.21.15.78:0/2877208343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c003c20 con 0x7ff384156d50 2023-06-09T11:12:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff36bfff700 1 -- 172.21.15.78:0/2877208343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c003d80 con 0x7ff384156d50 2023-06-09T11:12:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38415da80 con 0x7ff384156d50 2023-06-09T11:12:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff36bfff700 1 -- 172.21.15.78:0/2877208343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c00aae0 con 0x7ff384156d50 2023-06-09T11:12:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.623+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38415d7a0 con 0x7ff384156d50 2023-06-09T11:12:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.627+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff384159950 con 0x7ff384156d50 2023-06-09T11:12:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.627+0000 7ff36bfff700 1 -- 172.21.15.78:0/2877208343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff37c00ac40 con 0x7ff384156d50 2023-06-09T11:12:44.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.627+0000 7ff36bfff700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff3700662f0 0x7ff3700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:44.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.627+0000 7ff36bfff700 1 -- 172.21.15.78:0/2877208343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff37c083ad0 con 0x7ff384156d50 2023-06-09T11:12:44.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.631+0000 7ff3837fe700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff3700662f0 0x7ff3700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:44.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.631+0000 7ff3837fe700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff3700662f0 0x7ff3700687a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff374000f60 tx=0x7ff374007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.631+0000 7ff36bfff700 1 -- 172.21.15.78:0/2877208343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff37c050f40 con 0x7ff384156d50 2023-06-09T11:12:44.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3840b3c50 con 0x7ff384156d50 2023-06-09T11:12:44.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff36bfff700 1 -- 172.21.15.78:0/2877208343 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff37c054560 con 0x7ff384156d50 2023-06-09T11:12:44.807 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff3700662f0 msgr2=0x7ff3700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff3700662f0 0x7ff3700687a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff374000f60 tx=0x7ff374007c40 comp rx=0 tx=0).stop 2023-06-09T11:12:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff384156d50 msgr2=0x7ff384152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff384156d50 0x7ff384152c10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00cbc0 tx=0x7ff37c00ced0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 shutdown_connections 2023-06-09T11:12:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff3700662f0 0x7ff3700687a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff384156d50 0x7ff384152c10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3840ce3d0 0x7ff3841526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 --2- 172.21.15.78:0/2877208343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3840b2da0 0x7ff3840c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.799+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 >> 172.21.15.78:0/2877208343 conn(0x7ff3840b0780 msgr2=0x7ff3840b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.803+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 shutdown_connections 2023-06-09T11:12:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.803+0000 7ff38882f700 1 -- 172.21.15.78:0/2877208343 wait complete. 2023-06-09T11:12:44.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:45.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.995+0000 7fd5d1891700 1 Processor -- start 2023-06-09T11:12:45.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.995+0000 7fd5d1891700 1 -- start start 2023-06-09T11:12:45.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5d1891700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc15a160 0x7fd5cc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5d1891700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5cc070890 0x7fd5cc070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5d1891700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc06d730 con 0x7fd5cc0d26d0 2023-06-09T11:12:45.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5d1891700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0d1190 con 0x7fd5cc070890 2023-06-09T11:12:45.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5d1891700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc071250 con 0x7fd5cc15a160 2023-06-09T11:12:45.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5cc070890 0x7fd5cc070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5cc070890 0x7fd5cc070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52050/0 (socket says 172.21.15.78:52050) 2023-06-09T11:12:45.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1995046890 learned_addr learned my addr 172.21.15.78:0/1995046890 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:45.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5caffd700 1 --2- 172.21.15.78:0/1995046890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc15a160 0x7fd5cc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1995046890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc15a160 msgr2=0x7fd5cc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:45.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 --2- 172.21.15.78:0/1995046890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc15a160 0x7fd5cc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1995046890 >> v1:172.21.15.187:6789/0 conn(0x7fd5cc0d26d0 legacy=0x7fd5cc0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1995046890 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc15a530 con 0x7fd5cc070890 2023-06-09T11:12:45.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5cb7fe700 1 --2- 172.21.15.78:0/1995046890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc070890 0x7fd5cc070d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009e50 tx=0x7fd5c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dbeb2ce2ed618e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5c9ffb700 1 -- 172.21.15.78:0/1995046890 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400e070 con 0x7fd5cc070890 2023-06-09T11:12:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5c9ffb700 1 -- 172.21.15.78:0/1995046890 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c400b9c0 con 0x7fd5cc070890 2023-06-09T11:12:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:44.999+0000 7fd5c9ffb700 1 -- 172.21.15.78:0/1995046890 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400bd70 con 0x7fd5cc070890 2023-06-09T11:12:45.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 -- 172.21.15.78:0/1995046890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc070890 msgr2=0x7fd5cc070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1995046890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc070890 0x7fd5cc070d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009e50 tx=0x7fd5c400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 -- 172.21.15.78:0/1995046890 shutdown_connections 2023-06-09T11:12:45.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1995046890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc070890 0x7fd5cc070d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1995046890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc15a160 0x7fd5cc15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 -- 172.21.15.78:0/1995046890 >> 172.21.15.78:0/1995046890 conn(0x7fd5cc0cf930 msgr2=0x7fd5cc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:45.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 -- 172.21.15.78:0/1995046890 shutdown_connections 2023-06-09T11:12:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 -- 172.21.15.78:0/1995046890 wait complete. 2023-06-09T11:12:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 Processor -- start 2023-06-09T11:12:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.003+0000 7fd5d1891700 1 -- start start 2023-06-09T11:12:45.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc070890 0x7fd5cc0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5cc0d26d0 0x7fd5cc0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc15a160 0x7fd5cc14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0b3ff0 con 0x7fd5cc15a160 2023-06-09T11:12:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0b3370 con 0x7fd5cc0d26d0 2023-06-09T11:12:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0b3650 con 0x7fd5cc070890 2023-06-09T11:12:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc15a160 0x7fd5cc14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc15a160 0x7fd5cc14e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52058/0 (socket says 172.21.15.78:52058) 2023-06-09T11:12:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1816412639 learned_addr learned my addr 172.21.15.78:0/1816412639 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5caffd700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc070890 0x7fd5cc0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5ca7fc700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5cc0d26d0 0x7fd5cc0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc070890 msgr2=0x7fd5cc0b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc070890 0x7fd5cc0b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5cc0d26d0 msgr2=0x7fd5cc0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5cc0d26d0 0x7fd5cc0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 -- 172.21.15.78:0/1816412639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009b30 con 0x7fd5cc15a160 2023-06-09T11:12:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5ca7fc700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5cc0d26d0 0x7fd5cc0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5cb7fe700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc15a160 0x7fd5cc14e500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0665b0 tx=0x7fd5c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5b3fff700 1 -- 172.21.15.78:0/1816412639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4004960 con 0x7fd5cc15a160 2023-06-09T11:12:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5b3fff700 1 -- 172.21.15.78:0/1816412639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c40099b0 con 0x7fd5cc15a160 2023-06-09T11:12:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc15d460 con 0x7fd5cc15a160 2023-06-09T11:12:45.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5b3fff700 1 -- 172.21.15.78:0/1816412639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c401b670 con 0x7fd5cc15a160 2023-06-09T11:12:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc15d180 con 0x7fd5cc15a160 2023-06-09T11:12:45.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.007+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc15d740 con 0x7fd5cc15a160 2023-06-09T11:12:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.011+0000 7fd5b3fff700 1 -- 172.21.15.78:0/1816412639 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5c401b7d0 con 0x7fd5cc15a160 2023-06-09T11:12:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.011+0000 7fd5b3fff700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd5b80662f0 0x7fd5b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.011+0000 7fd5b3fff700 1 -- 172.21.15.78:0/1816412639 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5c4085640 con 0x7fd5cc15a160 2023-06-09T11:12:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.011+0000 7fd5caffd700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd5b80662f0 0x7fd5b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.015+0000 7fd5caffd700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd5b80662f0 0x7fd5b80687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009950 tx=0x7fd5bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.019+0000 7fd5b3fff700 1 -- 172.21.15.78:0/1816412639 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd5c4052b50 con 0x7fd5cc15a160 2023-06-09T11:12:45.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.187+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5cc067610 con 0x7fd5cc15a160 2023-06-09T11:12:45.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.187+0000 7fd5b3fff700 1 -- 172.21.15.78:0/1816412639 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5c4056170 con 0x7fd5cc15a160 2023-06-09T11:12:45.195 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:45.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.187+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd5b80662f0 msgr2=0x7fd5b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.187+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd5b80662f0 0x7fd5b80687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009950 tx=0x7fd5bc008040 comp rx=0 tx=0).stop 2023-06-09T11:12:45.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.187+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc15a160 msgr2=0x7fd5cc14e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.187+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc15a160 0x7fd5cc14e500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0665b0 tx=0x7fd5c4004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 shutdown_connections 2023-06-09T11:12:45.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd5b80662f0 0x7fd5b80687a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5cc15a160 0x7fd5cc14e500 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5cc0d26d0 0x7fd5cc0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 --2- 172.21.15.78:0/1816412639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5cc070890 0x7fd5cc0b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 >> 172.21.15.78:0/1816412639 conn(0x7fd5cc0cf930 msgr2=0x7fd5cc06f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:45.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 shutdown_connections 2023-06-09T11:12:45.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.191+0000 7fd5d1891700 1 -- 172.21.15.78:0/1816412639 wait complete. 2023-06-09T11:12:45.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.391+0000 7ff04af2d700 1 Processor -- start 2023-06-09T11:12:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.391+0000 7ff04af2d700 1 -- start start 2023-06-09T11:12:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff04af2d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff044160b60 0x7ff04406ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff04af2d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160f30 0x7ff0440c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff04af2d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff04406b360 0x7ff0440c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff04af2d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440cb070 con 0x7ff044160b60 2023-06-09T11:12:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff04af2d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440cd470 con 0x7ff04406b360 2023-06-09T11:12:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff04af2d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440ccbd0 con 0x7ff044160f30 2023-06-09T11:12:45.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff044160b60 0x7ff04406ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff044160b60 0x7ff04406ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52062/0 (socket says 172.21.15.78:52062) 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 -- 172.21.15.78:0/87527482 learned_addr learned my addr 172.21.15.78:0/87527482 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff043fff700 1 --2- 172.21.15.78:0/87527482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160f30 0x7ff0440c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff0494ca700 1 --2- 172.21.15.78:0/87527482 >> v2:172.21.15.187:3300/0 conn(0x7ff04406b360 0x7ff0440c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 -- 172.21.15.78:0/87527482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160f30 msgr2=0x7ff0440c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 --2- 172.21.15.78:0/87527482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160f30 0x7ff0440c1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 -- 172.21.15.78:0/87527482 >> v2:172.21.15.187:3300/0 conn(0x7ff04406b360 msgr2=0x7ff0440c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:45.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 --2- 172.21.15.78:0/87527482 >> v2:172.21.15.187:3300/0 conn(0x7ff04406b360 0x7ff0440c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 -- 172.21.15.78:0/87527482 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440cceb0 con 0x7ff044160b60 2023-06-09T11:12:45.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff048cc9700 1 --2- 172.21.15.78:0/87527482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160b60 0x7ff04406ae20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0440ce4e0 tx=0x7ff038009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15293d28b8380036 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff0437fe700 1 -- 172.21.15.78:0/87527482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038011830 con 0x7ff044160b60 2023-06-09T11:12:45.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff0437fe700 1 -- 172.21.15.78:0/87527482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038011990 con 0x7ff044160b60 2023-06-09T11:12:45.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.395+0000 7ff0437fe700 1 -- 172.21.15.78:0/87527482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038011d20 con 0x7ff044160b60 2023-06-09T11:12:45.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 -- 172.21.15.78:0/87527482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160b60 msgr2=0x7ff04406ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 --2- 172.21.15.78:0/87527482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160b60 0x7ff04406ae20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0440ce4e0 tx=0x7ff038009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 -- 172.21.15.78:0/87527482 shutdown_connections 2023-06-09T11:12:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 --2- 172.21.15.78:0/87527482 >> v2:172.21.15.187:3300/0 conn(0x7ff04406b360 0x7ff0440c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 --2- 172.21.15.78:0/87527482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160f30 0x7ff0440c1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 --2- 172.21.15.78:0/87527482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160b60 0x7ff04406ae20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 -- 172.21.15.78:0/87527482 >> 172.21.15.78:0/87527482 conn(0x7ff0440cf8b0 msgr2=0x7ff0440cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 -- 172.21.15.78:0/87527482 shutdown_connections 2023-06-09T11:12:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.399+0000 7ff04af2d700 1 -- 172.21.15.78:0/87527482 wait complete. 2023-06-09T11:12:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 Processor -- start 2023-06-09T11:12:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 -- start start 2023-06-09T11:12:45.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04406b360 0x7ff0440be630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160b60 0x7ff0440c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160f30 0x7ff0440c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440beb70 con 0x7ff044160f30 2023-06-09T11:12:45.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440bfb70 con 0x7ff04406b360 2023-06-09T11:12:45.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff04af2d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440bfe50 con 0x7ff044160b60 2023-06-09T11:12:45.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160f30 0x7ff0440c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160f30 0x7ff0440c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52068/0 (socket says 172.21.15.78:52068) 2023-06-09T11:12:45.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 -- 172.21.15.78:0/3124827075 learned_addr learned my addr 172.21.15.78:0/3124827075 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:45.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff048cc9700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04406b360 0x7ff0440be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff043fff700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160b60 0x7ff0440c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 -- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160b60 msgr2=0x7ff0440c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160b60 0x7ff0440c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 -- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04406b360 msgr2=0x7ff0440be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04406b360 0x7ff0440be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.403+0000 7ff0494ca700 1 -- 172.21.15.78:0/3124827075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009570 con 0x7ff044160f30 2023-06-09T11:12:45.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.407+0000 7ff0494ca700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160f30 0x7ff0440c1240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00efc0 tx=0x7ff03c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.407+0000 7ff0417fa700 1 -- 172.21.15.78:0/3124827075 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c009b20 con 0x7ff044160f30 2023-06-09T11:12:45.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.407+0000 7ff0417fa700 1 -- 172.21.15.78:0/3124827075 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00f040 con 0x7ff044160f30 2023-06-09T11:12:45.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.407+0000 7ff0417fa700 1 -- 172.21.15.78:0/3124827075 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00cd40 con 0x7ff044160f30 2023-06-09T11:12:45.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.407+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04406f9b0 con 0x7ff044160f30 2023-06-09T11:12:45.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.407+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0440cd190 con 0x7ff044160f30 2023-06-09T11:12:45.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.407+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0440cc7f0 con 0x7ff044160f30 2023-06-09T11:12:45.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.411+0000 7ff0417fa700 1 -- 172.21.15.78:0/3124827075 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff03c014480 con 0x7ff044160f30 2023-06-09T11:12:45.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.411+0000 7ff0417fa700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff0280662f0 0x7ff0280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.411+0000 7ff0417fa700 1 -- 172.21.15.78:0/3124827075 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff03c0847c0 con 0x7ff044160f30 2023-06-09T11:12:45.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.411+0000 7ff048cc9700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff0280662f0 0x7ff0280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.411+0000 7ff048cc9700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff0280662f0 0x7ff0280687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff038000c00 tx=0x7ff038008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.415+0000 7ff0417fa700 1 -- 172.21.15.78:0/3124827075 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff03c051c30 con 0x7ff044160f30 2023-06-09T11:12:45.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.587+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0440741c0 con 0x7ff044160f30 2023-06-09T11:12:45.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.587+0000 7ff0417fa700 1 -- 172.21.15.78:0/3124827075 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff03c055250 con 0x7ff044160f30 2023-06-09T11:12:45.597 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:45.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff0280662f0 msgr2=0x7ff0280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff0280662f0 0x7ff0280687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff038000c00 tx=0x7ff038008030 comp rx=0 tx=0).stop 2023-06-09T11:12:45.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160f30 msgr2=0x7ff0440c1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160f30 0x7ff0440c1240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00efc0 tx=0x7ff03c009f60 comp rx=0 tx=0).stop 2023-06-09T11:12:45.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 shutdown_connections 2023-06-09T11:12:45.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff0280662f0 0x7ff0280687a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff044160f30 0x7ff0440c1240 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff044160b60 0x7ff0440c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 --2- 172.21.15.78:0/3124827075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04406b360 0x7ff0440be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 >> 172.21.15.78:0/3124827075 conn(0x7ff0440cf8b0 msgr2=0x7ff04406fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:45.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 shutdown_connections 2023-06-09T11:12:45.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.595+0000 7ff04af2d700 1 -- 172.21.15.78:0/3124827075 wait complete. 2023-06-09T11:12:45.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:45.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.791+0000 7f4913671700 1 Processor -- start 2023-06-09T11:12:45.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4913671700 1 -- start start 2023-06-09T11:12:45.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4913671700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c15cb20 0x7f490c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4913671700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f490c160f10 0x7f490c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4913671700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c06fa00 con 0x7f490c0cc7f0 2023-06-09T11:12:45.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4913671700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c161490 con 0x7f490c160f10 2023-06-09T11:12:45.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4913671700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c06fce0 con 0x7f490c15cb20 2023-06-09T11:12:45.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4910c0c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f490c160f10 0x7f490c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f491140d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c15cb20 0x7f490c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4910c0c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f490c160f10 0x7f490c0c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52072/0 (socket says 172.21.15.78:52072) 2023-06-09T11:12:45.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4910c0c700 1 -- 172.21.15.78:0/3147552327 learned_addr learned my addr 172.21.15.78:0/3147552327 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:45.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4911c0e700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f490c0cc7f0 0x7f490c0ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:37486/0 (socket says 172.21.15.78:37486) 2023-06-09T11:12:45.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4910c0c700 1 -- 172.21.15.78:0/3147552327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c15cb20 msgr2=0x7f490c0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:45.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4910c0c700 1 --2- 172.21.15.78:0/3147552327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c15cb20 0x7f490c0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4910c0c700 1 -- 172.21.15.78:0/3147552327 >> v1:172.21.15.187:6789/0 conn(0x7f490c0cc7f0 legacy=0x7f490c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.795+0000 7f4910c0c700 1 -- 172.21.15.78:0/3147552327 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c06ffc0 con 0x7f490c160f10 2023-06-09T11:12:45.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4910c0c700 1 --2- 172.21.15.78:0/3147552327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c160f10 0x7f490c0c9270 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009910 tx=0x7f48fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df4e65adaad8476 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4903fff700 1 -- 172.21.15.78:0/3147552327 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011830 con 0x7f490c160f10 2023-06-09T11:12:45.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4903fff700 1 -- 172.21.15.78:0/3147552327 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc011990 con 0x7f490c160f10 2023-06-09T11:12:45.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4903fff700 1 -- 172.21.15.78:0/3147552327 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011d40 con 0x7f490c160f10 2023-06-09T11:12:45.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 -- 172.21.15.78:0/3147552327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c160f10 msgr2=0x7f490c0c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 --2- 172.21.15.78:0/3147552327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c160f10 0x7f490c0c9270 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009910 tx=0x7f48fc009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:45.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 -- 172.21.15.78:0/3147552327 shutdown_connections 2023-06-09T11:12:45.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 --2- 172.21.15.78:0/3147552327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c160f10 0x7f490c0c9270 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 --2- 172.21.15.78:0/3147552327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c15cb20 0x7f490c0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 -- 172.21.15.78:0/3147552327 >> 172.21.15.78:0/3147552327 conn(0x7f490c0cf8b0 msgr2=0x7f490c0cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:45.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 -- 172.21.15.78:0/3147552327 shutdown_connections 2023-06-09T11:12:45.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.799+0000 7f4913671700 1 -- 172.21.15.78:0/3147552327 wait complete. 2023-06-09T11:12:45.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 Processor -- start 2023-06-09T11:12:45.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 -- start start 2023-06-09T11:12:45.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c0cc7f0 0x7f490c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c15cb20 0x7f490c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f490c160f10 0x7f490c0c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0b30d0 con 0x7f490c15cb20 2023-06-09T11:12:45.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c7500 con 0x7f490c160f10 2023-06-09T11:12:45.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c15f230 con 0x7f490c0cc7f0 2023-06-09T11:12:45.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c15cb20 0x7f490c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c15cb20 0x7f490c0c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52084/0 (socket says 172.21.15.78:52084) 2023-06-09T11:12:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 -- 172.21.15.78:0/169385843 learned_addr learned my addr 172.21.15.78:0/169385843 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f491140d700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c0cc7f0 0x7f490c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4911c0e700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f490c160f10 0x7f490c0c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 -- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c0cc7f0 msgr2=0x7f490c15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c0cc7f0 0x7f490c15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 -- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f490c160f10 msgr2=0x7f490c0c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f490c160f10 0x7f490c0c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 -- 172.21.15.78:0/169385843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc009570 con 0x7f490c15cb20 2023-06-09T11:12:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f491140d700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c0cc7f0 0x7f490c15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:45.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4910c0c700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c15cb20 0x7f490c0c5df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f490c073aa0 tx=0x7f48fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4901ffb700 1 -- 172.21.15.78:0/169385843 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00b9f0 con 0x7f490c15cb20 2023-06-09T11:12:45.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c06a060 con 0x7f490c15cb20 2023-06-09T11:12:45.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4901ffb700 1 -- 172.21.15.78:0/169385843 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc01e070 con 0x7f490c15cb20 2023-06-09T11:12:45.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4901ffb700 1 -- 172.21.15.78:0/169385843 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00bd90 con 0x7f490c15cb20 2023-06-09T11:12:45.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.803+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c0702a0 con 0x7f490c15cb20 2023-06-09T11:12:45.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.807+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c0c97b0 con 0x7f490c15cb20 2023-06-09T11:12:45.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.807+0000 7f4901ffb700 1 -- 172.21.15.78:0/169385843 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48fc01a420 con 0x7f490c15cb20 2023-06-09T11:12:45.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.807+0000 7f4901ffb700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f48f0066320 0x7f48f00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:45.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.807+0000 7f4901ffb700 1 -- 172.21.15.78:0/169385843 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48fc084ed0 con 0x7f490c15cb20 2023-06-09T11:12:45.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.811+0000 7f491140d700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f48f0066320 0x7f48f00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:45.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.811+0000 7f491140d700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f48f0066320 0x7f48f00687d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f490c1f5270 tx=0x7f4908008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:45.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.815+0000 7f4901ffb700 1 -- 172.21.15.78:0/169385843 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f48fc052360 con 0x7f490c15cb20 2023-06-09T11:12:45.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.983+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f490c074210 con 0x7f490c15cb20 2023-06-09T11:12:45.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.983+0000 7f4901ffb700 1 -- 172.21.15.78:0/169385843 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48fc055980 con 0x7f490c15cb20 2023-06-09T11:12:45.993 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:45.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f48f0066320 msgr2=0x7f48f00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f48f0066320 0x7f48f00687d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f490c1f5270 tx=0x7f4908008040 comp rx=0 tx=0).stop 2023-06-09T11:12:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c15cb20 msgr2=0x7f490c0c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c15cb20 0x7f490c0c5df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f490c073aa0 tx=0x7f48fc004770 comp rx=0 tx=0).stop 2023-06-09T11:12:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 shutdown_connections 2023-06-09T11:12:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f48f0066320 0x7f48f00687d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f490c160f10 0x7f490c0c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f490c15cb20 0x7f490c0c5df0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 --2- 172.21.15.78:0/169385843 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f490c0cc7f0 0x7f490c15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.987+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 >> 172.21.15.78:0/169385843 conn(0x7f490c0cf8b0 msgr2=0x7f490c0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.991+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 shutdown_connections 2023-06-09T11:12:45.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:45.991+0000 7f4913671700 1 -- 172.21.15.78:0/169385843 wait complete. 2023-06-09T11:12:46.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T11:12:46.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.187+0000 7f63a910e700 1 Processor -- start 2023-06-09T11:12:46.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.187+0000 7f63a910e700 1 -- start start 2023-06-09T11:12:46.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f63a415a3e0 0x7f63a406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a40ce470 0x7f63a406f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63a415df60 0x7f63a415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a415e920 con 0x7f63a415df60 2023-06-09T11:12:46.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a40cc8e0 con 0x7f63a415a3e0 2023-06-09T11:12:46.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a415a7b0 con 0x7f63a40ce470 2023-06-09T11:12:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63a415df60 0x7f63a415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63a415df60 0x7f63a415e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52098/0 (socket says 172.21.15.78:52098) 2023-06-09T11:12:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 -- 172.21.15.78:0/2058816884 learned_addr learned my addr 172.21.15.78:0/2058816884 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:46.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a3fff700 1 --2- 172.21.15.78:0/2058816884 >> v2:172.21.15.187:3300/0 conn(0x7f63a415a3e0 0x7f63a406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f639bfff700 1 --2- 172.21.15.78:0/2058816884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a40ce470 0x7f63a406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 -- 172.21.15.78:0/2058816884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a40ce470 msgr2=0x7f63a406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 --2- 172.21.15.78:0/2058816884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a40ce470 0x7f63a406f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 -- 172.21.15.78:0/2058816884 >> v2:172.21.15.187:3300/0 conn(0x7f63a415a3e0 msgr2=0x7f63a406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 --2- 172.21.15.78:0/2058816884 >> v2:172.21.15.187:3300/0 conn(0x7f63a415a3e0 0x7f63a406e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 -- 172.21.15.78:0/2058816884 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40ccb80 con 0x7f63a415df60 2023-06-09T11:12:46.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a890d700 1 --2- 172.21.15.78:0/2058816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a415df60 0x7f63a415e3e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63a40cb2e0 tx=0x7f639c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4e655d968ad413 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:46.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a37fe700 1 -- 172.21.15.78:0/2058816884 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c00e070 con 0x7f63a415df60 2023-06-09T11:12:46.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a37fe700 1 -- 172.21.15.78:0/2058816884 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c00b910 con 0x7f63a415df60 2023-06-09T11:12:46.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a37fe700 1 -- 172.21.15.78:0/2058816884 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c00bcc0 con 0x7f63a415df60 2023-06-09T11:12:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 -- 172.21.15.78:0/2058816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a415df60 msgr2=0x7f63a415e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 --2- 172.21.15.78:0/2058816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a415df60 0x7f63a415e3e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63a40cb2e0 tx=0x7f639c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 -- 172.21.15.78:0/2058816884 shutdown_connections 2023-06-09T11:12:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 --2- 172.21.15.78:0/2058816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a415df60 0x7f63a415e3e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 --2- 172.21.15.78:0/2058816884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a40ce470 0x7f63a406f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 --2- 172.21.15.78:0/2058816884 >> v2:172.21.15.187:3300/0 conn(0x7f63a415a3e0 0x7f63a406e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 -- 172.21.15.78:0/2058816884 >> 172.21.15.78:0/2058816884 conn(0x7f63a40cf670 msgr2=0x7f63a40cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.191+0000 7f63a910e700 1 -- 172.21.15.78:0/2058816884 shutdown_connections 2023-06-09T11:12:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 -- 172.21.15.78:0/2058816884 wait complete. 2023-06-09T11:12:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 Processor -- start 2023-06-09T11:12:46.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 -- start start 2023-06-09T11:12:46.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a40ce470 0x7f63a40c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a415a3e0 0x7f63a40c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63a415df60 0x7f63a40c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40c8470 con 0x7f63a40ce470 2023-06-09T11:12:46.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a415d6b0 con 0x7f63a415df60 2023-06-09T11:12:46.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a910e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40af090 con 0x7f63a415a3e0 2023-06-09T11:12:46.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a40ce470 0x7f63a40c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a40ce470 0x7f63a40c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52102/0 (socket says 172.21.15.78:52102) 2023-06-09T11:12:46.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a3fff700 1 -- 172.21.15.78:0/641105659 learned_addr learned my addr 172.21.15.78:0/641105659 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:46.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f63a890d700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63a415df60 0x7f63a40c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.195+0000 7f639bfff700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a415a3e0 0x7f63a40c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a3fff700 1 -- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a415a3e0 msgr2=0x7f63a40c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a3fff700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a415a3e0 0x7f63a40c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a3fff700 1 -- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63a415df60 msgr2=0x7f63a40c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a3fff700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63a415df60 0x7f63a40c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a3fff700 1 -- 172.21.15.78:0/641105659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c009b30 con 0x7f63a40ce470 2023-06-09T11:12:46.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a3fff700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a40ce470 0x7f63a40c7f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9d0 tx=0x7f639400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:46.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a17fa700 1 -- 172.21.15.78:0/641105659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394009720 con 0x7f63a40ce470 2023-06-09T11:12:46.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a17fa700 1 -- 172.21.15.78:0/641105659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639400ee70 con 0x7f63a40ce470 2023-06-09T11:12:46.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a406b750 con 0x7f63a40ce470 2023-06-09T11:12:46.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a17fa700 1 -- 172.21.15.78:0/641105659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639400ca50 con 0x7f63a40ce470 2023-06-09T11:12:46.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a406b470 con 0x7f63a40ce470 2023-06-09T11:12:46.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.199+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a4070240 con 0x7f63a40ce470 2023-06-09T11:12:46.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.203+0000 7f63a17fa700 1 -- 172.21.15.78:0/641105659 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f639400cbb0 con 0x7f63a40ce470 2023-06-09T11:12:46.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.203+0000 7f63a17fa700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f63840662f0 0x7f63840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.203+0000 7f63a17fa700 1 -- 172.21.15.78:0/641105659 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6394083d20 con 0x7f63a40ce470 2023-06-09T11:12:46.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.203+0000 7f639bfff700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f63840662f0 0x7f63840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.203+0000 7f639bfff700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f63840662f0 0x7f63840687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f63a40c8720 tx=0x7f638c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:46.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.207+0000 7f63a17fa700 1 -- 172.21.15.78:0/641105659 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6394051080 con 0x7f63a40ce470 2023-06-09T11:12:46.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.391+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63a40741c0 con 0x7f63a40ce470 2023-06-09T11:12:46.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.391+0000 7f63a17fa700 1 -- 172.21.15.78:0/641105659 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f639400ce60 con 0x7f63a40ce470 2023-06-09T11:12:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f63840662f0 msgr2=0x7f63840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f63840662f0 0x7f63840687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f63a40c8720 tx=0x7f638c008040 comp rx=0 tx=0).stop 2023-06-09T11:12:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a40ce470 msgr2=0x7f63a40c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a40ce470 0x7f63a40c7f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9d0 tx=0x7f639400ece0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 shutdown_connections 2023-06-09T11:12:46.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f63840662f0 0x7f63840687a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63a415df60 0x7f63a40c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63a415a3e0 0x7f63a40c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 --2- 172.21.15.78:0/641105659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63a40ce470 0x7f63a40c7f30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 >> 172.21.15.78:0/641105659 conn(0x7f63a40cf670 msgr2=0x7f63a406fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 shutdown_connections 2023-06-09T11:12:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.399+0000 7f63a910e700 1 -- 172.21.15.78:0/641105659 wait complete. 2023-06-09T11:12:46.409 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-09T11:12:46.428 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T11:12:46.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:46.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-09T11:12:46.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T11:12:46.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:46.512 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T11:12:46.536 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:46.537 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:46.557 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:46.557 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:46.618 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:46.618 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:46.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:46.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.851+0000 7f9348b37700 1 Processor -- start 2023-06-09T11:12:46.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9348b37700 1 -- start start 2023-06-09T11:12:46.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9348b37700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f934415a3e0 0x7f934406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9348b37700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934406f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9348b37700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440cc8e0 con 0x7f934415df60 2023-06-09T11:12:46.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9348b37700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934415a7b0 con 0x7f934415a3e0 2023-06-09T11:12:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9348b37700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440ccb80 con 0x7f93440ce470 2023-06-09T11:12:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9343fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f934415df60 0x7f9344070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50460/0 (socket says 172.21.15.78:50460) 2023-06-09T11:12:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f9343fff700 1 -- 172.21.15.78:0/3082474668 learned_addr learned my addr 172.21.15.78:0/3082474668 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:46.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f93437fe700 1 --2- 172.21.15.78:0/3082474668 >> v2:172.21.15.187:3300/0 conn(0x7f934415a3e0 0x7f934406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.855+0000 7f933bfff700 1 --2- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9342ffd700 1 -- 172.21.15.78:0/3082474668 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643164975 0 0) 0x7f93440cc8e0 con 0x7f934415df60 2023-06-09T11:12:46.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9342ffd700 1 -- 172.21.15.78:0/3082474668 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93300035d0 con 0x7f934415df60 2023-06-09T11:12:46.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f93437fe700 1 -- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 msgr2=0x7f934406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:46.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f93437fe700 1 --2- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934406f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f93437fe700 1 -- 172.21.15.78:0/3082474668 >> v1:172.21.15.78:6789/0 conn(0x7f934415df60 legacy=0x7f9344070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f93437fe700 1 -- 172.21.15.78:0/3082474668 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934406b470 con 0x7f934415a3e0 2023-06-09T11:12:46.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f93437fe700 1 --2- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415a3e0 0x7f934406e960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9334009850 tx=0x7f9334009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41dde2c2952e5de2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:46.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9342ffd700 1 -- 172.21.15.78:0/3082474668 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334011830 con 0x7f934415a3e0 2023-06-09T11:12:46.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9342ffd700 1 -- 172.21.15.78:0/3082474668 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334011990 con 0x7f934415a3e0 2023-06-09T11:12:46.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9342ffd700 1 -- 172.21.15.78:0/3082474668 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334011d40 con 0x7f934415a3e0 2023-06-09T11:12:46.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 -- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415a3e0 msgr2=0x7f934406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 --2- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415a3e0 0x7f934406e960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9334009850 tx=0x7f9334009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:46.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 -- 172.21.15.78:0/3082474668 shutdown_connections 2023-06-09T11:12:46.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 --2- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934406f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 --2- 172.21.15.78:0/3082474668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415a3e0 0x7f934406e960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 -- 172.21.15.78:0/3082474668 >> 172.21.15.78:0/3082474668 conn(0x7f93440cf670 msgr2=0x7f93440cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:46.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 -- 172.21.15.78:0/3082474668 shutdown_connections 2023-06-09T11:12:46.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.859+0000 7f9348b37700 1 -- 172.21.15.78:0/3082474668 wait complete. 2023-06-09T11:12:46.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 Processor -- start 2023-06-09T11:12:46.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 -- start start 2023-06-09T11:12:46.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934415a3e0 0x7f934413f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415df60 0x7f934414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934414efc0 con 0x7f934415a3e0 2023-06-09T11:12:46.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934414e5f0 con 0x7f934415df60 2023-06-09T11:12:46.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f9348b37700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934414d9e0 con 0x7f93440ce470 2023-06-09T11:12:46.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f933bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934415a3e0 0x7f934413f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.863+0000 7f933bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934415a3e0 0x7f934413f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52110/0 (socket says 172.21.15.78:52110) 2023-06-09T11:12:46.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f933bfff700 1 -- 172.21.15.78:0/726038992 learned_addr learned my addr 172.21.15.78:0/726038992 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:46.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f93437fe700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9343fff700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415df60 0x7f934414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f933bfff700 1 -- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 msgr2=0x7f934414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f933bfff700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934414ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f933bfff700 1 -- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415df60 msgr2=0x7f934414cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:46.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f933bfff700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415df60 0x7f934414cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:46.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f933bfff700 1 -- 172.21.15.78:0/726038992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93340094b0 con 0x7f934415a3e0 2023-06-09T11:12:46.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9343fff700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415df60 0x7f934414cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:46.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f933bfff700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934415a3e0 0x7f934413f2e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f932c00e9d0 tx=0x7f932c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9340ff9700 1 -- 172.21.15.78:0/726038992 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c009720 con 0x7f934415a3e0 2023-06-09T11:12:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9340ff9700 1 -- 172.21.15.78:0/726038992 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c00c850 con 0x7f934415a3e0 2023-06-09T11:12:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9340ff9700 1 -- 172.21.15.78:0/726038992 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00cbc0 con 0x7f934415a3e0 2023-06-09T11:12:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934415e3e0 con 0x7f934415a3e0 2023-06-09T11:12:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934406b750 con 0x7f934415a3e0 2023-06-09T11:12:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.867+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934415e570 con 0x7f934415a3e0 2023-06-09T11:12:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.871+0000 7f9340ff9700 1 -- 172.21.15.78:0/726038992 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f932c00cd20 con 0x7f934415a3e0 2023-06-09T11:12:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.871+0000 7f9340ff9700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9324066320 0x7f93240687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.871+0000 7f9340ff9700 1 -- 172.21.15.78:0/726038992 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f932c083db0 con 0x7f934415a3e0 2023-06-09T11:12:46.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.871+0000 7f93437fe700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9324066320 0x7f93240687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.875+0000 7f93437fe700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9324066320 0x7f93240687d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f93340090b0 tx=0x7f9334008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:46.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:46.879+0000 7f9340ff9700 1 -- 172.21.15.78:0/726038992 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f932c088070 con 0x7f934415a3e0 2023-06-09T11:12:47.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.051+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93440741c0 con 0x7f934415a3e0 2023-06-09T11:12:47.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.055+0000 7f9340ff9700 1 -- 172.21.15.78:0/726038992 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f932c021090 con 0x7f934415a3e0 2023-06-09T11:12:47.065 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:47.065 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:09.804084+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9324066320 msgr2=0x7f93240687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9324066320 0x7f93240687d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f93340090b0 tx=0x7f9334008030 comp rx=0 tx=0).stop 2023-06-09T11:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934415a3e0 msgr2=0x7f934413f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934415a3e0 0x7f934413f2e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f932c00e9d0 tx=0x7f932c00ece0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 shutdown_connections 2023-06-09T11:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9324066320 0x7f93240687d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f934415df60 0x7f934414cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f934415a3e0 0x7f934413f2e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 --2- 172.21.15.78:0/726038992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93440ce470 0x7f934414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 >> 172.21.15.78:0/726038992 conn(0x7f93440cf670 msgr2=0x7f93440b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 shutdown_connections 2023-06-09T11:12:47.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.059+0000 7f9348b37700 1 -- 172.21.15.78:0/726038992 wait complete. 2023-06-09T11:12:47.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:47.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:47.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.259+0000 7f47e65ce700 1 Processor -- start 2023-06-09T11:12:47.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.259+0000 7f47e65ce700 1 -- start start 2023-06-09T11:12:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e65ce700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47e015c560 0x7f47e00b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e65ce700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e006b6e0 con 0x7f47e006d690 2023-06-09T11:12:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e65ce700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e015d4c0 con 0x7f47e015c930 2023-06-09T11:12:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e65ce700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00b29e0 con 0x7f47e015c560 2023-06-09T11:12:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e5dcd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f47e006d690 0x7f47e006dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50476/0 (socket says 172.21.15.78:50476) 2023-06-09T11:12:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e55cc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47e015c560 0x7f47e00b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e5dcd700 1 -- 172.21.15.78:0/1753930711 learned_addr learned my addr 172.21.15.78:0/1753930711 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e55cc700 1 -- 172.21.15.78:0/1753930711 >> v1:172.21.15.187:6789/0 conn(0x7f47e015c930 legacy=0x7f47e015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e55cc700 1 -- 172.21.15.78:0/1753930711 >> v1:172.21.15.78:6789/0 conn(0x7f47e006d690 legacy=0x7f47e006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e55cc700 1 -- 172.21.15.78:0/1753930711 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e006adb0 con 0x7f47e015c560 2023-06-09T11:12:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47e55cc700 1 --2- 172.21.15.78:0/1753930711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e00b1a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009850 tx=0x7f47dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37da9ebd046d5639 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47d7fff700 1 -- 172.21.15.78:0/1753930711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc011830 con 0x7f47e015c560 2023-06-09T11:12:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47d7fff700 1 -- 172.21.15.78:0/1753930711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc011990 con 0x7f47e015c560 2023-06-09T11:12:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.263+0000 7f47d7fff700 1 -- 172.21.15.78:0/1753930711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc011d20 con 0x7f47e015c560 2023-06-09T11:12:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 -- 172.21.15.78:0/1753930711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 msgr2=0x7f47e00b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 --2- 172.21.15.78:0/1753930711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e00b1a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009850 tx=0x7f47dc009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 -- 172.21.15.78:0/1753930711 shutdown_connections 2023-06-09T11:12:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 --2- 172.21.15.78:0/1753930711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e00b1a80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 -- 172.21.15.78:0/1753930711 >> 172.21.15.78:0/1753930711 conn(0x7f47e00b0780 msgr2=0x7f47e00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:47.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 -- 172.21.15.78:0/1753930711 shutdown_connections 2023-06-09T11:12:47.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 -- 172.21.15.78:0/1753930711 wait complete. 2023-06-09T11:12:47.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 Processor -- start 2023-06-09T11:12:47.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.267+0000 7f47e65ce700 1 -- start start 2023-06-09T11:12:47.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e006d690 0x7f47e01474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e0147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015c930 0x7f47e015f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01494c0 con 0x7f47e015c560 2023-06-09T11:12:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0148840 con 0x7f47e015c930 2023-06-09T11:12:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0148b20 con 0x7f47e006d690 2023-06-09T11:12:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e0147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e0147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52126/0 (socket says 172.21.15.78:52126) 2023-06-09T11:12:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 -- 172.21.15.78:0/3181943841 learned_addr learned my addr 172.21.15.78:0/3181943841 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e55cc700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e006d690 0x7f47e01474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e5dcd700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015c930 0x7f47e015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 -- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e006d690 msgr2=0x7f47e01474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e006d690 0x7f47e01474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 -- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015c930 msgr2=0x7f47e015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015c930 0x7f47e015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 -- 172.21.15.78:0/3181943841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc0094b0 con 0x7f47e015c560 2023-06-09T11:12:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e55cc700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e006d690 0x7f47e01474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e4dcb700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e0147d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c500 tx=0x7f47d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47d5ffb700 1 -- 172.21.15.78:0/3181943841 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00052d0 con 0x7f47e015c560 2023-06-09T11:12:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47d5ffb700 1 -- 172.21.15.78:0/3181943841 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0005430 con 0x7f47e015c560 2023-06-09T11:12:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e006b370 con 0x7f47e015c560 2023-06-09T11:12:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47d5ffb700 1 -- 172.21.15.78:0/3181943841 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00055a0 con 0x7f47e015c560 2023-06-09T11:12:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.271+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e006b090 con 0x7f47e015c560 2023-06-09T11:12:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.275+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e015d8c0 con 0x7f47e015c560 2023-06-09T11:12:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.275+0000 7f47d5ffb700 1 -- 172.21.15.78:0/3181943841 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47d00038e0 con 0x7f47e015c560 2023-06-09T11:12:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.275+0000 7f47d5ffb700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47c40662f0 0x7f47c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.275+0000 7f47d5ffb700 1 -- 172.21.15.78:0/3181943841 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47d00830a0 con 0x7f47e015c560 2023-06-09T11:12:47.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.279+0000 7f47e55cc700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47c40662f0 0x7f47c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.279+0000 7f47e55cc700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47c40662f0 0x7f47c40687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009fd0 tx=0x7f47dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:47.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.283+0000 7f47d5ffb700 1 -- 172.21.15.78:0/3181943841 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f47d00505b0 con 0x7f47e015c560 2023-06-09T11:12:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.451+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47e0149600 con 0x7f47e015c560 2023-06-09T11:12:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.451+0000 7f47d5ffb700 1 -- 172.21.15.78:0/3181943841 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47e0149600 con 0x7f47e015c560 2023-06-09T11:12:47.460 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47c40662f0 msgr2=0x7f47c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47c40662f0 0x7f47c40687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009fd0 tx=0x7f47dc008030 comp rx=0 tx=0).stop 2023-06-09T11:12:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 msgr2=0x7f47e0147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e0147d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c500 tx=0x7f47d000c8c0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 shutdown_connections 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f47c40662f0 0x7f47c40687a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e015c930 0x7f47e015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e015c560 0x7f47e0147d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 --2- 172.21.15.78:0/3181943841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e006d690 0x7f47e01474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 >> 172.21.15.78:0/3181943841 conn(0x7f47e00b0780 msgr2=0x7f47e015dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 shutdown_connections 2023-06-09T11:12:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.455+0000 7f47e65ce700 1 -- 172.21.15.78:0/3181943841 wait complete. 2023-06-09T11:12:47.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.659+0000 7f893b8fa700 1 Processor -- start 2023-06-09T11:12:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.659+0000 7f893b8fa700 1 -- start start 2023-06-09T11:12:47.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f893b8fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f893b8fa700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f893406d790 0x7f89340d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f893b8fa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89340d11b0 0x7f893406f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f893b8fa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89340d1630 con 0x7f89340d11b0 2023-06-09T11:12:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f893b8fa700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89340cda60 con 0x7f893406d790 2023-06-09T11:12:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f893b8fa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8934160d70 con 0x7f893415c9f0 2023-06-09T11:12:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89340d11b0 0x7f893406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89340d11b0 0x7f893406f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52134/0 (socket says 172.21.15.78:52134) 2023-06-09T11:12:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 -- 172.21.15.78:0/1088239972 learned_addr learned my addr 172.21.15.78:0/1088239972 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939696700 1 --2- 172.21.15.78:0/1088239972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8938e95700 1 --2- 172.21.15.78:0/1088239972 >> v2:172.21.15.187:3300/0 conn(0x7f893406d790 0x7f89340d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 -- 172.21.15.78:0/1088239972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 msgr2=0x7f8934160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 --2- 172.21.15.78:0/1088239972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 -- 172.21.15.78:0/1088239972 >> v2:172.21.15.187:3300/0 conn(0x7f893406d790 msgr2=0x7f89340d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 --2- 172.21.15.78:0/1088239972 >> v2:172.21.15.187:3300/0 conn(0x7f893406d790 0x7f89340d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 -- 172.21.15.78:0/1088239972 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934161050 con 0x7f89340d11b0 2023-06-09T11:12:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f8939e97700 1 --2- 172.21.15.78:0/1088239972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89340d11b0 0x7f893406f880 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8934071760 tx=0x7f892c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa27668cd8e0877c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:47.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f892bfff700 1 -- 172.21.15.78:0/1088239972 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00e070 con 0x7f89340d11b0 2023-06-09T11:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f892bfff700 1 -- 172.21.15.78:0/1088239972 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c00b910 con 0x7f89340d11b0 2023-06-09T11:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.663+0000 7f892bfff700 1 -- 172.21.15.78:0/1088239972 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00bcc0 con 0x7f89340d11b0 2023-06-09T11:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 -- 172.21.15.78:0/1088239972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89340d11b0 msgr2=0x7f893406f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 --2- 172.21.15.78:0/1088239972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89340d11b0 0x7f893406f880 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8934071760 tx=0x7f892c00b330 comp rx=0 tx=0).stop 2023-06-09T11:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 -- 172.21.15.78:0/1088239972 shutdown_connections 2023-06-09T11:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 --2- 172.21.15.78:0/1088239972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89340d11b0 0x7f893406f880 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 --2- 172.21.15.78:0/1088239972 >> v2:172.21.15.187:3300/0 conn(0x7f893406d790 0x7f89340d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 --2- 172.21.15.78:0/1088239972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 -- 172.21.15.78:0/1088239972 >> 172.21.15.78:0/1088239972 conn(0x7f89340b4c90 msgr2=0x7f89340b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 -- 172.21.15.78:0/1088239972 shutdown_connections 2023-06-09T11:12:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 -- 172.21.15.78:0/1088239972 wait complete. 2023-06-09T11:12:47.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 Processor -- start 2023-06-09T11:12:47.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.667+0000 7f893b8fa700 1 -- start start 2023-06-09T11:12:47.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893406d790 0x7f8934150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89340d11b0 0x7f89340cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89340cb660 con 0x7f893406d790 2023-06-09T11:12:47.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89340ca5c0 con 0x7f89340d11b0 2023-06-09T11:12:47.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89340ca8a0 con 0x7f893415c9f0 2023-06-09T11:12:47.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893406d790 0x7f8934150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893406d790 0x7f8934150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52150/0 (socket says 172.21.15.78:52150) 2023-06-09T11:12:47.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 -- 172.21.15.78:0/3963620774 learned_addr learned my addr 172.21.15.78:0/3963620774 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:47.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939e97700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8938e95700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89340d11b0 0x7f89340cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 -- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 msgr2=0x7f8934156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 -- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89340d11b0 msgr2=0x7f89340cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89340d11b0 0x7f89340cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 -- 172.21.15.78:0/3963620774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c009b30 con 0x7f893406d790 2023-06-09T11:12:47.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8939696700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893406d790 0x7f8934150270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f893000e9d0 tx=0x7f893000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:47.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8929ffb700 1 -- 172.21.15.78:0/3963620774 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930009720 con 0x7f893406d790 2023-06-09T11:12:47.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8929ffb700 1 -- 172.21.15.78:0/3963620774 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893000ee70 con 0x7f893406d790 2023-06-09T11:12:47.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89340cd6f0 con 0x7f893406d790 2023-06-09T11:12:47.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f8929ffb700 1 -- 172.21.15.78:0/3963620774 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893000ca50 con 0x7f893406d790 2023-06-09T11:12:47.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.671+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8934161330 con 0x7f893406d790 2023-06-09T11:12:47.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.675+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893415cdc0 con 0x7f893406d790 2023-06-09T11:12:47.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.675+0000 7f8929ffb700 1 -- 172.21.15.78:0/3963620774 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f893000cbb0 con 0x7f893406d790 2023-06-09T11:12:47.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.679+0000 7f8929ffb700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89180662f0 0x7f89180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:47.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.679+0000 7f8929ffb700 1 -- 172.21.15.78:0/3963620774 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8930083d20 con 0x7f893406d790 2023-06-09T11:12:47.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.679+0000 7f8938e95700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89180662f0 0x7f89180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.679+0000 7f8938e95700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89180662f0 0x7f89180687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f893415cfd0 tx=0x7f8924009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.683+0000 7f8929ffb700 1 -- 172.21.15.78:0/3963620774 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8930051190 con 0x7f893406d790 2023-06-09T11:12:47.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.851+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89340741f0 con 0x7f893406d790 2023-06-09T11:12:47.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.851+0000 7f8929ffb700 1 -- 172.21.15.78:0/3963620774 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89300170a0 con 0x7f893406d790 2023-06-09T11:12:47.862 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89180662f0 msgr2=0x7f89180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89180662f0 0x7f89180687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f893415cfd0 tx=0x7f8924009240 comp rx=0 tx=0).stop 2023-06-09T11:12:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893406d790 msgr2=0x7f8934150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:47.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893406d790 0x7f8934150270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f893000e9d0 tx=0x7f893000ece0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 shutdown_connections 2023-06-09T11:12:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89180662f0 0x7f89180687a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f893415c9f0 0x7f8934156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89340d11b0 0x7f89340cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 --2- 172.21.15.78:0/3963620774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893406d790 0x7f8934150270 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:47.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 >> 172.21.15.78:0/3963620774 conn(0x7f89340b4c90 msgr2=0x7f89340cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:47.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 shutdown_connections 2023-06-09T11:12:47.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:47.855+0000 7f893b8fa700 1 -- 172.21.15.78:0/3963620774 wait complete. 2023-06-09T11:12:47.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.047+0000 7efd32828700 1 Processor -- start 2023-06-09T11:12:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.047+0000 7efd32828700 1 -- start start 2023-06-09T11:12:48.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd32828700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd2c15a490 0x7efd2c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd32828700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efd2c0ade90 0x7efd2c06ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd32828700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2c0cd5e0 con 0x7efd2c0ce5b0 2023-06-09T11:12:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd32828700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c069ed0 con 0x7efd2c15a490 2023-06-09T11:12:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd32828700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c15a860 con 0x7efd2c0ade90 2023-06-09T11:12:48.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd2c15a490 0x7efd2c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd2c15a490 0x7efd2c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52158/0 (socket says 172.21.15.78:52158) 2023-06-09T11:12:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 -- 172.21.15.78:0/2328434268 learned_addr learned my addr 172.21.15.78:0/2328434268 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31025700 1 --2- 172.21.15.78:0/2328434268 >> v2:172.21.15.187:3300/0 conn(0x7efd2c0ade90 0x7efd2c06ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 -- 172.21.15.78:0/2328434268 >> v2:172.21.15.187:3300/0 conn(0x7efd2c0ade90 msgr2=0x7efd2c06ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 --2- 172.21.15.78:0/2328434268 >> v2:172.21.15.187:3300/0 conn(0x7efd2c0ade90 0x7efd2c06ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 -- 172.21.15.78:0/2328434268 >> v1:172.21.15.187:6789/0 conn(0x7efd2c0ce5b0 legacy=0x7efd2c06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 -- 172.21.15.78:0/2328434268 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c0cd810 con 0x7efd2c15a490 2023-06-09T11:12:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.051+0000 7efd31826700 1 --2- 172.21.15.78:0/2328434268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c15a490 0x7efd2c06d690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b3db0 tx=0x7efd28009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f852897607011e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd30824700 1 -- 172.21.15.78:0/2328434268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800b8a0 con 0x7efd2c15a490 2023-06-09T11:12:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd30824700 1 -- 172.21.15.78:0/2328434268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2800ba00 con 0x7efd2c15a490 2023-06-09T11:12:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd30824700 1 -- 172.21.15.78:0/2328434268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800bd90 con 0x7efd2c15a490 2023-06-09T11:12:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 -- 172.21.15.78:0/2328434268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c15a490 msgr2=0x7efd2c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 --2- 172.21.15.78:0/2328434268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c15a490 0x7efd2c06d690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b3db0 tx=0x7efd28009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 -- 172.21.15.78:0/2328434268 shutdown_connections 2023-06-09T11:12:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 --2- 172.21.15.78:0/2328434268 >> v2:172.21.15.187:3300/0 conn(0x7efd2c0ade90 0x7efd2c06ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 --2- 172.21.15.78:0/2328434268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c15a490 0x7efd2c06d690 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 -- 172.21.15.78:0/2328434268 >> 172.21.15.78:0/2328434268 conn(0x7efd2c0b0780 msgr2=0x7efd2c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 -- 172.21.15.78:0/2328434268 shutdown_connections 2023-06-09T11:12:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 -- 172.21.15.78:0/2328434268 wait complete. 2023-06-09T11:12:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.055+0000 7efd32828700 1 Processor -- start 2023-06-09T11:12:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 -- start start 2023-06-09T11:12:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c0ade90 0x7efd2c1417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd2c0ce5b0 0x7efd2c15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd2c15a490 0x7efd2c155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c141d20 con 0x7efd2c0ade90 2023-06-09T11:12:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c144160 con 0x7efd2c15a490 2023-06-09T11:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c144440 con 0x7efd2c0ce5b0 2023-06-09T11:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c0ade90 0x7efd2c1417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c0ade90 0x7efd2c1417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52168/0 (socket says 172.21.15.78:52168) 2023-06-09T11:12:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 -- 172.21.15.78:0/2560683539 learned_addr learned my addr 172.21.15.78:0/2560683539 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31025700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd2c0ce5b0 0x7efd2c15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32027700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd2c15a490 0x7efd2c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 -- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd2c0ce5b0 msgr2=0x7efd2c15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd2c0ce5b0 0x7efd2c15bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 -- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd2c15a490 msgr2=0x7efd2c155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd2c15a490 0x7efd2c155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 -- 172.21.15.78:0/2560683539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009570 con 0x7efd2c0ade90 2023-06-09T11:12:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32027700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd2c15a490 0x7efd2c155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd31826700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c0ade90 0x7efd2c1417e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b1840 tx=0x7efd28004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd227fc700 1 -- 172.21.15.78:0/2560683539 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280036c0 con 0x7efd2c0ade90 2023-06-09T11:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd227fc700 1 -- 172.21.15.78:0/2560683539 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2801f070 con 0x7efd2c0ade90 2023-06-09T11:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd227fc700 1 -- 172.21.15.78:0/2560683539 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28003a80 con 0x7efd2c0ade90 2023-06-09T11:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.059+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c06a390 con 0x7efd2c0ade90 2023-06-09T11:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.063+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c06a0b0 con 0x7efd2c0ade90 2023-06-09T11:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.063+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c06a670 con 0x7efd2c0ade90 2023-06-09T11:12:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.063+0000 7efd227fc700 1 -- 172.21.15.78:0/2560683539 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd28021030 con 0x7efd2c0ade90 2023-06-09T11:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.067+0000 7efd227fc700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efd100662f0 0x7efd100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.067+0000 7efd227fc700 1 -- 172.21.15.78:0/2560683539 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd28085390 con 0x7efd2c0ade90 2023-06-09T11:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.067+0000 7efd31025700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efd100662f0 0x7efd100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.067+0000 7efd31025700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efd100662f0 0x7efd100687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b04f0 tx=0x7efd1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.071+0000 7efd227fc700 1 -- 172.21.15.78:0/2560683539 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efd280529d0 con 0x7efd2c0ade90 2023-06-09T11:12:48.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.243+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd2c067610 con 0x7efd2c0ade90 2023-06-09T11:12:48.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.243+0000 7efd227fc700 1 -- 172.21.15.78:0/2560683539 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd28055ff0 con 0x7efd2c0ade90 2023-06-09T11:12:48.254 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:48.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efd100662f0 msgr2=0x7efd100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efd100662f0 0x7efd100687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b04f0 tx=0x7efd1c008040 comp rx=0 tx=0).stop 2023-06-09T11:12:48.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c0ade90 msgr2=0x7efd2c1417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c0ade90 0x7efd2c1417e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0b1840 tx=0x7efd28004770 comp rx=0 tx=0).stop 2023-06-09T11:12:48.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 shutdown_connections 2023-06-09T11:12:48.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efd100662f0 0x7efd100687a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd2c15a490 0x7efd2c155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd2c0ce5b0 0x7efd2c15bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 --2- 172.21.15.78:0/2560683539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd2c0ade90 0x7efd2c1417e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 >> 172.21.15.78:0/2560683539 conn(0x7efd2c0b0780 msgr2=0x7efd2c15e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:48.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 shutdown_connections 2023-06-09T11:12:48.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.247+0000 7efd32828700 1 -- 172.21.15.78:0/2560683539 wait complete. 2023-06-09T11:12:48.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:48.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.451+0000 7ff90085a700 1 Processor -- start 2023-06-09T11:12:48.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.451+0000 7ff90085a700 1 -- start start 2023-06-09T11:12:48.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.451+0000 7ff90085a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8fc15a160 0x7ff8fc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff90085a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc06d730 con 0x7ff8fc070890 2023-06-09T11:12:48.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff90085a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc15a530 con 0x7ff8fc0d26d0 2023-06-09T11:12:48.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff90085a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc0d1190 con 0x7ff8fc15a160 2023-06-09T11:12:48.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fbfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff8fc070890 0x7ff8fc070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50492/0 (socket says 172.21.15.78:50492) 2023-06-09T11:12:48.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fbfff700 1 -- 172.21.15.78:0/1460046512 learned_addr learned my addr 172.21.15.78:0/1460046512 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fb7fe700 1 --2- 172.21.15.78:0/1460046512 >> v2:172.21.15.187:3300/0 conn(0x7ff8fc15a160 0x7ff8fc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688710159 0 0) 0x7ff8fc06d730 con 0x7ff8fc070890 2023-06-09T11:12:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e40035d0 con 0x7ff8fc070890 2023-06-09T11:12:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140777621 0 0) 0x7ff8e40035d0 con 0x7ff8fc070890 2023-06-09T11:12:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 >> v2:172.21.15.187:3300/0 conn(0x7ff8fc15a160 msgr2=0x7ff8fc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 --2- 172.21.15.78:0/1460046512 >> v2:172.21.15.187:3300/0 conn(0x7ff8fc15a160 0x7ff8fc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 >> v1:172.21.15.187:6789/0 conn(0x7ff8fc0d26d0 legacy=0x7ff8fc0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc15d180 con 0x7ff8fc070890 2023-06-09T11:12:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7ff8f4001a10 con 0x7ff8fc070890 2023-06-09T11:12:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 >> v1:172.21.15.78:6789/0 conn(0x7ff8fc070890 legacy=0x7ff8fc070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8e4003a20 0x7ff8e4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8e40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8e40050d0 0x7ff8e400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0d1190 con 0x7ff8e4004410 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e400c020 con 0x7ff8e40050d0 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e400c1e0 con 0x7ff8e4003a20 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8faffd700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8e40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fb7fe700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8e4003a20 0x7ff8e4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fbfff700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8e40050d0 0x7ff8e400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8faffd700 1 -- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8e4003a20 msgr2=0x7ff8e4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8faffd700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8e4003a20 0x7ff8e4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8faffd700 1 -- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8e40050d0 msgr2=0x7ff8e400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8faffd700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8e40050d0 0x7ff8e400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8faffd700 1 -- 172.21.15.78:0/1460046512 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e40035d0 con 0x7ff8e4004410 2023-06-09T11:12:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fbfff700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8e40050d0 0x7ff8e400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fbfff700 1 -- 172.21.15.78:0/1460046512 reap_dead start 2023-06-09T11:12:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8faffd700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8e40048d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00018f0 tx=0x7ff8e40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45684052e90e1d23 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.455+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0001390 con 0x7ff8e4004410 2023-06-09T11:12:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f00052f0 con 0x7ff8e4004410 2023-06-09T11:12:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff8fa7fc700 1 -- 172.21.15.78:0/1460046512 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00036a0 con 0x7ff8e4004410 2023-06-09T11:12:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 -- 172.21.15.78:0/1460046512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 msgr2=0x7ff8e40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8e40048d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00018f0 tx=0x7ff8e40058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 -- 172.21.15.78:0/1460046512 shutdown_connections 2023-06-09T11:12:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 --2- 172.21.15.78:0/1460046512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8e40048d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 -- 172.21.15.78:0/1460046512 >> 172.21.15.78:0/1460046512 conn(0x7ff8fc0cf930 msgr2=0x7ff8fc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 -- 172.21.15.78:0/1460046512 shutdown_connections 2023-06-09T11:12:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 -- 172.21.15.78:0/1460046512 wait complete. 2023-06-09T11:12:48.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 Processor -- start 2023-06-09T11:12:48.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 -- start start 2023-06-09T11:12:48.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.459+0000 7ff90085a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8fc0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff90085a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc160df0 0x7ff8fc1f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff90085a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc1f5e20 0x7ff8fc0b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff90085a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc1f5170 con 0x7ff8e4004410 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff90085a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b6320 con 0x7ff8fc160df0 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff90085a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b6600 con 0x7ff8fc1f5e20 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8fc0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8fc0c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52192/0 (socket says 172.21.15.78:52192) 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 -- 172.21.15.78:0/3357464467 learned_addr learned my addr 172.21.15.78:0/3357464467 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8faffd700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc160df0 0x7ff8fc1f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fbfff700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc1f5e20 0x7ff8fc0b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 -- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc1f5e20 msgr2=0x7ff8fc0b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc1f5e20 0x7ff8fc0b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 -- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc160df0 msgr2=0x7ff8fc1f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc160df0 0x7ff8fc1f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 -- 172.21.15.78:0/3357464467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc15d740 con 0x7ff8e4004410 2023-06-09T11:12:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8faffd700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc160df0 0x7ff8fc1f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8fb7fe700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8fc0c8200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0115d0 tx=0x7ff8ec0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8e3fff700 1 -- 172.21.15.78:0/3357464467 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec015870 con 0x7ff8e4004410 2023-06-09T11:12:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8e3fff700 1 -- 172.21.15.78:0/3357464467 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0159d0 con 0x7ff8e4004410 2023-06-09T11:12:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff8e3fff700 1 -- 172.21.15.78:0/3357464467 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec015d40 con 0x7ff8e4004410 2023-06-09T11:12:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc15d460 con 0x7ff8e4004410 2023-06-09T11:12:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.463+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc15da20 con 0x7ff8e4004410 2023-06-09T11:12:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.467+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc0b6b20 con 0x7ff8e4004410 2023-06-09T11:12:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.467+0000 7ff8e3fff700 1 -- 172.21.15.78:0/3357464467 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8ec0143e0 con 0x7ff8e4004410 2023-06-09T11:12:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.467+0000 7ff8e3fff700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8e80662f0 0x7ff8e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.467+0000 7ff8e3fff700 1 -- 172.21.15.78:0/3357464467 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff8ec083fe0 con 0x7ff8e4004410 2023-06-09T11:12:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.467+0000 7ff8faffd700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8e80662f0 0x7ff8e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.471+0000 7ff8faffd700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8e80662f0 0x7ff8e80687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc155df0 tx=0x7ff8f0005000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.475+0000 7ff8e3fff700 1 -- 172.21.15.78:0/3357464467 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff8ec0513e0 con 0x7ff8e4004410 2023-06-09T11:12:48.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.651+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8fc067610 con 0x7ff8e4004410 2023-06-09T11:12:48.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.651+0000 7ff8e3fff700 1 -- 172.21.15.78:0/3357464467 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8ec054a00 con 0x7ff8e4004410 2023-06-09T11:12:48.661 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:48.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8e80662f0 msgr2=0x7ff8e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8e80662f0 0x7ff8e80687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc155df0 tx=0x7ff8f0005000 comp rx=0 tx=0).stop 2023-06-09T11:12:48.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 msgr2=0x7ff8fc0c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8fc0c8200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0115d0 tx=0x7ff8ec0118e0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 shutdown_connections 2023-06-09T11:12:48.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8e80662f0 0x7ff8e80687a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8fc1f5e20 0x7ff8fc0b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8fc160df0 0x7ff8fc1f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 --2- 172.21.15.78:0/3357464467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e4004410 0x7ff8fc0c8200 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 >> 172.21.15.78:0/3357464467 conn(0x7ff8fc0cf930 msgr2=0x7ff8fc159910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:48.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 shutdown_connections 2023-06-09T11:12:48.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.655+0000 7ff90085a700 1 -- 172.21.15.78:0/3357464467 wait complete. 2023-06-09T11:12:48.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T11:12:48.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.843+0000 7f866ded1700 1 Processor -- start 2023-06-09T11:12:48.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.843+0000 7f866ded1700 1 -- start start 2023-06-09T11:12:48.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f866ded1700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f866806fc80 0x7f8668070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f866ded1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866815c880 0x7f866806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f866ded1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86680c87a0 con 0x7f86680c7cb0 2023-06-09T11:12:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f866ded1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8668070590 con 0x7f866815c880 2023-06-09T11:12:48.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f866ded1700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680c81e0 con 0x7f866806fc80 2023-06-09T11:12:48.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866815c880 0x7f866806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866815c880 0x7f866806df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52208/0 (socket says 172.21.15.78:52208) 2023-06-09T11:12:48.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 -- 172.21.15.78:0/1516071476 learned_addr learned my addr 172.21.15.78:0/1516071476 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:48.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f866cecf700 1 --2- 172.21.15.78:0/1516071476 >> v2:172.21.15.187:3300/0 conn(0x7f866806fc80 0x7f8668070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 -- 172.21.15.78:0/1516071476 >> v2:172.21.15.187:3300/0 conn(0x7f866806fc80 msgr2=0x7f8668070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:48.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 --2- 172.21.15.78:0/1516071476 >> v2:172.21.15.187:3300/0 conn(0x7f866806fc80 0x7f8668070050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 -- 172.21.15.78:0/1516071476 >> v1:172.21.15.187:6789/0 conn(0x7f86680c7cb0 legacy=0x7f866806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 -- 172.21.15.78:0/1516071476 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680c84c0 con 0x7f866815c880 2023-06-09T11:12:48.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f8667fff700 1 --2- 172.21.15.78:0/1516071476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866815c880 0x7f866806df50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8654009910 tx=0x7f8654009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b0e8324df5ff75 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f86677fe700 1 -- 172.21.15.78:0/1516071476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400ba20 con 0x7f866815c880 2023-06-09T11:12:48.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f86677fe700 1 -- 172.21.15.78:0/1516071476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400bb80 con 0x7f866815c880 2023-06-09T11:12:48.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.847+0000 7f86677fe700 1 -- 172.21.15.78:0/1516071476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654009e60 con 0x7f866815c880 2023-06-09T11:12:48.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 -- 172.21.15.78:0/1516071476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866815c880 msgr2=0x7f866806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 --2- 172.21.15.78:0/1516071476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866815c880 0x7f866806df50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8654009910 tx=0x7f8654009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:48.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 -- 172.21.15.78:0/1516071476 shutdown_connections 2023-06-09T11:12:48.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 --2- 172.21.15.78:0/1516071476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866815c880 0x7f866806df50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 --2- 172.21.15.78:0/1516071476 >> v2:172.21.15.187:3300/0 conn(0x7f866806fc80 0x7f8668070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 -- 172.21.15.78:0/1516071476 >> 172.21.15.78:0/1516071476 conn(0x7f86680cf870 msgr2=0x7f86680cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:48.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 -- 172.21.15.78:0/1516071476 shutdown_connections 2023-06-09T11:12:48.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 -- 172.21.15.78:0/1516071476 wait complete. 2023-06-09T11:12:48.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 Processor -- start 2023-06-09T11:12:48.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.851+0000 7f866ded1700 1 -- start start 2023-06-09T11:12:48.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866806fc80 0x7f86681f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86680c7cb0 0x7f86681f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866815c880 0x7f866815a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681f63a0 con 0x7f86680c7cb0 2023-06-09T11:12:48.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681f5de0 con 0x7f866806fc80 2023-06-09T11:12:48.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86681f60c0 con 0x7f866815c880 2023-06-09T11:12:48.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86680c7cb0 0x7f86681f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86680c7cb0 0x7f86681f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52210/0 (socket says 172.21.15.78:52210) 2023-06-09T11:12:48.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 -- 172.21.15.78:0/1775676112 learned_addr learned my addr 172.21.15.78:0/1775676112 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:48.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866d6d0700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866815c880 0x7f866815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866cecf700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866806fc80 0x7f86681f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 -- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866815c880 msgr2=0x7f866815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866815c880 0x7f866815a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 -- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866806fc80 msgr2=0x7f86681f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:48.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866806fc80 0x7f86681f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:48.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 -- 172.21.15.78:0/1775676112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654009570 con 0x7f86680c7cb0 2023-06-09T11:12:48.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866cecf700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866806fc80 0x7f86681f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:48.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f8667fff700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86680c7cb0 0x7f86681f5400 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8654014040 tx=0x7f8654004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f86657fa700 1 -- 172.21.15.78:0/1775676112 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654004610 con 0x7f86680c7cb0 2023-06-09T11:12:48.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f86657fa700 1 -- 172.21.15.78:0/1775676112 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865401e070 con 0x7f86680c7cb0 2023-06-09T11:12:48.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f86657fa700 1 -- 172.21.15.78:0/1775676112 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654003900 con 0x7f86680c7cb0 2023-06-09T11:12:48.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866806a350 con 0x7f86680c7cb0 2023-06-09T11:12:48.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.855+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866806a070 con 0x7f86680c7cb0 2023-06-09T11:12:48.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.859+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866815d0e0 con 0x7f86680c7cb0 2023-06-09T11:12:48.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.859+0000 7f86657fa700 1 -- 172.21.15.78:0/1775676112 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8654003a60 con 0x7f86680c7cb0 2023-06-09T11:12:48.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.863+0000 7f86657fa700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f864c0662f0 0x7f864c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:48.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.863+0000 7f86657fa700 1 -- 172.21.15.78:0/1775676112 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8654020070 con 0x7f86680c7cb0 2023-06-09T11:12:48.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.863+0000 7f866cecf700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f864c0662f0 0x7f864c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:48.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.863+0000 7f866cecf700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f864c0662f0 0x7f864c0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f865c009a10 tx=0x7f865c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:48.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:48.871+0000 7f86657fa700 1 -- 172.21.15.78:0/1775676112 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f86540b56f0 con 0x7f86680c7cb0 2023-06-09T11:12:49.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.055+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f86680741c0 con 0x7f86680c7cb0 2023-06-09T11:12:49.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.055+0000 7f86657fa700 1 -- 172.21.15.78:0/1775676112 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f866815d0e0 con 0x7f86680c7cb0 2023-06-09T11:12:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f864c0662f0 msgr2=0x7f864c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f864c0662f0 0x7f864c0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f865c009a10 tx=0x7f865c008040 comp rx=0 tx=0).stop 2023-06-09T11:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86680c7cb0 msgr2=0x7f86681f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86680c7cb0 0x7f86681f5400 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8654014040 tx=0x7f8654004770 comp rx=0 tx=0).stop 2023-06-09T11:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 shutdown_connections 2023-06-09T11:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f864c0662f0 0x7f864c0687a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866815c880 0x7f866815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86680c7cb0 0x7f86681f5400 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 --2- 172.21.15.78:0/1775676112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866806fc80 0x7f86681f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 >> 172.21.15.78:0/1775676112 conn(0x7f86680cf870 msgr2=0x7f86680cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 shutdown_connections 2023-06-09T11:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.059+0000 7f866ded1700 1 -- 172.21.15.78:0/1775676112 wait complete. 2023-06-09T11:12:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-09T11:12:49.085 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-09T11:12:49.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:49.086 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-09T11:12:49.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T11:12:49.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:49.177 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T11:12:49.210 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:49.210 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:49.231 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:49.231 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:49.297 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:12:49.298 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:49.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:49.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 Processor -- start 2023-06-09T11:12:49.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 -- start start 2023-06-09T11:12:49.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f90fc159530 0x7f90fc069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f90fc0ca5c0 0x7f90fc06f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90fc0cb520 con 0x7f90fc0ca5c0 2023-06-09T11:12:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90fc06a860 con 0x7f90fc159530 2023-06-09T11:12:49.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9103b69700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc0caa40 con 0x7f90fc06a410 2023-06-09T11:12:49.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9102106700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f90fc0ca5c0 0x7f90fc06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9102106700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f90fc0ca5c0 0x7f90fc06f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52222/0 (socket says 172.21.15.78:52222) 2023-06-09T11:12:49.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9102106700 1 -- 172.21.15.78:0/838514102 learned_addr learned my addr 172.21.15.78:0/838514102 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:49.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9101104700 1 --2- 172.21.15.78:0/838514102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.567+0000 7f9101905700 1 --2- 172.21.15.78:0/838514102 >> v2:172.21.15.187:3300/0 conn(0x7f90fc159530 0x7f90fc069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9102106700 1 -- 172.21.15.78:0/838514102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 msgr2=0x7f90fc0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:49.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9102106700 1 --2- 172.21.15.78:0/838514102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9102106700 1 -- 172.21.15.78:0/838514102 >> v2:172.21.15.187:3300/0 conn(0x7f90fc159530 msgr2=0x7f90fc069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:49.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9102106700 1 --2- 172.21.15.78:0/838514102 >> v2:172.21.15.187:3300/0 conn(0x7f90fc159530 0x7f90fc069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9102106700 1 -- 172.21.15.78:0/838514102 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc0cca40 con 0x7f90fc0ca5c0 2023-06-09T11:12:49.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9101905700 1 --2- 172.21.15.78:0/838514102 >> v2:172.21.15.187:3300/0 conn(0x7f90fc159530 0x7f90fc069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:49.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9102106700 1 --2- 172.21.15.78:0/838514102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0ca5c0 0x7f90fc06f880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f90fc067320 tx=0x7f90f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c763907395bb184 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:49.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9100903700 1 -- 172.21.15.78:0/838514102 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400e070 con 0x7f90fc0ca5c0 2023-06-09T11:12:49.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9100903700 1 -- 172.21.15.78:0/838514102 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f400b9c0 con 0x7f90fc0ca5c0 2023-06-09T11:12:49.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9100903700 1 -- 172.21.15.78:0/838514102 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400bd70 con 0x7f90fc0ca5c0 2023-06-09T11:12:49.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 -- 172.21.15.78:0/838514102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0ca5c0 msgr2=0x7f90fc06f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 --2- 172.21.15.78:0/838514102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0ca5c0 0x7f90fc06f880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f90fc067320 tx=0x7f90f400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:49.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 -- 172.21.15.78:0/838514102 shutdown_connections 2023-06-09T11:12:49.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 --2- 172.21.15.78:0/838514102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0ca5c0 0x7f90fc06f880 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 --2- 172.21.15.78:0/838514102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 --2- 172.21.15.78:0/838514102 >> v2:172.21.15.187:3300/0 conn(0x7f90fc159530 0x7f90fc069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 -- 172.21.15.78:0/838514102 >> 172.21.15.78:0/838514102 conn(0x7f90fc0b1480 msgr2=0x7f90fc0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:49.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 -- 172.21.15.78:0/838514102 shutdown_connections 2023-06-09T11:12:49.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.571+0000 7f9103b69700 1 -- 172.21.15.78:0/838514102 wait complete. 2023-06-09T11:12:49.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.575+0000 7f9103b69700 1 Processor -- start 2023-06-09T11:12:49.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.575+0000 7f9103b69700 1 -- start start 2023-06-09T11:12:49.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc1480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90fc0ca5c0 0x7f90fc0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc159530 0x7f90fc0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc15a390 con 0x7f90fc159530 2023-06-09T11:12:49.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc15a670 con 0x7f90fc0ca5c0 2023-06-09T11:12:49.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc15a950 con 0x7f90fc06a410 2023-06-09T11:12:49.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc159530 0x7f90fc0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc159530 0x7f90fc0aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52224/0 (socket says 172.21.15.78:52224) 2023-06-09T11:12:49.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 -- 172.21.15.78:0/2407154460 learned_addr learned my addr 172.21.15.78:0/2407154460 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:49.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9101905700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc1480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9101104700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90fc0ca5c0 0x7f90fc0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 -- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 msgr2=0x7f90fc1480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc1480e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 -- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90fc0ca5c0 msgr2=0x7f90fc0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90fc0ca5c0 0x7f90fc0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 -- 172.21.15.78:0/2407154460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4009b30 con 0x7f90fc159530 2023-06-09T11:12:49.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9101905700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc1480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:49.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9102106700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc159530 0x7f90fc0aee70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90fc073aa0 tx=0x7f90f4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:49.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f90f27fc700 1 -- 172.21.15.78:0/2407154460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4004250 con 0x7f90fc159530 2023-06-09T11:12:49.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f90f27fc700 1 -- 172.21.15.78:0/2407154460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f40043b0 con 0x7f90fc159530 2023-06-09T11:12:49.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f90f27fc700 1 -- 172.21.15.78:0/2407154460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4004760 con 0x7f90fc159530 2023-06-09T11:12:49.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc0caf60 con 0x7f90fc159530 2023-06-09T11:12:49.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.579+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90fc0cac80 con 0x7f90fc159530 2023-06-09T11:12:49.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.583+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90fc0cb240 con 0x7f90fc159530 2023-06-09T11:12:49.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.583+0000 7f90f27fc700 1 -- 172.21.15.78:0/2407154460 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90f401c440 con 0x7f90fc159530 2023-06-09T11:12:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.583+0000 7f90f27fc700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f90e00662f0 0x7f90e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.587+0000 7f90f27fc700 1 -- 172.21.15.78:0/2407154460 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f90f4085650 con 0x7f90fc159530 2023-06-09T11:12:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.587+0000 7f9101905700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f90e00662f0 0x7f90e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.587+0000 7f9101905700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f90e00662f0 0x7f90e00687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90f800c9a0 tx=0x7f90f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:49.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.591+0000 7f90f27fc700 1 -- 172.21.15.78:0/2407154460 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f90f4052b20 con 0x7f90fc159530 2023-06-09T11:12:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.767+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90fc0741c0 con 0x7f90fc159530 2023-06-09T11:12:49.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f90f27fc700 1 -- 172.21.15.78:0/2407154460 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f90f4056140 con 0x7f90fc159530 2023-06-09T11:12:49.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:49.779 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:49.372533+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f90e00662f0 msgr2=0x7f90e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f90e00662f0 0x7f90e00687a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90f800c9a0 tx=0x7f90f8008040 comp rx=0 tx=0).stop 2023-06-09T11:12:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc159530 msgr2=0x7f90fc0aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc159530 0x7f90fc0aee70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90fc073aa0 tx=0x7f90f4004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 shutdown_connections 2023-06-09T11:12:49.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f90e00662f0 0x7f90e00687a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc159530 0x7f90fc0aee70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90fc0ca5c0 0x7f90fc0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 --2- 172.21.15.78:0/2407154460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90fc06a410 0x7f90fc1480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 >> 172.21.15.78:0/2407154460 conn(0x7f90fc0b1480 msgr2=0x7f90fc158700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 shutdown_connections 2023-06-09T11:12:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.771+0000 7f9103b69700 1 -- 172.21.15.78:0/2407154460 wait complete. 2023-06-09T11:12:49.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:49.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:49.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.963+0000 7f68ef59e700 1 Processor -- start 2023-06-09T11:12:49.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.967+0000 7f68ef59e700 1 -- start start 2023-06-09T11:12:49.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.967+0000 7f68ef59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68f015a490 0x7f68f006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.967+0000 7f68ef59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f006ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ef59e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00cd5e0 con 0x7f68f00ce5b0 2023-06-09T11:12:49.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ef59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f0069ed0 con 0x7f68f015a490 2023-06-09T11:12:49.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ef59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f015a860 con 0x7f68f00ade90 2023-06-09T11:12:49.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68f015a490 0x7f68f006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68f015a490 0x7f68f006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52236/0 (socket says 172.21.15.78:52236) 2023-06-09T11:12:49.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 -- 172.21.15.78:0/1711613024 learned_addr learned my addr 172.21.15.78:0/1711613024 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:49.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68edd9b700 1 --2- 172.21.15.78:0/1711613024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f006ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 -- 172.21.15.78:0/1711613024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 msgr2=0x7f68f006ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:49.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 --2- 172.21.15.78:0/1711613024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f006ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 -- 172.21.15.78:0/1711613024 >> v1:172.21.15.187:6789/0 conn(0x7f68f00ce5b0 legacy=0x7f68f006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 -- 172.21.15.78:0/1711613024 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00cd810 con 0x7f68f015a490 2023-06-09T11:12:49.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ee59c700 1 --2- 172.21.15.78:0/1711613024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f015a490 0x7f68f006d690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009910 tx=0x7f68e0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226ccc139fe19ebf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:49.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ed59a700 1 -- 172.21.15.78:0/1711613024 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0011830 con 0x7f68f015a490 2023-06-09T11:12:49.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ed59a700 1 -- 172.21.15.78:0/1711613024 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0011990 con 0x7f68f015a490 2023-06-09T11:12:49.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.971+0000 7f68ed59a700 1 -- 172.21.15.78:0/1711613024 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0011d40 con 0x7f68f015a490 2023-06-09T11:12:49.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 -- 172.21.15.78:0/1711613024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f015a490 msgr2=0x7f68f006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1711613024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f015a490 0x7f68f006d690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009910 tx=0x7f68e0009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:49.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 -- 172.21.15.78:0/1711613024 shutdown_connections 2023-06-09T11:12:49.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1711613024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f006ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1711613024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f015a490 0x7f68f006d690 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 -- 172.21.15.78:0/1711613024 >> 172.21.15.78:0/1711613024 conn(0x7f68f00b0780 msgr2=0x7f68f00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:49.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 -- 172.21.15.78:0/1711613024 shutdown_connections 2023-06-09T11:12:49.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.975+0000 7f68ef59e700 1 -- 172.21.15.78:0/1711613024 wait complete. 2023-06-09T11:12:49.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 Processor -- start 2023-06-09T11:12:49.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 -- start start 2023-06-09T11:12:49.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f01f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f00ce5b0 0x7f68f015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68f015a490 0x7f68f014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f014b0a0 con 0x7f68f00ce5b0 2023-06-09T11:12:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f01f2c60 con 0x7f68f015a490 2023-06-09T11:12:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f014b360 con 0x7f68f00ade90 2023-06-09T11:12:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f00ce5b0 0x7f68f015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f00ce5b0 0x7f68f015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52244/0 (socket says 172.21.15.78:52244) 2023-06-09T11:12:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 -- 172.21.15.78:0/1395576514 learned_addr learned my addr 172.21.15.78:0/1395576514 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ee59c700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f01f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68eed9d700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68f015a490 0x7f68f014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 -- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 msgr2=0x7f68f01f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f01f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 -- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68f015a490 msgr2=0x7f68f014cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68f015a490 0x7f68f014cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 -- 172.21.15.78:0/1395576514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009570 con 0x7f68f00ce5b0 2023-06-09T11:12:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68eed9d700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68f015a490 0x7f68f014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68edd9b700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f00ce5b0 0x7f68f015c370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68e400e840 tx=0x7f68e400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68deffd700 1 -- 172.21.15.78:0/1395576514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40095a0 con 0x7f68f00ce5b0 2023-06-09T11:12:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68deffd700 1 -- 172.21.15.78:0/1395576514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4013680 con 0x7f68f00ce5b0 2023-06-09T11:12:49.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68deffd700 1 -- 172.21.15.78:0/1395576514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40139f0 con 0x7f68f00ce5b0 2023-06-09T11:12:49.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.979+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f006a390 con 0x7f68f00ce5b0 2023-06-09T11:12:49.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.983+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f006a0b0 con 0x7f68f00ce5b0 2023-06-09T11:12:49.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.983+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f006a670 con 0x7f68f00ce5b0 2023-06-09T11:12:49.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.983+0000 7f68deffd700 1 -- 172.21.15.78:0/1395576514 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68e4013b50 con 0x7f68f00ce5b0 2023-06-09T11:12:49.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.987+0000 7f68deffd700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68d00662f0 0x7f68d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:49.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.987+0000 7f68deffd700 1 -- 172.21.15.78:0/1395576514 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f68e4083c50 con 0x7f68f00ce5b0 2023-06-09T11:12:49.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.987+0000 7f68ee59c700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68d00662f0 0x7f68d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:49.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.987+0000 7f68ee59c700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68d00662f0 0x7f68d00687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f68e0000c00 tx=0x7f68e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:50.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:49.991+0000 7f68deffd700 1 -- 172.21.15.78:0/1395576514 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f68e4089020 con 0x7f68f00ce5b0 2023-06-09T11:12:50.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.167+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68f0067610 con 0x7f68f00ce5b0 2023-06-09T11:12:50.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68deffd700 1 -- 172.21.15.78:0/1395576514 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68e4017020 con 0x7f68f00ce5b0 2023-06-09T11:12:50.179 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:50.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68d00662f0 msgr2=0x7f68d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68d00662f0 0x7f68d00687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f68e0000c00 tx=0x7f68e0008030 comp rx=0 tx=0).stop 2023-06-09T11:12:50.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f00ce5b0 msgr2=0x7f68f015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f00ce5b0 0x7f68f015c370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68e400e840 tx=0x7f68e400eb50 comp rx=0 tx=0).stop 2023-06-09T11:12:50.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 shutdown_connections 2023-06-09T11:12:50.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f68d00662f0 0x7f68d00687a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68f015a490 0x7f68f014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68f00ce5b0 0x7f68f015c370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 --2- 172.21.15.78:0/1395576514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f68f00ade90 0x7f68f01f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.171+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 >> 172.21.15.78:0/1395576514 conn(0x7f68f00b0780 msgr2=0x7f68f00cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:50.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.175+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 shutdown_connections 2023-06-09T11:12:50.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.175+0000 7f68ef59e700 1 -- 172.21.15.78:0/1395576514 wait complete. 2023-06-09T11:12:50.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dc1901700 1 Processor -- start 2023-06-09T11:12:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dc1901700 1 -- start start 2023-06-09T11:12:50.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dc1901700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 0x7f0dbc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dc1901700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc06d730 con 0x7f0dbc0d26d0 2023-06-09T11:12:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dc1901700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc15a530 con 0x7f0dbc070890 2023-06-09T11:12:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dc1901700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0d1190 con 0x7f0dbc15a160 2023-06-09T11:12:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dba7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0dbc0d26d0 0x7f0dbc0d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50500/0 (socket says 172.21.15.78:50500) 2023-06-09T11:12:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dba7fc700 1 -- 172.21.15.78:0/3063640920 learned_addr learned my addr 172.21.15.78:0/3063640920 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 0x7f0dbc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054132521 0 0) 0x7f0dbc06d730 con 0x7f0dbc0d26d0 2023-06-09T11:12:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.367+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da40035d0 con 0x7f0dbc0d26d0 2023-06-09T11:12:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996109178 0 0) 0x7f0dbc15a530 con 0x7f0dbc070890 2023-06-09T11:12:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dbc06d730 con 0x7f0dbc070890 2023-06-09T11:12:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 13253935 0 0) 0x7f0da40035d0 con 0x7f0dbc0d26d0 2023-06-09T11:12:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 msgr2=0x7f0dbc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 0x7f0dbc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 >> v1:172.21.15.187:6789/0 conn(0x7f0dbc070890 legacy=0x7f0dbc06dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc15d180 con 0x7f0dbc0d26d0 2023-06-09T11:12:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f0db00015f0 con 0x7f0dbc0d26d0 2023-06-09T11:12:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 >> v1:172.21.15.78:6789/0 conn(0x7f0dbc0d26d0 legacy=0x7f0dbc0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da4003be0 0x7f0da4003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 0x7f0da4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0da4004db0 0x7f0da4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0d1190 con 0x7f0da4003be0 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da400bae0 con 0x7f0da4004db0 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da400bca0 con 0x7f0dbc15a160 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da4003be0 0x7f0da4003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dba7fc700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 0x7f0da4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbb7fe700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0da4004db0 0x7f0da4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbaffd700 1 -- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 msgr2=0x7f0da4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:50.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 0x7f0da4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbaffd700 1 -- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0da4004db0 msgr2=0x7f0da4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0da4004db0 0x7f0da4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbaffd700 1 -- 172.21.15.78:0/3063640920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da40035d0 con 0x7f0da4003be0 2023-06-09T11:12:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dba7fc700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0dbc15a160 0x7f0da4004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da4003be0 0x7f0da4003fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009b40 tx=0x7f0da40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45255178157b4236 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00e6c0 con 0x7f0da4003be0 2023-06-09T11:12:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00e820 con 0x7f0da4003be0 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0db9ffb700 1 -- 172.21.15.78:0/3063640920 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00eb90 con 0x7f0da4003be0 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dc1901700 1 -- 172.21.15.78:0/3063640920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da4003be0 msgr2=0x7f0da4003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dc1901700 1 --2- 172.21.15.78:0/3063640920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0da4003be0 0x7f0da4003fd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009b40 tx=0x7f0da40058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dbb7fe700 1 -- 172.21.15.78:0/3063640920 reap_dead start 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dc1901700 1 -- 172.21.15.78:0/3063640920 shutdown_connections 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dc1901700 1 -- 172.21.15.78:0/3063640920 >> 172.21.15.78:0/3063640920 conn(0x7f0dbc0cf930 msgr2=0x7f0dbc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dc1901700 1 -- 172.21.15.78:0/3063640920 shutdown_connections 2023-06-09T11:12:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.371+0000 7f0dc1901700 1 -- 172.21.15.78:0/3063640920 wait complete. 2023-06-09T11:12:50.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.375+0000 7f0dc1901700 1 Processor -- start 2023-06-09T11:12:50.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.375+0000 7f0dc1901700 1 -- start start 2023-06-09T11:12:50.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0da4003be0 0x7f0dbc0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dbc1f5350 0x7f0dbc1f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc1f5fa0 0x7f0dbc15eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b2f70 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b3250 con 0x7f0dbc1f5350 2023-06-09T11:12:50.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b3530 con 0x7f0da4003be0 2023-06-09T11:12:50.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc1f5fa0 0x7f0dbc15eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc1f5fa0 0x7f0dbc15eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52248/0 (socket says 172.21.15.78:52248) 2023-06-09T11:12:50.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 -- 172.21.15.78:0/3525966016 learned_addr learned my addr 172.21.15.78:0/3525966016 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:50.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0da4003be0 0x7f0dbc0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dba7fc700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dbc1f5350 0x7f0dbc1f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 -- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0da4003be0 msgr2=0x7f0dbc0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0da4003be0 0x7f0dbc0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 -- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dbc1f5350 msgr2=0x7f0dbc1f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dbc1f5350 0x7f0dbc1f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 -- 172.21.15.78:0/3525966016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc15d740 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dbb7fe700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc1f5fa0 0x7f0dbc15eeb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc06ccc0 tx=0x7f0db400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0da3fff700 1 -- 172.21.15.78:0/3525966016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4003c30 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0da3fff700 1 -- 172.21.15.78:0/3525966016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4003d90 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc15d460 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0da3fff700 1 -- 172.21.15.78:0/3525966016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4005310 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.379+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc15da20 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.383+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc067610 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.383+0000 7f0da3fff700 1 -- 172.21.15.78:0/3525966016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0db4005470 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.387+0000 7f0da3fff700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0da8066320 0x7f0da80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.387+0000 7f0da3fff700 1 -- 172.21.15.78:0/3525966016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0db4083c70 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.387+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0da8066320 0x7f0da80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.387+0000 7f0dbaffd700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0da8066320 0x7f0da80687d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0dac000c00 tx=0x7f0dac01f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.395+0000 7f0da3fff700 1 -- 172.21.15.78:0/3525966016 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0db4051140 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.563+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0dbc06f1d0 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.563+0000 7f0da3fff700 1 -- 172.21.15.78:0/3525966016 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0db4054760 con 0x7f0dbc1f5fa0 2023-06-09T11:12:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:50.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0da8066320 msgr2=0x7f0da80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0da8066320 0x7f0da80687d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0dac000c00 tx=0x7f0dac01f040 comp rx=0 tx=0).stop 2023-06-09T11:12:50.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc1f5fa0 msgr2=0x7f0dbc15eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc1f5fa0 0x7f0dbc15eeb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc06ccc0 tx=0x7f0db400ef00 comp rx=0 tx=0).stop 2023-06-09T11:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 shutdown_connections 2023-06-09T11:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0da8066320 0x7f0da80687d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dbc1f5fa0 0x7f0dbc15eeb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dbc1f5350 0x7f0dbc1f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 --2- 172.21.15.78:0/3525966016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0da4003be0 0x7f0dbc0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 >> 172.21.15.78:0/3525966016 conn(0x7f0dbc0cf930 msgr2=0x7f0dbc06dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 shutdown_connections 2023-06-09T11:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.567+0000 7f0dc1901700 1 -- 172.21.15.78:0/3525966016 wait complete. 2023-06-09T11:12:50.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.763+0000 7fa6115a7700 1 Processor -- start 2023-06-09T11:12:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa6115a7700 1 -- start start 2023-06-09T11:12:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa6115a7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa6115a7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa60c0ca180 0x7fa60c0ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa6115a7700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c15a7f0 con 0x7fa60c0cda10 2023-06-09T11:12:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa6115a7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c159c20 con 0x7fa60c0ca180 2023-06-09T11:12:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa6115a7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0ce320 con 0x7fa60c0cbdb0 2023-06-09T11:12:50.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa60c0ca180 0x7fa60c0ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa603fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa60c0ca180 0x7fa60c0ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52258/0 (socket says 172.21.15.78:52258) 2023-06-09T11:12:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60b7fe700 1 -- 172.21.15.78:0/822157110 learned_addr learned my addr 172.21.15.78:0/822157110 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60affd700 1 --1- 172.21.15.78:0/822157110 >> v1:172.21.15.187:6789/0 conn(0x7fa60c0cda10 0x7fa60c15db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:37548/0 (socket says 172.21.15.78:37548) 2023-06-09T11:12:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60b7fe700 1 -- 172.21.15.78:0/822157110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 msgr2=0x7fa60c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60b7fe700 1 --2- 172.21.15.78:0/822157110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60b7fe700 1 -- 172.21.15.78:0/822157110 >> v1:172.21.15.187:6789/0 conn(0x7fa60c0cda10 legacy=0x7fa60c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.767+0000 7fa60b7fe700 1 -- 172.21.15.78:0/822157110 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c159ec0 con 0x7fa60c0ca180 2023-06-09T11:12:50.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa60b7fe700 1 --2- 172.21.15.78:0/822157110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0ca600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa60400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159a70d2c660edce server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa60a7fc700 1 -- 172.21.15.78:0/822157110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400e070 con 0x7fa60c0ca180 2023-06-09T11:12:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa60a7fc700 1 -- 172.21.15.78:0/822157110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400b910 con 0x7fa60c0ca180 2023-06-09T11:12:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa60a7fc700 1 -- 172.21.15.78:0/822157110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400bcc0 con 0x7fa60c0ca180 2023-06-09T11:12:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 -- 172.21.15.78:0/822157110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 msgr2=0x7fa60c0ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 --2- 172.21.15.78:0/822157110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0ca600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa60400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:50.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 -- 172.21.15.78:0/822157110 shutdown_connections 2023-06-09T11:12:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 --2- 172.21.15.78:0/822157110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0ca600 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 --2- 172.21.15.78:0/822157110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 -- 172.21.15.78:0/822157110 >> 172.21.15.78:0/822157110 conn(0x7fa60c0cf8b0 msgr2=0x7fa60c0cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 -- 172.21.15.78:0/822157110 shutdown_connections 2023-06-09T11:12:50.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.771+0000 7fa6115a7700 1 -- 172.21.15.78:0/822157110 wait complete. 2023-06-09T11:12:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.775+0000 7fa6115a7700 1 Processor -- start 2023-06-09T11:12:50.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.775+0000 7fa6115a7700 1 -- start start 2023-06-09T11:12:50.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa60c0cda10 0x7fa60c14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c14df70 con 0x7fa60c0ca180 2023-06-09T11:12:50.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0c8930 con 0x7fa60c0cda10 2023-06-09T11:12:50.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c1e62e0 con 0x7fa60c0cbdb0 2023-06-09T11:12:50.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52264/0 (socket says 172.21.15.78:52264) 2023-06-09T11:12:50.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 -- 172.21.15.78:0/409031815 learned_addr learned my addr 172.21.15.78:0/409031815 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:50.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa603fff700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60b7fe700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa60c0cda10 0x7fa60c14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 -- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 msgr2=0x7fa60c0c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 -- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa60c0cda10 msgr2=0x7fa60c14da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa60c0cda10 0x7fa60c14da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 -- 172.21.15.78:0/409031815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604009b30 con 0x7fa60c0ca180 2023-06-09T11:12:50.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa603fff700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:50.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60b7fe700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa60c0cda10 0x7fa60c14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:50.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa60affd700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0c82a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c4d0 tx=0x7fa5fc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6037fe700 1 -- 172.21.15.78:0/409031815 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc005cd0 con 0x7fa60c0ca180 2023-06-09T11:12:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6037fe700 1 -- 172.21.15.78:0/409031815 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc005e30 con 0x7fa60c0ca180 2023-06-09T11:12:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c15a480 con 0x7fa60c0ca180 2023-06-09T11:12:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6037fe700 1 -- 172.21.15.78:0/409031815 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0072d0 con 0x7fa60c0ca180 2023-06-09T11:12:50.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.779+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c15a1a0 con 0x7fa60c0ca180 2023-06-09T11:12:50.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.783+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c157470 con 0x7fa60c0ca180 2023-06-09T11:12:50.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.783+0000 7fa6037fe700 1 -- 172.21.15.78:0/409031815 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5fc007430 con 0x7fa60c0ca180 2023-06-09T11:12:50.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.787+0000 7fa6037fe700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa5ec066320 0x7fa5ec0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:50.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.787+0000 7fa6037fe700 1 -- 172.21.15.78:0/409031815 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa5fc083140 con 0x7fa60c0ca180 2023-06-09T11:12:50.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.787+0000 7fa603fff700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa5ec066320 0x7fa5ec0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:50.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.787+0000 7fa603fff700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa5ec066320 0x7fa5ec0687d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa60c15c650 tx=0x7fa5f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.791+0000 7fa6037fe700 1 -- 172.21.15.78:0/409031815 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa5fc050590 con 0x7fa60c0ca180 2023-06-09T11:12:50.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.963+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa60c0741c0 con 0x7fa60c0ca180 2023-06-09T11:12:50.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.963+0000 7fa6037fe700 1 -- 172.21.15.78:0/409031815 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5fc053bb0 con 0x7fa60c0ca180 2023-06-09T11:12:50.971 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:50.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa5ec066320 msgr2=0x7fa5ec0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa5ec066320 0x7fa5ec0687d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa60c15c650 tx=0x7fa5f4008040 comp rx=0 tx=0).stop 2023-06-09T11:12:50.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 msgr2=0x7fa60c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:50.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0c82a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c4d0 tx=0x7fa5fc00c890 comp rx=0 tx=0).stop 2023-06-09T11:12:50.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 shutdown_connections 2023-06-09T11:12:50.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa5ec066320 0x7fa5ec0687d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa60c0cda10 0x7fa60c14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa60c0cbdb0 0x7fa60c0c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 --2- 172.21.15.78:0/409031815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa60c0ca180 0x7fa60c0c82a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:50.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 >> 172.21.15.78:0/409031815 conn(0x7fa60c0cf8b0 msgr2=0x7fa60c06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:50.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 shutdown_connections 2023-06-09T11:12:50.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:50.967+0000 7fa6115a7700 1 -- 172.21.15.78:0/409031815 wait complete. 2023-06-09T11:12:50.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:51.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94bf59e700 1 Processor -- start 2023-06-09T11:12:51.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94bf59e700 1 -- start start 2023-06-09T11:12:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94bf59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c0146c50 0x7f94c00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94bf59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94c006b6e0 0x7f94c0160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94bf59e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c006e6a0 con 0x7f94c0161440 2023-06-09T11:12:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94bf59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c006a070 con 0x7f94c006b6e0 2023-06-09T11:12:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94bf59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c006a310 con 0x7f94c0146c50 2023-06-09T11:12:51.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.163+0000 7f94b7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94c006b6e0 0x7f94c0160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94b7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94c006b6e0 0x7f94c0160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52274/0 (socket says 172.21.15.78:52274) 2023-06-09T11:12:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94b7fff700 1 -- 172.21.15.78:0/1544687708 learned_addr learned my addr 172.21.15.78:0/1544687708 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94be59c700 1 --2- 172.21.15.78:0/1544687708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c0146c50 0x7f94c00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94b7fff700 1 -- 172.21.15.78:0/1544687708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c0146c50 msgr2=0x7f94c00b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94b7fff700 1 --2- 172.21.15.78:0/1544687708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c0146c50 0x7f94c00b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94b7fff700 1 -- 172.21.15.78:0/1544687708 >> v1:172.21.15.187:6789/0 conn(0x7f94c0161440 legacy=0x7f94c0164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94b7fff700 1 -- 172.21.15.78:0/1544687708 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c006a5f0 con 0x7f94c006b6e0 2023-06-09T11:12:51.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94b7fff700 1 --2- 172.21.15.78:0/1544687708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c006b6e0 0x7f94c0160f00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009910 tx=0x7f94a8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11aa85435db5d51 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bdd9b700 1 -- 172.21.15.78:0/1544687708 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8011830 con 0x7f94c006b6e0 2023-06-09T11:12:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bdd9b700 1 -- 172.21.15.78:0/1544687708 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a8011990 con 0x7f94c006b6e0 2023-06-09T11:12:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bdd9b700 1 -- 172.21.15.78:0/1544687708 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8011d40 con 0x7f94c006b6e0 2023-06-09T11:12:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 -- 172.21.15.78:0/1544687708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c006b6e0 msgr2=0x7f94c0160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 --2- 172.21.15.78:0/1544687708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c006b6e0 0x7f94c0160f00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009910 tx=0x7f94a8009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 -- 172.21.15.78:0/1544687708 shutdown_connections 2023-06-09T11:12:51.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 --2- 172.21.15.78:0/1544687708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c006b6e0 0x7f94c0160f00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 --2- 172.21.15.78:0/1544687708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c0146c50 0x7f94c00b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 -- 172.21.15.78:0/1544687708 >> 172.21.15.78:0/1544687708 conn(0x7f94c00b0780 msgr2=0x7f94c00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 -- 172.21.15.78:0/1544687708 shutdown_connections 2023-06-09T11:12:51.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.167+0000 7f94bf59e700 1 -- 172.21.15.78:0/1544687708 wait complete. 2023-06-09T11:12:51.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.171+0000 7f94bf59e700 1 Processor -- start 2023-06-09T11:12:51.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.171+0000 7f94bf59e700 1 -- start start 2023-06-09T11:12:51.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c006b6e0 0x7f94c01575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c0146c50 0x7f94c00cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c0161440 0x7f94c0144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00cf360 con 0x7f94c0146c50 2023-06-09T11:12:51.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00ce460 con 0x7f94c0161440 2023-06-09T11:12:51.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00ce6e0 con 0x7f94c006b6e0 2023-06-09T11:12:51.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c0146c50 0x7f94c00cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c0146c50 0x7f94c00cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52286/0 (socket says 172.21.15.78:52286) 2023-06-09T11:12:51.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 -- 172.21.15.78:0/10329722 learned_addr learned my addr 172.21.15.78:0/10329722 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:51.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94be59c700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c006b6e0 0x7f94c01575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bed9d700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c0161440 0x7f94c0144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 -- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c006b6e0 msgr2=0x7f94c01575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c006b6e0 0x7f94c01575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 -- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c0161440 msgr2=0x7f94c0144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c0161440 0x7f94c0144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 -- 172.21.15.78:0/10329722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009570 con 0x7f94c0146c50 2023-06-09T11:12:51.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bed9d700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c0161440 0x7f94c0144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:51.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b7fff700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c0146c50 0x7f94c00cdf20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94a8000c00 tx=0x7f94a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b6ffd700 1 -- 172.21.15.78:0/10329722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8004590 con 0x7f94c0146c50 2023-06-09T11:12:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b6ffd700 1 -- 172.21.15.78:0/10329722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a80036c0 con 0x7f94c0146c50 2023-06-09T11:12:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c006abb0 con 0x7f94c0146c50 2023-06-09T11:12:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94b6ffd700 1 -- 172.21.15.78:0/10329722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8003a70 con 0x7f94c0146c50 2023-06-09T11:12:51.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.175+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c006a8d0 con 0x7f94c0146c50 2023-06-09T11:12:51.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.179+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c006b0d0 con 0x7f94c0146c50 2023-06-09T11:12:51.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.179+0000 7f94b6ffd700 1 -- 172.21.15.78:0/10329722 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94a8003bd0 con 0x7f94c0146c50 2023-06-09T11:12:51.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.183+0000 7f94b6ffd700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f94a00662f0 0x7f94a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.183+0000 7f94b6ffd700 1 -- 172.21.15.78:0/10329722 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f94a8021030 con 0x7f94c0146c50 2023-06-09T11:12:51.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.183+0000 7f94be59c700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f94a00662f0 0x7f94a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.183+0000 7f94be59c700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f94a00662f0 0x7f94a00687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009bf0 tx=0x7f94b0009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:51.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.187+0000 7f94b6ffd700 1 -- 172.21.15.78:0/10329722 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f94a8052860 con 0x7f94c0146c50 2023-06-09T11:12:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.359+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94c0067610 con 0x7f94c0146c50 2023-06-09T11:12:51.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.359+0000 7f94b6ffd700 1 -- 172.21.15.78:0/10329722 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94a8055e80 con 0x7f94c0146c50 2023-06-09T11:12:51.368 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:51.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f94a00662f0 msgr2=0x7f94a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f94a00662f0 0x7f94a00687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009bf0 tx=0x7f94b0009240 comp rx=0 tx=0).stop 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c0146c50 msgr2=0x7f94c00cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c0146c50 0x7f94c00cdf20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94a8000c00 tx=0x7f94a8004770 comp rx=0 tx=0).stop 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 shutdown_connections 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f94a00662f0 0x7f94a00687a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c0161440 0x7f94c0144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c0146c50 0x7f94c00cdf20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 --2- 172.21.15.78:0/10329722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94c006b6e0 0x7f94c01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 >> 172.21.15.78:0/10329722 conn(0x7f94c00b0780 msgr2=0x7f94c00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 shutdown_connections 2023-06-09T11:12:51.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.363+0000 7f94bf59e700 1 -- 172.21.15.78:0/10329722 wait complete. 2023-06-09T11:12:51.391 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T11:12:51.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.555+0000 7fc746983700 1 Processor -- start 2023-06-09T11:12:51.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.555+0000 7fc746983700 1 -- start start 2023-06-09T11:12:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746983700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740164c00 0x7fc7400ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746983700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc74006f2a0 0x7fc74006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746983700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400adb00 con 0x7fc740160940 2023-06-09T11:12:51.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746983700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7401653a0 con 0x7fc74006f2a0 2023-06-09T11:12:51.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746983700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74006ba70 con 0x7fc740164c00 2023-06-09T11:12:51.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc745981700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc740160940 0x7fc7401644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50504/0 (socket says 172.21.15.78:50504) 2023-06-09T11:12:51.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc745981700 1 -- 172.21.15.78:0/3376915412 learned_addr learned my addr 172.21.15.78:0/3376915412 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:51.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746182700 1 --2- 172.21.15.78:0/3376915412 >> v2:172.21.15.187:3300/0 conn(0x7fc74006f2a0 0x7fc74006dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc745180700 1 --2- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740164c00 0x7fc7400ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc74497f700 1 -- 172.21.15.78:0/3376915412 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604791794 0 0) 0x7fc7400adb00 con 0x7fc740160940 2023-06-09T11:12:51.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746182700 1 -- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740164c00 msgr2=0x7fc7400ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:51.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746182700 1 --2- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740164c00 0x7fc7400ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746182700 1 -- 172.21.15.78:0/3376915412 >> v1:172.21.15.78:6789/0 conn(0x7fc740160940 legacy=0x7fc7401644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746182700 1 -- 172.21.15.78:0/3376915412 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400ccb10 con 0x7fc74006f2a0 2023-06-09T11:12:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc746182700 1 --2- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc74006dfa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc738009dc0 tx=0x7fc73800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a7565a4b9317e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc74497f700 1 -- 172.21.15.78:0/3376915412 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800e070 con 0x7fc74006f2a0 2023-06-09T11:12:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc74497f700 1 -- 172.21.15.78:0/3376915412 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73800bae0 con 0x7fc74006f2a0 2023-06-09T11:12:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.559+0000 7fc74497f700 1 -- 172.21.15.78:0/3376915412 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800be90 con 0x7fc74006f2a0 2023-06-09T11:12:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 msgr2=0x7fc74006dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 --2- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc74006dfa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc738009dc0 tx=0x7fc73800b330 comp rx=0 tx=0).stop 2023-06-09T11:12:51.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- 172.21.15.78:0/3376915412 shutdown_connections 2023-06-09T11:12:51.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 --2- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc74006dfa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 --2- 172.21.15.78:0/3376915412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740164c00 0x7fc7400ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- 172.21.15.78:0/3376915412 >> 172.21.15.78:0/3376915412 conn(0x7fc7400cf670 msgr2=0x7fc7400cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:51.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- 172.21.15.78:0/3376915412 shutdown_connections 2023-06-09T11:12:51.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- 172.21.15.78:0/3376915412 wait complete. 2023-06-09T11:12:51.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 Processor -- start 2023-06-09T11:12:51.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- start start 2023-06-09T11:12:51.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc7401f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740160940 0x7fc7400ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc740164c00 0x7fc7400c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74015a610 con 0x7fc740164c00 2023-06-09T11:12:51.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400aeeb0 con 0x7fc74006f2a0 2023-06-09T11:12:51.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.563+0000 7fc746983700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400af190 con 0x7fc740160940 2023-06-09T11:12:51.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745180700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740160940 0x7fc7400ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc7401f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc746182700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc740164c00 0x7fc7400c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745180700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740160940 0x7fc7400ae3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50044/0 (socket says 172.21.15.78:50044) 2023-06-09T11:12:51.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745180700 1 -- 172.21.15.78:0/1332290523 learned_addr learned my addr 172.21.15.78:0/1332290523 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:51.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc7401f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:54498/0 (socket says 172.21.15.78:54498) 2023-06-09T11:12:51.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 -- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740160940 msgr2=0x7fc7400ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740160940 0x7fc7400ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 -- 172.21.15.78:0/1332290523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc740164c00 msgr2=0x7fc7400c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc740164c00 0x7fc7400c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 -- 172.21.15.78:0/1332290523 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc738009a70 con 0x7fc74006f2a0 2023-06-09T11:12:51.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc745981700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc7401f5bb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00c550 tx=0x7fc73c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:51.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc7367fc700 1 -- 172.21.15.78:0/1332290523 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c004ca0 con 0x7fc74006f2a0 2023-06-09T11:12:51.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc7367fc700 1 -- 172.21.15.78:0/1332290523 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c004e00 con 0x7fc74006f2a0 2023-06-09T11:12:51.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7401650c0 con 0x7fc74006f2a0 2023-06-09T11:12:51.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc7367fc700 1 -- 172.21.15.78:0/1332290523 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c007310 con 0x7fc74006f2a0 2023-06-09T11:12:51.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.567+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7400add50 con 0x7fc74006f2a0 2023-06-09T11:12:51.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.571+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc740161d20 con 0x7fc74006f2a0 2023-06-09T11:12:51.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.571+0000 7fc7367fc700 1 -- 172.21.15.78:0/1332290523 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc73c007470 con 0x7fc74006f2a0 2023-06-09T11:12:51.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.571+0000 7fc7367fc700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc724066340 0x7fc7240687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:51.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.575+0000 7fc7367fc700 1 -- 172.21.15.78:0/1332290523 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc73c083890 con 0x7fc74006f2a0 2023-06-09T11:12:51.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.575+0000 7fc745180700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc724066340 0x7fc7240687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:51.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.575+0000 7fc745180700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc724066340 0x7fc7240687f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc74006d640 tx=0x7fc730009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:51.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.583+0000 7fc7367fc700 1 -- 172.21.15.78:0/1332290523 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc73c050cb0 con 0x7fc74006f2a0 2023-06-09T11:12:51.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.767+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc7400af580 con 0x7fc74006f2a0 2023-06-09T11:12:51.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.767+0000 7fc7367fc700 1 -- 172.21.15.78:0/1332290523 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc73c0542d0 con 0x7fc74006f2a0 2023-06-09T11:12:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc724066340 msgr2=0x7fc7240687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc724066340 0x7fc7240687f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc74006d640 tx=0x7fc730009240 comp rx=0 tx=0).stop 2023-06-09T11:12:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 msgr2=0x7fc7401f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc7401f5bb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00c550 tx=0x7fc73c00c860 comp rx=0 tx=0).stop 2023-06-09T11:12:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 shutdown_connections 2023-06-09T11:12:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc724066340 0x7fc7240687f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc740164c00 0x7fc7400c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc740160940 0x7fc7400ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 --2- 172.21.15.78:0/1332290523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc74006f2a0 0x7fc7401f5bb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 >> 172.21.15.78:0/1332290523 conn(0x7fc7400cf670 msgr2=0x7fc74006da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 shutdown_connections 2023-06-09T11:12:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:51.771+0000 7fc746983700 1 -- 172.21.15.78:0/1332290523 wait complete. 2023-06-09T11:12:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-09T11:12:51.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-09T11:12:51.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:51.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-09T11:12:51.902 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T11:12:51.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:51.903 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T11:12:51.921 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:51.922 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:51.941 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:51.941 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:51.998 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T11:12:51.999 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:12:52.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:52.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.227+0000 7ffa257cb700 1 Processor -- start 2023-06-09T11:12:52.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.227+0000 7ffa257cb700 1 -- start start 2023-06-09T11:12:52.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa257cb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015a3e0 0x7ffa2006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa257cb700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffa200ce470 0x7ffa2006f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa257cb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa200cc8e0 con 0x7ffa2015df60 2023-06-09T11:12:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa257cb700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2015a7b0 con 0x7ffa200ce470 2023-06-09T11:12:52.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa257cb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200ccb80 con 0x7ffa2015a3e0 2023-06-09T11:12:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa24fca700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ffa2015df60 0x7ffa20070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50518/0 (socket says 172.21.15.78:50518) 2023-06-09T11:12:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa24fca700 1 -- 172.21.15.78:0/1400805341 learned_addr learned my addr 172.21.15.78:0/1400805341 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:52.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa17fff700 1 --2- 172.21.15.78:0/1400805341 >> v2:172.21.15.187:3300/0 conn(0x7ffa200ce470 0x7ffa2006f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa1ffff700 1 --2- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015a3e0 0x7ffa2006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa17fff700 1 -- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015a3e0 msgr2=0x7ffa2006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa17fff700 1 --2- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015a3e0 0x7ffa2006e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa17fff700 1 -- 172.21.15.78:0/1400805341 >> v1:172.21.15.78:6789/0 conn(0x7ffa2015df60 legacy=0x7ffa20070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa17fff700 1 -- 172.21.15.78:0/1400805341 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2006b470 con 0x7ffa200ce470 2023-06-09T11:12:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa1ffff700 1 --2- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015a3e0 0x7ffa2006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa1f7fe700 1 -- 172.21.15.78:0/1400805341 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705851075 0 0) 0x7ffa200cc8e0 con 0x7ffa2015df60 2023-06-09T11:12:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa17fff700 1 --2- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 0x7ffa2006f090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009850 tx=0x7ffa08009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30be4e0e78f4b0fd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa1f7fe700 1 -- 172.21.15.78:0/1400805341 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08011830 con 0x7ffa200ce470 2023-06-09T11:12:52.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa1f7fe700 1 -- 172.21.15.78:0/1400805341 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08011990 con 0x7ffa200ce470 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.231+0000 7ffa1f7fe700 1 -- 172.21.15.78:0/1400805341 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08011d40 con 0x7ffa200ce470 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 msgr2=0x7ffa2006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 --2- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 0x7ffa2006f090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009850 tx=0x7ffa08009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- 172.21.15.78:0/1400805341 shutdown_connections 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 --2- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 0x7ffa2006f090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 --2- 172.21.15.78:0/1400805341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015a3e0 0x7ffa2006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- 172.21.15.78:0/1400805341 >> 172.21.15.78:0/1400805341 conn(0x7ffa200cf670 msgr2=0x7ffa200cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- 172.21.15.78:0/1400805341 shutdown_connections 2023-06-09T11:12:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- 172.21.15.78:0/1400805341 wait complete. 2023-06-09T11:12:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 Processor -- start 2023-06-09T11:12:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- start start 2023-06-09T11:12:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 0x7ffa2014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa2015a3e0 0x7ffa2014aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015df60 0x7ffa2014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa201500c0 con 0x7ffa2015a3e0 2023-06-09T11:12:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2014dd20 con 0x7ffa200ce470 2023-06-09T11:12:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.235+0000 7ffa257cb700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2014e000 con 0x7ffa2015df60 2023-06-09T11:12:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa2015a3e0 0x7ffa2014aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa2015a3e0 0x7ffa2014aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52302/0 (socket says 172.21.15.78:52302) 2023-06-09T11:12:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 -- 172.21.15.78:0/3189435115 learned_addr learned my addr 172.21.15.78:0/3189435115 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa1ffff700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 0x7ffa2014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa24fca700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015df60 0x7ffa2014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 -- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015df60 msgr2=0x7ffa2014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015df60 0x7ffa2014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 -- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 msgr2=0x7ffa2014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 0x7ffa2014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 -- 172.21.15.78:0/3189435115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100094b0 con 0x7ffa2015a3e0 2023-06-09T11:12:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa17fff700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa2015a3e0 0x7ffa2014aa10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa080090b0 tx=0x7ffa08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa1d7fa700 1 -- 172.21.15.78:0/3189435115 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0801a990 con 0x7ffa2015a3e0 2023-06-09T11:12:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa1d7fa700 1 -- 172.21.15.78:0/3189435115 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0801f070 con 0x7ffa2015a3e0 2023-06-09T11:12:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa080094b0 con 0x7ffa2015a3e0 2023-06-09T11:12:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa1d7fa700 1 -- 172.21.15.78:0/3189435115 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0801ad30 con 0x7ffa2015a3e0 2023-06-09T11:12:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.239+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2015e3e0 con 0x7ffa2015a3e0 2023-06-09T11:12:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.243+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2006b750 con 0x7ffa2015a3e0 2023-06-09T11:12:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.243+0000 7ffa1d7fa700 1 -- 172.21.15.78:0/3189435115 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa0801b430 con 0x7ffa2015a3e0 2023-06-09T11:12:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.243+0000 7ffa1d7fa700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffa00066320 0x7ffa000687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.247+0000 7ffa1d7fa700 1 -- 172.21.15.78:0/3189435115 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffa08084ed0 con 0x7ffa2015a3e0 2023-06-09T11:12:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.247+0000 7ffa1ffff700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffa00066320 0x7ffa000687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.247+0000 7ffa1ffff700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffa00066320 0x7ffa000687d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffa20151300 tx=0x7ffa10009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.251+0000 7ffa1d7fa700 1 -- 172.21.15.78:0/3189435115 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffa08052280 con 0x7ffa2015a3e0 2023-06-09T11:12:52.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.423+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa2015e570 con 0x7ffa2015a3e0 2023-06-09T11:12:52.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.423+0000 7ffa1d7fa700 1 -- 172.21.15.78:0/3189435115 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18339 (secure 0 0 0) 0x7ffa080558a0 con 0x7ffa2015a3e0 2023-06-09T11:12:52.433 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:52.433 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:49.372533+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:52.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffa00066320 msgr2=0x7ffa000687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffa00066320 0x7ffa000687d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffa20151300 tx=0x7ffa10009240 comp rx=0 tx=0).stop 2023-06-09T11:12:52.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa2015a3e0 msgr2=0x7ffa2014aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa2015a3e0 0x7ffa2014aa10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa080090b0 tx=0x7ffa08004770 comp rx=0 tx=0).stop 2023-06-09T11:12:52.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 shutdown_connections 2023-06-09T11:12:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffa00066320 0x7ffa000687d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa2015df60 0x7ffa2014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa2015a3e0 0x7ffa2014aa10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 --2- 172.21.15.78:0/3189435115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa200ce470 0x7ffa2014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 >> 172.21.15.78:0/3189435115 conn(0x7ffa200cf670 msgr2=0x7ffa20070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 shutdown_connections 2023-06-09T11:12:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.427+0000 7ffa257cb700 1 -- 172.21.15.78:0/3189435115 wait complete. 2023-06-09T11:12:52.458 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:52.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:52.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.631+0000 7f4187fff700 1 Processor -- start 2023-06-09T11:12:52.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.631+0000 7f4187fff700 1 -- start start 2023-06-09T11:12:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4187fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4188142a50 0x7f418806a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4187fff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4188142e20 con 0x7f418806bd70 2023-06-09T11:12:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4187fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418806acd0 con 0x7f418806e6a0 2023-06-09T11:12:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4187fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418806afb0 con 0x7f4188142a50 2023-06-09T11:12:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f41867fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f418806bd70 0x7f41880b6930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50526/0 (socket says 172.21.15.78:50526) 2023-06-09T11:12:52.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f41867fc700 1 -- 172.21.15.78:0/2457815832 learned_addr learned my addr 172.21.15.78:0/2457815832 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4186ffd700 1 --2- 172.21.15.78:0/2457815832 >> v2:172.21.15.187:3300/0 conn(0x7f4188142a50 0x7f418806a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4185ffb700 1 -- 172.21.15.78:0/2457815832 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946904463 0 0) 0x7f4188142e20 con 0x7f418806bd70 2023-06-09T11:12:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4185ffb700 1 -- 172.21.15.78:0/2457815832 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41700035d0 con 0x7f418806bd70 2023-06-09T11:12:52.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4186ffd700 1 -- 172.21.15.78:0/2457815832 >> v1:172.21.15.187:6789/0 conn(0x7f418806e6a0 legacy=0x7f41881431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4185ffb700 1 -- 172.21.15.78:0/2457815832 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651597173 0 0) 0x7f41700035d0 con 0x7f418806bd70 2023-06-09T11:12:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4186ffd700 1 -- 172.21.15.78:0/2457815832 >> v1:172.21.15.78:6789/0 conn(0x7f418806bd70 legacy=0x7f41880b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.635+0000 7f4186ffd700 1 -- 172.21.15.78:0/2457815832 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418806b290 con 0x7f4188142a50 2023-06-09T11:12:52.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4186ffd700 1 --2- 172.21.15.78:0/2457815832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4188142a50 0x7f418806a680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4178009850 tx=0x7f4178009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a79bf28f404a041 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:52.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4185ffb700 1 -- 172.21.15.78:0/2457815832 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c001690 con 0x7f4188142a50 2023-06-09T11:12:52.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4185ffb700 1 -- 172.21.15.78:0/2457815832 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4178004030 con 0x7f4188142a50 2023-06-09T11:12:52.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4185ffb700 1 -- 172.21.15.78:0/2457815832 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780043c0 con 0x7f4188142a50 2023-06-09T11:12:52.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4187fff700 1 -- 172.21.15.78:0/2457815832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4188142a50 msgr2=0x7f418806a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4187fff700 1 --2- 172.21.15.78:0/2457815832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4188142a50 0x7f418806a680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4178009850 tx=0x7f4178009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:52.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4187fff700 1 -- 172.21.15.78:0/2457815832 shutdown_connections 2023-06-09T11:12:52.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4187fff700 1 --2- 172.21.15.78:0/2457815832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4188142a50 0x7f418806a680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4187fff700 1 -- 172.21.15.78:0/2457815832 >> 172.21.15.78:0/2457815832 conn(0x7f41880b5820 msgr2=0x7f41880d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:52.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4187fff700 1 -- 172.21.15.78:0/2457815832 shutdown_connections 2023-06-09T11:12:52.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.639+0000 7f4187fff700 1 -- 172.21.15.78:0/2457815832 wait complete. 2023-06-09T11:12:52.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 Processor -- start 2023-06-09T11:12:52.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 -- start start 2023-06-09T11:12:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f418806bd70 0x7f41880d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f418806e6a0 0x7f41880cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4188142a50 0x7f418815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41880d1920 con 0x7f4188142a50 2023-06-09T11:12:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41880d0340 con 0x7f418806bd70 2023-06-09T11:12:52.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.643+0000 7f4187fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41880d0620 con 0x7f418806e6a0 2023-06-09T11:12:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4188142a50 0x7f418815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4188142a50 0x7f418815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52318/0 (socket says 172.21.15.78:52318) 2023-06-09T11:12:52.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 -- 172.21.15.78:0/789410031 learned_addr learned my addr 172.21.15.78:0/789410031 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f4186ffd700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f418806bd70 0x7f41880d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41867fc700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f418806e6a0 0x7f41880cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 -- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f418806e6a0 msgr2=0x7f41880cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f418806e6a0 0x7f41880cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 -- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f418806bd70 msgr2=0x7f41880d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f418806bd70 0x7f41880d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 -- 172.21.15.78:0/789410031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780094b0 con 0x7f4188142a50 2023-06-09T11:12:52.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f41877fe700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4188142a50 0x7f418815a930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f418000cba0 tx=0x7f418000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:52.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f416ffff700 1 -- 172.21.15.78:0/789410031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180003c20 con 0x7f4188142a50 2023-06-09T11:12:52.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f416ffff700 1 -- 172.21.15.78:0/789410031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180003d80 con 0x7f4188142a50 2023-06-09T11:12:52.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f416ffff700 1 -- 172.21.15.78:0/789410031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000aae0 con 0x7f4188142a50 2023-06-09T11:12:52.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418806b850 con 0x7f4188142a50 2023-06-09T11:12:52.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418806b570 con 0x7f4188142a50 2023-06-09T11:12:52.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.647+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418806eb20 con 0x7f4188142a50 2023-06-09T11:12:52.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.651+0000 7f416ffff700 1 -- 172.21.15.78:0/789410031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f418000ac40 con 0x7f4188142a50 2023-06-09T11:12:52.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.651+0000 7f416ffff700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f41740662f0 0x7f41740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:52.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.651+0000 7f416ffff700 1 -- 172.21.15.78:0/789410031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4180083d70 con 0x7f4188142a50 2023-06-09T11:12:52.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.655+0000 7f4186ffd700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f41740662f0 0x7f41740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:52.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.655+0000 7f4186ffd700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f41740662f0 0x7f41740687a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f41780090b0 tx=0x7f4178008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:52.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.659+0000 7f416ffff700 1 -- 172.21.15.78:0/789410031 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4180051110 con 0x7f4188142a50 2023-06-09T11:12:52.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.827+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4188067610 con 0x7f4188142a50 2023-06-09T11:12:52.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f416ffff700 1 -- 172.21.15.78:0/789410031 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4180054730 con 0x7f4188142a50 2023-06-09T11:12:52.839 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:52.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f41740662f0 msgr2=0x7f41740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f41740662f0 0x7f41740687a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f41780090b0 tx=0x7f4178008030 comp rx=0 tx=0).stop 2023-06-09T11:12:52.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4188142a50 msgr2=0x7f418815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:52.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4188142a50 0x7f418815a930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f418000cba0 tx=0x7f418000ceb0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 shutdown_connections 2023-06-09T11:12:52.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f41740662f0 0x7f41740687a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4188142a50 0x7f418815a930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f418806e6a0 0x7f41880cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 --2- 172.21.15.78:0/789410031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f418806bd70 0x7f41880d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:52.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 >> 172.21.15.78:0/789410031 conn(0x7f41880b5820 msgr2=0x7f41880b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:52.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 shutdown_connections 2023-06-09T11:12:52.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:52.831+0000 7f4187fff700 1 -- 172.21.15.78:0/789410031 wait complete. 2023-06-09T11:12:52.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:53.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.035+0000 7fda1ed0e700 1 Processor -- start 2023-06-09T11:12:53.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.035+0000 7fda1ed0e700 1 -- start start 2023-06-09T11:12:53.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1ed0e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160a80 0x7fda1806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1ed0e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fda1806f1e0 0x7fda1806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1ed0e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1806ed50 con 0x7fda18160e50 2023-06-09T11:12:53.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1ed0e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda180ae030 con 0x7fda1806f1e0 2023-06-09T11:12:53.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1ed0e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1806e140 con 0x7fda18160a80 2023-06-09T11:12:53.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1e50d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fda18160e50 0x7fda181612b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50538/0 (socket says 172.21.15.78:50538) 2023-06-09T11:12:53.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1d50b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fda1806f1e0 0x7fda1806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1e50d700 1 -- 172.21.15.78:0/3554795883 learned_addr learned my addr 172.21.15.78:0/3554795883 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:53.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1dd0c700 1 --2- 172.21.15.78:0/3554795883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160a80 0x7fda1806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1dd0c700 1 -- 172.21.15.78:0/3554795883 >> v2:172.21.15.187:3300/0 conn(0x7fda1806f1e0 msgr2=0x7fda1806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:53.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1dd0c700 1 --2- 172.21.15.78:0/3554795883 >> v2:172.21.15.187:3300/0 conn(0x7fda1806f1e0 0x7fda1806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1dd0c700 1 -- 172.21.15.78:0/3554795883 >> v1:172.21.15.78:6789/0 conn(0x7fda18160e50 legacy=0x7fda181612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1dd0c700 1 -- 172.21.15.78:0/3554795883 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1806e420 con 0x7fda18160a80 2023-06-09T11:12:53.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1d50b700 1 --2- 172.21.15.78:0/3554795883 >> v2:172.21.15.187:3300/0 conn(0x7fda1806f1e0 0x7fda1806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:53.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.039+0000 7fda1dd0c700 1 --2- 172.21.15.78:0/3554795883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160a80 0x7fda1806d570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda14009850 tx=0x7fda14009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65accba2d028b502 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1cd0a700 1 -- 172.21.15.78:0/3554795883 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14011830 con 0x7fda18160a80 2023-06-09T11:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1cd0a700 1 -- 172.21.15.78:0/3554795883 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14011990 con 0x7fda18160a80 2023-06-09T11:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1cd0a700 1 -- 172.21.15.78:0/3554795883 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14011d40 con 0x7fda18160a80 2023-06-09T11:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 -- 172.21.15.78:0/3554795883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160a80 msgr2=0x7fda1806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/3554795883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160a80 0x7fda1806d570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda14009850 tx=0x7fda14009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:53.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 -- 172.21.15.78:0/3554795883 shutdown_connections 2023-06-09T11:12:53.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/3554795883 >> v2:172.21.15.187:3300/0 conn(0x7fda1806f1e0 0x7fda1806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/3554795883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160a80 0x7fda1806d570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 -- 172.21.15.78:0/3554795883 >> 172.21.15.78:0/3554795883 conn(0x7fda180b05c0 msgr2=0x7fda180b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:53.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 -- 172.21.15.78:0/3554795883 shutdown_connections 2023-06-09T11:12:53.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.043+0000 7fda1ed0e700 1 -- 172.21.15.78:0/3554795883 wait complete. 2023-06-09T11:12:53.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.047+0000 7fda1ed0e700 1 Processor -- start 2023-06-09T11:12:53.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.047+0000 7fda1ed0e700 1 -- start start 2023-06-09T11:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1806f1e0 0x7fda18148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda18160a80 0x7fda1806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160e50 0x7fda1806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda181fa670 con 0x7fda1806f1e0 2023-06-09T11:12:53.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda181f99f0 con 0x7fda18160a80 2023-06-09T11:12:53.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda181f9cd0 con 0x7fda18160e50 2023-06-09T11:12:53.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1dd0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1806f1e0 0x7fda18148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1e50d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160e50 0x7fda1806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1dd0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1806f1e0 0x7fda18148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52322/0 (socket says 172.21.15.78:52322) 2023-06-09T11:12:53.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1dd0c700 1 -- 172.21.15.78:0/4195021902 learned_addr learned my addr 172.21.15.78:0/4195021902 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:53.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1d50b700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda18160a80 0x7fda1806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1e50d700 1 -- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda18160a80 msgr2=0x7fda1806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1e50d700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda18160a80 0x7fda1806d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1e50d700 1 -- 172.21.15.78:0/4195021902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1806f1e0 msgr2=0x7fda18148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1e50d700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1806f1e0 0x7fda18148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1e50d700 1 -- 172.21.15.78:0/4195021902 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080094b0 con 0x7fda18160e50 2023-06-09T11:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1e50d700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160e50 0x7fda1806dab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda1000caa0 tx=0x7fda1000cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda0e7fc700 1 -- 172.21.15.78:0/4195021902 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100074e0 con 0x7fda18160e50 2023-06-09T11:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda0e7fc700 1 -- 172.21.15.78:0/4195021902 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10007640 con 0x7fda18160e50 2023-06-09T11:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda140094b0 con 0x7fda18160e50 2023-06-09T11:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda0e7fc700 1 -- 172.21.15.78:0/4195021902 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100079b0 con 0x7fda18160e50 2023-06-09T11:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.051+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1806e9e0 con 0x7fda18160e50 2023-06-09T11:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.055+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1806e700 con 0x7fda18160e50 2023-06-09T11:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.055+0000 7fda0e7fc700 1 -- 172.21.15.78:0/4195021902 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda1001b3b0 con 0x7fda18160e50 2023-06-09T11:12:53.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.055+0000 7fda0e7fc700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9fc0662f0 0x7fd9fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.055+0000 7fda0e7fc700 1 -- 172.21.15.78:0/4195021902 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fda100834b0 con 0x7fda18160e50 2023-06-09T11:12:53.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.059+0000 7fda1dd0c700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9fc0662f0 0x7fd9fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.059+0000 7fda1dd0c700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9fc0662f0 0x7fd9fc0687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fda14000c00 tx=0x7fda14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.067+0000 7fda0e7fc700 1 -- 172.21.15.78:0/4195021902 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fda10050990 con 0x7fda18160e50 2023-06-09T11:12:53.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.235+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda181619c0 con 0x7fda18160e50 2023-06-09T11:12:53.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda0e7fc700 1 -- 172.21.15.78:0/4195021902 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda10053fb0 con 0x7fda18160e50 2023-06-09T11:12:53.247 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9fc0662f0 msgr2=0x7fd9fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9fc0662f0 0x7fd9fc0687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fda14000c00 tx=0x7fda14008030 comp rx=0 tx=0).stop 2023-06-09T11:12:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160e50 msgr2=0x7fda1806dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160e50 0x7fda1806dab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda1000caa0 tx=0x7fda1000cad0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 shutdown_connections 2023-06-09T11:12:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd9fc0662f0 0x7fd9fc0687a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda18160e50 0x7fda1806dab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda18160a80 0x7fda1806d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 --2- 172.21.15.78:0/4195021902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda1806f1e0 0x7fda18148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 >> 172.21.15.78:0/4195021902 conn(0x7fda180b05c0 msgr2=0x7fda18070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 shutdown_connections 2023-06-09T11:12:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.239+0000 7fda1ed0e700 1 -- 172.21.15.78:0/4195021902 wait complete. 2023-06-09T11:12:53.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:53.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.435+0000 7fec5231d700 1 Processor -- start 2023-06-09T11:12:53.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.435+0000 7fec5231d700 1 -- start start 2023-06-09T11:12:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5231d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c146c50 0x7fec4c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5231d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec4c06b6e0 0x7fec4c160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5231d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec4c161440 0x7fec4c164510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5231d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c06a070 con 0x7fec4c06b6e0 2023-06-09T11:12:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5231d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c06a310 con 0x7fec4c161440 2023-06-09T11:12:53.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5231d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c06a5f0 con 0x7fec4c146c50 2023-06-09T11:12:53.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec50b1a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec4c06b6e0 0x7fec4c160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5131b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c146c50 0x7fec4c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec51b1c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec4c161440 0x7fec4c164510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec50b1a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec4c06b6e0 0x7fec4c160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52330/0 (socket says 172.21.15.78:52330) 2023-06-09T11:12:53.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec5131b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c146c50 0x7fec4c0b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50092/0 (socket says 172.21.15.78:50092) 2023-06-09T11:12:53.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec50b1a700 1 -- 172.21.15.78:0/3467097268 learned_addr learned my addr 172.21.15.78:0/3467097268 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:53.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec51b1c700 1 -- 172.21.15.78:0/3467097268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c146c50 msgr2=0x7fec4c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:53.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec51b1c700 1 --2- 172.21.15.78:0/3467097268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c146c50 0x7fec4c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec51b1c700 1 -- 172.21.15.78:0/3467097268 >> v2:172.21.15.78:3300/0 conn(0x7fec4c06b6e0 msgr2=0x7fec4c160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:53.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec51b1c700 1 --2- 172.21.15.78:0/3467097268 >> v2:172.21.15.78:3300/0 conn(0x7fec4c06b6e0 0x7fec4c160f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec51b1c700 1 -- 172.21.15.78:0/3467097268 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c06a8d0 con 0x7fec4c161440 2023-06-09T11:12:53.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec50b1a700 1 --2- 172.21.15.78:0/3467097268 >> v2:172.21.15.78:3300/0 conn(0x7fec4c06b6e0 0x7fec4c160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:53.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec51b1c700 1 --2- 172.21.15.78:0/3467097268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c161440 0x7fec4c164510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fec4c06bb10 tx=0x7fec4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f7fd389a4343cdc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec43fff700 1 -- 172.21.15.78:0/3467097268 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4400e070 con 0x7fec4c161440 2023-06-09T11:12:53.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec43fff700 1 -- 172.21.15.78:0/3467097268 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4400bb20 con 0x7fec4c161440 2023-06-09T11:12:53.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.439+0000 7fec43fff700 1 -- 172.21.15.78:0/3467097268 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44012430 con 0x7fec4c161440 2023-06-09T11:12:53.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 -- 172.21.15.78:0/3467097268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c161440 msgr2=0x7fec4c164510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 --2- 172.21.15.78:0/3467097268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c161440 0x7fec4c164510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fec4c06bb10 tx=0x7fec4400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:53.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 -- 172.21.15.78:0/3467097268 shutdown_connections 2023-06-09T11:12:53.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 --2- 172.21.15.78:0/3467097268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c161440 0x7fec4c164510 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 --2- 172.21.15.78:0/3467097268 >> v2:172.21.15.78:3300/0 conn(0x7fec4c06b6e0 0x7fec4c160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 --2- 172.21.15.78:0/3467097268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c146c50 0x7fec4c0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 -- 172.21.15.78:0/3467097268 >> 172.21.15.78:0/3467097268 conn(0x7fec4c0b0780 msgr2=0x7fec4c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:53.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 -- 172.21.15.78:0/3467097268 shutdown_connections 2023-06-09T11:12:53.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 -- 172.21.15.78:0/3467097268 wait complete. 2023-06-09T11:12:53.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 Processor -- start 2023-06-09T11:12:53.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.443+0000 7fec5231d700 1 -- start start 2023-06-09T11:12:53.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c06b6e0 0x7fec4c1f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c146c50 0x7fec4c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c161440 0x7fec4c15c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0cc2b0 con 0x7fec4c146c50 2023-06-09T11:12:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c15a000 con 0x7fec4c06b6e0 2023-06-09T11:12:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c15cad0 con 0x7fec4c161440 2023-06-09T11:12:53.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c146c50 0x7fec4c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c146c50 0x7fec4c1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52342/0 (socket says 172.21.15.78:52342) 2023-06-09T11:12:53.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 -- 172.21.15.78:0/3677793912 learned_addr learned my addr 172.21.15.78:0/3677793912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:53.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5131b700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c06b6e0 0x7fec4c1f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec51b1c700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c161440 0x7fec4c15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 -- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c161440 msgr2=0x7fec4c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c161440 0x7fec4c15c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 -- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c06b6e0 msgr2=0x7fec4c1f9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c06b6e0 0x7fec4c1f9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 -- 172.21.15.78:0/3677793912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c009570 con 0x7fec4c146c50 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec50b1a700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c146c50 0x7fec4c1415f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00ebe0 tx=0x7fec3c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec41ffb700 1 -- 172.21.15.78:0/3677793912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c00c850 con 0x7fec4c146c50 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec41ffb700 1 -- 172.21.15.78:0/3677793912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c00c9b0 con 0x7fec4c146c50 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec41ffb700 1 -- 172.21.15.78:0/3677793912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c00cd20 con 0x7fec4c146c50 2023-06-09T11:12:53.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec44009a70 con 0x7fec4c146c50 2023-06-09T11:12:53.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.447+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c06b0d0 con 0x7fec4c146c50 2023-06-09T11:12:53.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.451+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c06abb0 con 0x7fec4c146c50 2023-06-09T11:12:53.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.451+0000 7fec41ffb700 1 -- 172.21.15.78:0/3677793912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec3c013470 con 0x7fec4c146c50 2023-06-09T11:12:53.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.455+0000 7fec41ffb700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fec300662f0 0x7fec300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.455+0000 7fec41ffb700 1 -- 172.21.15.78:0/3677793912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fec3c083dd0 con 0x7fec4c146c50 2023-06-09T11:12:53.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.455+0000 7fec5131b700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fec300662f0 0x7fec300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.455+0000 7fec5131b700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fec300662f0 0x7fec300687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec48009b70 tx=0x7fec48009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.459+0000 7fec41ffb700 1 -- 172.21.15.78:0/3677793912 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fec3c088070 con 0x7fec4c146c50 2023-06-09T11:12:53.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.631+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec4c161850 con 0x7fec4c146c50 2023-06-09T11:12:53.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.631+0000 7fec41ffb700 1 -- 172.21.15.78:0/3677793912 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec3c051200 con 0x7fec4c146c50 2023-06-09T11:12:53.641 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:53.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fec300662f0 msgr2=0x7fec300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fec300662f0 0x7fec300687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec48009b70 tx=0x7fec48009240 comp rx=0 tx=0).stop 2023-06-09T11:12:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c146c50 msgr2=0x7fec4c1415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c146c50 0x7fec4c1415f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00ebe0 tx=0x7fec3c00eef0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 shutdown_connections 2023-06-09T11:12:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fec300662f0 0x7fec300687a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c161440 0x7fec4c15c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c146c50 0x7fec4c1415f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 --2- 172.21.15.78:0/3677793912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c06b6e0 0x7fec4c1f9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 >> 172.21.15.78:0/3677793912 conn(0x7fec4c0b0780 msgr2=0x7fec4c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 shutdown_connections 2023-06-09T11:12:53.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.635+0000 7fec5231d700 1 -- 172.21.15.78:0/3677793912 wait complete. 2023-06-09T11:12:53.666 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:53.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.835+0000 7f3150b1e700 1 Processor -- start 2023-06-09T11:12:53.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.835+0000 7f3150b1e700 1 -- start start 2023-06-09T11:12:53.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f3150b1e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f314c15a7c0 0x7f314c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f3150b1e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c0705f0 con 0x7f314c0cbdb0 2023-06-09T11:12:53.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f3150b1e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c06fa20 con 0x7f314c0c9980 2023-06-09T11:12:53.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f3150b1e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c15ab90 con 0x7f314c15a7c0 2023-06-09T11:12:53.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f314c15a7c0 0x7f314c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314a59c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f314c15a7c0 0x7f314c070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52344/0 (socket says 172.21.15.78:52344) 2023-06-09T11:12:53.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314a59c700 1 -- 172.21.15.78:0/3547905498 learned_addr learned my addr 172.21.15.78:0/3547905498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:53.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314a59c700 1 -- 172.21.15.78:0/3547905498 >> v1:172.21.15.187:6789/0 conn(0x7f314c0c9980 legacy=0x7f314c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:53.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314a59c700 1 -- 172.21.15.78:0/3547905498 >> v1:172.21.15.78:6789/0 conn(0x7f314c0cbdb0 legacy=0x7f314c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314a59c700 1 -- 172.21.15.78:0/3547905498 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c06fcc0 con 0x7f314c15a7c0 2023-06-09T11:12:53.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314a59c700 1 --2- 172.21.15.78:0/3547905498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c15a7c0 0x7f314c070a80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f313c009910 tx=0x7f313c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e244af890db192d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314959a700 1 -- 172.21.15.78:0/3547905498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c004230 con 0x7f314c15a7c0 2023-06-09T11:12:53.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314959a700 1 -- 172.21.15.78:0/3547905498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c004390 con 0x7f314c15a7c0 2023-06-09T11:12:53.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.839+0000 7f314959a700 1 -- 172.21.15.78:0/3547905498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c009e60 con 0x7f314c15a7c0 2023-06-09T11:12:53.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 -- 172.21.15.78:0/3547905498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c15a7c0 msgr2=0x7f314c070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3547905498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c15a7c0 0x7f314c070a80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f313c009910 tx=0x7f313c009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:53.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 -- 172.21.15.78:0/3547905498 shutdown_connections 2023-06-09T11:12:53.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3547905498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c15a7c0 0x7f314c070a80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 -- 172.21.15.78:0/3547905498 >> 172.21.15.78:0/3547905498 conn(0x7f314c0cf8b0 msgr2=0x7f314c0cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:53.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 -- 172.21.15.78:0/3547905498 shutdown_connections 2023-06-09T11:12:53.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 -- 172.21.15.78:0/3547905498 wait complete. 2023-06-09T11:12:53.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 Processor -- start 2023-06-09T11:12:53.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.843+0000 7f3150b1e700 1 -- start start 2023-06-09T11:12:53.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c0c9980 0x7f314c0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f314c0cbdb0 0x7f314c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f314c15a7c0 0x7f314c0b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c14dad0 con 0x7f314c0c9980 2023-06-09T11:12:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0b47a0 con 0x7f314c0cbdb0 2023-06-09T11:12:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0b3700 con 0x7f314c15a7c0 2023-06-09T11:12:53.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c0c9980 0x7f314c0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c0c9980 0x7f314c0c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52354/0 (socket says 172.21.15.78:52354) 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 -- 172.21.15.78:0/3483564805 learned_addr learned my addr 172.21.15.78:0/3483564805 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314ad9d700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f314c15a7c0 0x7f314c0b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 -- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f314c15a7c0 msgr2=0x7f314c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f314c15a7c0 0x7f314c0b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3149d9b700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f314c0cbdb0 0x7f314c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 -- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f314c0cbdb0 msgr2=0x7f314c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:53.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f314c0cbdb0 0x7f314c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 -- 172.21.15.78:0/3483564805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009570 con 0x7f314c0c9980 2023-06-09T11:12:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314ad9d700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f314c15a7c0 0x7f314c0b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3149d9b700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f314c0cbdb0 0x7f314c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f314a59c700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c0c9980 0x7f314c0c4780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f313c004000 tx=0x7f313c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f313affd700 1 -- 172.21.15.78:0/3483564805 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00be00 con 0x7f314c0c9980 2023-06-09T11:12:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f313affd700 1 -- 172.21.15.78:0/3483564805 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c01f070 con 0x7f314c0c9980 2023-06-09T11:12:53.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c070280 con 0x7f314c0c9980 2023-06-09T11:12:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f313affd700 1 -- 172.21.15.78:0/3483564805 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c003900 con 0x7f314c0c9980 2023-06-09T11:12:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.847+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c06ffa0 con 0x7f314c0c9980 2023-06-09T11:12:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.851+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c0b4ae0 con 0x7f314c0c9980 2023-06-09T11:12:53.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.851+0000 7f313affd700 1 -- 172.21.15.78:0/3483564805 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f313c021030 con 0x7f314c0c9980 2023-06-09T11:12:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.855+0000 7f313affd700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f312c0662f0 0x7f312c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:53.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.855+0000 7f313affd700 1 -- 172.21.15.78:0/3483564805 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f313c0854d0 con 0x7f314c0c9980 2023-06-09T11:12:53.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.855+0000 7f3149d9b700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f312c0662f0 0x7f312c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:53.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.855+0000 7f3149d9b700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f312c0662f0 0x7f312c0687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f314c0ce9a0 tx=0x7f3140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:53.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:53.859+0000 7f313affd700 1 -- 172.21.15.78:0/3483564805 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f313c052900 con 0x7f314c0c9980 2023-06-09T11:12:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.023+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f314c0b4ae0 con 0x7f314c0c9980 2023-06-09T11:12:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.023+0000 7f313affd700 1 -- 172.21.15.78:0/3483564805 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f313c055f20 con 0x7f314c0c9980 2023-06-09T11:12:54.034 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f312c0662f0 msgr2=0x7f312c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f312c0662f0 0x7f312c0687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f314c0ce9a0 tx=0x7f3140009040 comp rx=0 tx=0).stop 2023-06-09T11:12:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c0c9980 msgr2=0x7f314c0c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c0c9980 0x7f314c0c4780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f313c004000 tx=0x7f313c004770 comp rx=0 tx=0).stop 2023-06-09T11:12:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 shutdown_connections 2023-06-09T11:12:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f312c0662f0 0x7f312c0687a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f314c15a7c0 0x7f314c0b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f314c0cbdb0 0x7f314c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 --2- 172.21.15.78:0/3483564805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f314c0c9980 0x7f314c0c4780 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 >> 172.21.15.78:0/3483564805 conn(0x7f314c0cf8b0 msgr2=0x7f314c0af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 shutdown_connections 2023-06-09T11:12:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.027+0000 7f3150b1e700 1 -- 172.21.15.78:0/3483564805 wait complete. 2023-06-09T11:12:54.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T11:12:54.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.223+0000 7fd558c25700 1 Processor -- start 2023-06-09T11:12:54.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.223+0000 7fd558c25700 1 -- start start 2023-06-09T11:12:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.223+0000 7fd558c25700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd554160e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.223+0000 7fd558c25700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd5540cc810 0x7fd554070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.223+0000 7fd558c25700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55406fdd0 con 0x7fd55406d8d0 2023-06-09T11:12:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.223+0000 7fd558c25700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55406f880 con 0x7fd5540cc810 2023-06-09T11:12:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.223+0000 7fd558c25700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540ae3a0 con 0x7fd5540adfd0 2023-06-09T11:12:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd554160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd554160e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50114/0 (socket says 172.21.15.78:50114) 2023-06-09T11:12:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 -- 172.21.15.78:0/4011976223 learned_addr learned my addr 172.21.15.78:0/4011976223 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd552d9d700 1 --1- 172.21.15.78:0/4011976223 >> v1:172.21.15.78:6789/0 conn(0x7fd55406d8d0 0x7fd5540c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50566/0 (socket says 172.21.15.78:50566) 2023-06-09T11:12:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd54bfff700 1 --2- 172.21.15.78:0/4011976223 >> v2:172.21.15.187:3300/0 conn(0x7fd5540cc810 0x7fd554070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 -- 172.21.15.78:0/4011976223 >> v2:172.21.15.187:3300/0 conn(0x7fd5540cc810 msgr2=0x7fd554070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:54.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 --2- 172.21.15.78:0/4011976223 >> v2:172.21.15.187:3300/0 conn(0x7fd5540cc810 0x7fd554070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 -- 172.21.15.78:0/4011976223 >> v1:172.21.15.78:6789/0 conn(0x7fd55406d8d0 legacy=0x7fd5540c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 -- 172.21.15.78:0/4011976223 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540ccf40 con 0x7fd5540adfd0 2023-06-09T11:12:54.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd55259c700 1 --2- 172.21.15.78:0/4011976223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd554160e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd544009910 tx=0x7fd544009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180f44034437cdd8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:54.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd551d9b700 1 -- 172.21.15.78:0/4011976223 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544011830 con 0x7fd5540adfd0 2023-06-09T11:12:54.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd551d9b700 1 -- 172.21.15.78:0/4011976223 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd544011990 con 0x7fd5540adfd0 2023-06-09T11:12:54.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd551d9b700 1 -- 172.21.15.78:0/4011976223 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544011d40 con 0x7fd5540adfd0 2023-06-09T11:12:54.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 -- 172.21.15.78:0/4011976223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 msgr2=0x7fd554160e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 --2- 172.21.15.78:0/4011976223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd554160e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd544009910 tx=0x7fd544009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:54.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 -- 172.21.15.78:0/4011976223 shutdown_connections 2023-06-09T11:12:54.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 --2- 172.21.15.78:0/4011976223 >> v2:172.21.15.187:3300/0 conn(0x7fd5540cc810 0x7fd554070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 --2- 172.21.15.78:0/4011976223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd554160e90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 -- 172.21.15.78:0/4011976223 >> 172.21.15.78:0/4011976223 conn(0x7fd5540b1480 msgr2=0x7fd5540cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:54.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 -- 172.21.15.78:0/4011976223 shutdown_connections 2023-06-09T11:12:54.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.227+0000 7fd558c25700 1 -- 172.21.15.78:0/4011976223 wait complete. 2023-06-09T11:12:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.231+0000 7fd558c25700 1 Processor -- start 2023-06-09T11:12:54.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.231+0000 7fd558c25700 1 -- start start 2023-06-09T11:12:54.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd558c25700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd55406d8d0 0x7fd55415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd558c25700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd5540b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd558c25700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5540cc810 0x7fd5541f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd558c25700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b2ee0 con 0x7fd5540cc810 2023-06-09T11:12:54.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd558c25700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b31c0 con 0x7fd55406d8d0 2023-06-09T11:12:54.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd558c25700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540b34a0 con 0x7fd5540adfd0 2023-06-09T11:12:54.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd55406d8d0 0x7fd55415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd55406d8d0 0x7fd55415e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:54610/0 (socket says 172.21.15.78:54610) 2023-06-09T11:12:54.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd5540b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd552d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5540cc810 0x7fd5541f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 -- 172.21.15.78:0/1280557800 learned_addr learned my addr 172.21.15.78:0/1280557800 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:54.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 -- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 msgr2=0x7fd5540b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd5540b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 -- 172.21.15.78:0/1280557800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5540cc810 msgr2=0x7fd5541f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5540cc810 0x7fd5541f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 -- 172.21.15.78:0/1280557800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009570 con 0x7fd55406d8d0 2023-06-09T11:12:54.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.235+0000 7fd55259c700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd55406d8d0 0x7fd55415e140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd544000c00 tx=0x7fd544004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:54.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.239+0000 7fd54affd700 1 -- 172.21.15.78:0/1280557800 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544004510 con 0x7fd55406d8d0 2023-06-09T11:12:54.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.239+0000 7fd54affd700 1 -- 172.21.15.78:0/1280557800 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5440036c0 con 0x7fd55406d8d0 2023-06-09T11:12:54.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.239+0000 7fd54affd700 1 -- 172.21.15.78:0/1280557800 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544003a70 con 0x7fd55406d8d0 2023-06-09T11:12:54.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.239+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55406fa60 con 0x7fd55406d8d0 2023-06-09T11:12:54.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.239+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5540cd220 con 0x7fd55406d8d0 2023-06-09T11:12:54.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.239+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5540ccc60 con 0x7fd55406d8d0 2023-06-09T11:12:54.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.243+0000 7fd54affd700 1 -- 172.21.15.78:0/1280557800 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd544003bd0 con 0x7fd55406d8d0 2023-06-09T11:12:54.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.243+0000 7fd54affd700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd534066320 0x7fd5340687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.243+0000 7fd54affd700 1 -- 172.21.15.78:0/1280557800 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd544021030 con 0x7fd55406d8d0 2023-06-09T11:12:54.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.243+0000 7fd54bfff700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd534066320 0x7fd5340687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.247+0000 7fd54bfff700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd534066320 0x7fd5340687d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5541f54d0 tx=0x7fd53c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:54.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.251+0000 7fd54affd700 1 -- 172.21.15.78:0/1280557800 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd544052780 con 0x7fd55406d8d0 2023-06-09T11:12:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.439+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd5540741c0 con 0x7fd55406d8d0 2023-06-09T11:12:54.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.439+0000 7fd54affd700 1 -- 172.21.15.78:0/1280557800 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd544055da0 con 0x7fd55406d8d0 2023-06-09T11:12:54.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.443+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd534066320 msgr2=0x7fd5340687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.443+0000 7fd558c25700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd534066320 0x7fd5340687d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd5541f54d0 tx=0x7fd53c009240 comp rx=0 tx=0).stop 2023-06-09T11:12:54.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd55406d8d0 msgr2=0x7fd55415e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd55406d8d0 0x7fd55415e140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd544000c00 tx=0x7fd544004770 comp rx=0 tx=0).stop 2023-06-09T11:12:54.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 shutdown_connections 2023-06-09T11:12:54.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd534066320 0x7fd5340687d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5540cc810 0x7fd5541f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5540adfd0 0x7fd5540b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 --2- 172.21.15.78:0/1280557800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd55406d8d0 0x7fd55415e140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 >> 172.21.15.78:0/1280557800 conn(0x7fd5540b1480 msgr2=0x7fd5540ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:54.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 shutdown_connections 2023-06-09T11:12:54.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.447+0000 7fd558c25700 1 -- 172.21.15.78:0/1280557800 wait complete. 2023-06-09T11:12:54.457 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-09T11:12:54.476 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-09T11:12:54.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:54.477 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-09T11:12:54.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T11:12:54.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:12:54.579 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T11:12:54.597 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-09T11:12:54.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.759+0000 7f1571501700 1 Processor -- start 2023-06-09T11:12:54.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.759+0000 7f1571501700 1 -- start start 2023-06-09T11:12:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f1571501700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c15a3e0 0x7f156c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f1571501700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f156c0ce470 0x7f156c06f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f1571501700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f156c15df60 0x7f156c15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f1571501700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c15e920 con 0x7f156c15df60 2023-06-09T11:12:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f1571501700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0cc8e0 con 0x7f156c0ce470 2023-06-09T11:12:54.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f1571501700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15a7b0 con 0x7f156c15a3e0 2023-06-09T11:12:54.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f156c15df60 0x7f156c15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c15a3e0 0x7f156c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f156c15df60 0x7f156c15e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52374/0 (socket says 172.21.15.78:52374) 2023-06-09T11:12:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 -- 172.21.15.78:0/2877618494 learned_addr learned my addr 172.21.15.78:0/2877618494 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156a7fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f156c0ce470 0x7f156c06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 -- 172.21.15.78:0/2877618494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c15a3e0 msgr2=0x7f156c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:54.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 --2- 172.21.15.78:0/2877618494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c15a3e0 0x7f156c06e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 -- 172.21.15.78:0/2877618494 >> v2:172.21.15.187:3300/0 conn(0x7f156c0ce470 msgr2=0x7f156c06f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 --2- 172.21.15.78:0/2877618494 >> v2:172.21.15.187:3300/0 conn(0x7f156c0ce470 0x7f156c06f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 -- 172.21.15.78:0/2877618494 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0ccb80 con 0x7f156c15df60 2023-06-09T11:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.763+0000 7f156b7fe700 1 --2- 172.21.15.78:0/2877618494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15df60 0x7f156c15e3e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f156c0cb310 tx=0x7f156400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd94a46c5d53337 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1569ffb700 1 -- 172.21.15.78:0/2877618494 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400e070 con 0x7f156c15df60 2023-06-09T11:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1569ffb700 1 -- 172.21.15.78:0/2877618494 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156400b910 con 0x7f156c15df60 2023-06-09T11:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1569ffb700 1 -- 172.21.15.78:0/2877618494 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400bcc0 con 0x7f156c15df60 2023-06-09T11:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 -- 172.21.15.78:0/2877618494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15df60 msgr2=0x7f156c15e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 --2- 172.21.15.78:0/2877618494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15df60 0x7f156c15e3e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f156c0cb310 tx=0x7f156400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 -- 172.21.15.78:0/2877618494 shutdown_connections 2023-06-09T11:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 --2- 172.21.15.78:0/2877618494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15df60 0x7f156c15e3e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 --2- 172.21.15.78:0/2877618494 >> v2:172.21.15.187:3300/0 conn(0x7f156c0ce470 0x7f156c06f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 --2- 172.21.15.78:0/2877618494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c15a3e0 0x7f156c06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 -- 172.21.15.78:0/2877618494 >> 172.21.15.78:0/2877618494 conn(0x7f156c0cf670 msgr2=0x7f156c0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:54.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 -- 172.21.15.78:0/2877618494 shutdown_connections 2023-06-09T11:12:54.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 -- 172.21.15.78:0/2877618494 wait complete. 2023-06-09T11:12:54.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 Processor -- start 2023-06-09T11:12:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.767+0000 7f1571501700 1 -- start start 2023-06-09T11:12:54.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c0ce470 0x7f156c15c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15a3e0 0x7f156c14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f156c15df60 0x7f156c14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c15c6b0 con 0x7f156c15a3e0 2023-06-09T11:12:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0b02a0 con 0x7f156c15df60 2023-06-09T11:12:54.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0b0580 con 0x7f156c0ce470 2023-06-09T11:12:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15a3e0 0x7f156c14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15a3e0 0x7f156c14a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52384/0 (socket says 172.21.15.78:52384) 2023-06-09T11:12:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 -- 172.21.15.78:0/2388880032 learned_addr learned my addr 172.21.15.78:0/2388880032 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156affd700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c0ce470 0x7f156c15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156b7fe700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f156c15df60 0x7f156c14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 -- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c0ce470 msgr2=0x7f156c15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c0ce470 0x7f156c15c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 -- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f156c15df60 msgr2=0x7f156c14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:54.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f156c15df60 0x7f156c14f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:54.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 -- 172.21.15.78:0/2388880032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009b30 con 0x7f156c15a3e0 2023-06-09T11:12:54.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f156a7fc700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15a3e0 0x7f156c14a8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f156000e9d0 tx=0x7f156000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:54.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f15537fe700 1 -- 172.21.15.78:0/2388880032 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560009720 con 0x7f156c15a3e0 2023-06-09T11:12:54.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f15537fe700 1 -- 172.21.15.78:0/2388880032 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156000ee70 con 0x7f156c15a3e0 2023-06-09T11:12:54.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f15537fe700 1 -- 172.21.15.78:0/2388880032 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000ca50 con 0x7f156c15a3e0 2023-06-09T11:12:54.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c06b750 con 0x7f156c15a3e0 2023-06-09T11:12:54.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.771+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c06b470 con 0x7f156c15a3e0 2023-06-09T11:12:54.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.775+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c070240 con 0x7f156c15a3e0 2023-06-09T11:12:54.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.775+0000 7f15537fe700 1 -- 172.21.15.78:0/2388880032 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f156000cbb0 con 0x7f156c15a3e0 2023-06-09T11:12:54.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.775+0000 7f15537fe700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f15580662f0 0x7f15580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:54.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.775+0000 7f15537fe700 1 -- 172.21.15.78:0/2388880032 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1560083e20 con 0x7f156c15a3e0 2023-06-09T11:12:54.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.779+0000 7f156affd700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f15580662f0 0x7f15580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:54.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.779+0000 7f156affd700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f15580662f0 0x7f15580687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f155c015340 tx=0x7f155c00f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:54.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.783+0000 7f15537fe700 1 -- 172.21.15.78:0/2388880032 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1560054c50 con 0x7f156c15a3e0 2023-06-09T11:12:55.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.995+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f156c0741c0 con 0x7f156c15a3e0 2023-06-09T11:12:55.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.995+0000 7f15537fe700 1 -- 172.21.15.78:0/2388880032 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f1560017090 con 0x7f156c15a3e0 2023-06-09T11:12:55.005 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:55.006 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:55.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f15580662f0 msgr2=0x7f15580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f15580662f0 0x7f15580687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f155c015340 tx=0x7f155c00f040 comp rx=0 tx=0).stop 2023-06-09T11:12:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15a3e0 msgr2=0x7f156c14a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15a3e0 0x7f156c14a8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f156000e9d0 tx=0x7f156000ece0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 shutdown_connections 2023-06-09T11:12:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f15580662f0 0x7f15580687a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f156c15df60 0x7f156c14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f156c15a3e0 0x7f156c14a8b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 --2- 172.21.15.78:0/2388880032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f156c0ce470 0x7f156c15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 >> 172.21.15.78:0/2388880032 conn(0x7f156c0cf670 msgr2=0x7f156c0cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 shutdown_connections 2023-06-09T11:12:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:54.999+0000 7f1571501700 1 -- 172.21.15.78:0/2388880032 wait complete. 2023-06-09T11:12:55.010 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:55.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:55.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.187+0000 7fe8650d1700 1 Processor -- start 2023-06-09T11:12:55.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.187+0000 7fe8650d1700 1 -- start start 2023-06-09T11:12:55.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe8650d1700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe86006dfe0 0x7fe8600cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe8650d1700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86006fdd0 con 0x7fe860160e90 2023-06-09T11:12:55.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe8650d1700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8601612e0 con 0x7fe8600adfd0 2023-06-09T11:12:55.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe8650d1700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86006f880 con 0x7fe86006dfe0 2023-06-09T11:12:55.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe857fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe860160e90 0x7fe86006d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43590/0 (socket says 172.21.15.78:43590) 2023-06-09T11:12:55.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe857fff700 1 -- 172.21.15.78:0/2672823581 learned_addr learned my addr 172.21.15.78:0/2672823581 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:55.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85f59e700 1 --2- 172.21.15.78:0/2672823581 >> v2:172.21.15.187:3300/0 conn(0x7fe86006dfe0 0x7fe8600cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565580427 0 0) 0x7fe86006fdd0 con 0x7fe860160e90 2023-06-09T11:12:55.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe84c0035d0 con 0x7fe860160e90 2023-06-09T11:12:55.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928527637 0 0) 0x7fe84c0035d0 con 0x7fe860160e90 2023-06-09T11:12:55.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 >> v2:172.21.15.187:3300/0 conn(0x7fe86006dfe0 msgr2=0x7fe8600cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:55.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 --2- 172.21.15.78:0/2672823581 >> v2:172.21.15.187:3300/0 conn(0x7fe86006dfe0 0x7fe8600cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 >> v1:172.21.15.187:6789/0 conn(0x7fe8600adfd0 legacy=0x7fe860070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600ae3a0 con 0x7fe860160e90 2023-06-09T11:12:55.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7fe848001670 con 0x7fe860160e90 2023-06-09T11:12:55.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85f59e700 1 --2- 172.21.15.78:0/2672823581 >> v2:172.21.15.187:3300/0 conn(0x7fe86006dfe0 0x7fe8600cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:55.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 >> v1:172.21.15.78:6789/0 conn(0x7fe860160e90 legacy=0x7fe86006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84c003a20 0x7fe84c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c004410 0x7fe84c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c0050d0 0x7fe84c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86006f880 con 0x7fe84c004410 2023-06-09T11:12:55.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c00c020 con 0x7fe84c0050d0 2023-06-09T11:12:55.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.191+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c00c1e0 con 0x7fe84c003a20 2023-06-09T11:12:55.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe857fff700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c004410 0x7fe84c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe85f59e700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c0050d0 0x7fe84c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe85ed9d700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84c003a20 0x7fe84c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe857fff700 1 -- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84c003a20 msgr2=0x7fe84c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:55.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe857fff700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84c003a20 0x7fe84c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe857fff700 1 -- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c0050d0 msgr2=0x7fe84c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:55.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe857fff700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c0050d0 0x7fe84c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe85f59e700 1 -- 172.21.15.78:0/2672823581 reap_dead start 2023-06-09T11:12:55.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe857fff700 1 -- 172.21.15.78:0/2672823581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0035d0 con 0x7fe84c004410 2023-06-09T11:12:55.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe857fff700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c004410 0x7fe84c0048d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe84800c320 tx=0x7fe84c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825f4622706ffd19 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:55.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800cd20 con 0x7fe84c004410 2023-06-09T11:12:55.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848007bc0 con 0x7fe84c004410 2023-06-09T11:12:55.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe85e59c700 1 -- 172.21.15.78:0/2672823581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800cea0 con 0x7fe84c004410 2023-06-09T11:12:55.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe8650d1700 1 -- 172.21.15.78:0/2672823581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c004410 msgr2=0x7fe84c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe8650d1700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c004410 0x7fe84c0048d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe84800c320 tx=0x7fe84c0058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe8650d1700 1 -- 172.21.15.78:0/2672823581 shutdown_connections 2023-06-09T11:12:55.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe8650d1700 1 --2- 172.21.15.78:0/2672823581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c004410 0x7fe84c0048d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe8650d1700 1 -- 172.21.15.78:0/2672823581 >> 172.21.15.78:0/2672823581 conn(0x7fe8600b1480 msgr2=0x7fe8600cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:55.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe8650d1700 1 -- 172.21.15.78:0/2672823581 shutdown_connections 2023-06-09T11:12:55.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.195+0000 7fe8650d1700 1 -- 172.21.15.78:0/2672823581 wait complete. 2023-06-09T11:12:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 Processor -- start 2023-06-09T11:12:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 -- start start 2023-06-09T11:12:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c004410 0x7fe86014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8600b29e0 0x7fe86015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8600b2e50 0x7fe86015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86015f1d0 con 0x7fe8600b29e0 2023-06-09T11:12:55.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600b1c20 con 0x7fe84c004410 2023-06-09T11:12:55.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe8650d1700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600b1f00 con 0x7fe8600b2e50 2023-06-09T11:12:55.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe857fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8600b29e0 0x7fe86015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe857fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8600b29e0 0x7fe86015e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38022/0 (socket says 172.21.15.78:38022) 2023-06-09T11:12:55.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe857fff700 1 -- 172.21.15.78:0/3775077963 learned_addr learned my addr 172.21.15.78:0/3775077963 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:55.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe85f59e700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8600b2e50 0x7fe86015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.199+0000 7fe85ed9d700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c004410 0x7fe86014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe857fff700 1 -- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8600b2e50 msgr2=0x7fe86015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe857fff700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8600b2e50 0x7fe86015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe857fff700 1 -- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c004410 msgr2=0x7fe86014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe857fff700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c004410 0x7fe86014bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe857fff700 1 -- 172.21.15.78:0/3775077963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600cd220 con 0x7fe8600b29e0 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe857fff700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8600b29e0 0x7fe86015e660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe84c005830 tx=0x7fe86006fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe8577fe700 1 -- 172.21.15.78:0/3775077963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848004ca0 con 0x7fe8600b29e0 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe8577fe700 1 -- 172.21.15.78:0/3775077963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848004e00 con 0x7fe8600b29e0 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8600ccf40 con 0x7fe8600b29e0 2023-06-09T11:12:55.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe8577fe700 1 -- 172.21.15.78:0/3775077963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480072f0 con 0x7fe8600b29e0 2023-06-09T11:12:55.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86006fa60 con 0x7fe8600b29e0 2023-06-09T11:12:55.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.203+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8600741c0 con 0x7fe8600b29e0 2023-06-09T11:12:55.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.207+0000 7fe8577fe700 1 -- 172.21.15.78:0/3775077963 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe848007450 con 0x7fe8600b29e0 2023-06-09T11:12:55.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.207+0000 7fe8577fe700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8400662f0 0x7fe8400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.207+0000 7fe8577fe700 1 -- 172.21.15.78:0/3775077963 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe848084750 con 0x7fe8600b29e0 2023-06-09T11:12:55.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.207+0000 7fe85ed9d700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8400662f0 0x7fe8400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.211+0000 7fe85ed9d700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8400662f0 0x7fe8400687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe86004fc00 tx=0x7fe850009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:55.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.215+0000 7fe8577fe700 1 -- 172.21.15.78:0/3775077963 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe848051ca0 con 0x7fe8600b29e0 2023-06-09T11:12:55.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.383+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe86015b660 con 0x7fe8600b29e0 2023-06-09T11:12:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.387+0000 7fe8577fe700 1 -- 172.21.15.78:0/3775077963 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18339 (secure 0 0 0) 0x7fe848082e60 con 0x7fe8600b29e0 2023-06-09T11:12:55.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:55.397 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:49.372533+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8400662f0 msgr2=0x7fe8400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8400662f0 0x7fe8400687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe86004fc00 tx=0x7fe850009040 comp rx=0 tx=0).stop 2023-06-09T11:12:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8600b29e0 msgr2=0x7fe86015e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8600b29e0 0x7fe86015e660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe84c005830 tx=0x7fe86006fd40 comp rx=0 tx=0).stop 2023-06-09T11:12:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 shutdown_connections 2023-06-09T11:12:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8400662f0 0x7fe8400687a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8600b2e50 0x7fe86015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8600b29e0 0x7fe86015e660 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 --2- 172.21.15.78:0/3775077963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe84c004410 0x7fe86014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 >> 172.21.15.78:0/3775077963 conn(0x7fe8600b1480 msgr2=0x7fe860160380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:55.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 shutdown_connections 2023-06-09T11:12:55.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.391+0000 7fe8650d1700 1 -- 172.21.15.78:0/3775077963 wait complete. 2023-06-09T11:12:55.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:12:06.883642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:12:07.709423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:12:55.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:12:55.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.587+0000 7f65f5937700 1 Processor -- start 2023-06-09T11:12:55.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.587+0000 7f65f5937700 1 -- start start 2023-06-09T11:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.587+0000 7f65f5937700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65f0146c50 0x7f65f00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.587+0000 7f65f5937700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 0x7f65f006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.587+0000 7f65f5937700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f006a070 con 0x7f65f006b6e0 2023-06-09T11:12:55.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.587+0000 7f65f5937700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f006a310 con 0x7f65f0146c50 2023-06-09T11:12:55.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.587+0000 7f65f5937700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f006a5f0 con 0x7f65f0161610 2023-06-09T11:12:55.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65effff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f65f006b6e0 0x7f65f0160f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43592/0 (socket says 172.21.15.78:43592) 2023-06-09T11:12:55.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65effff700 1 -- 172.21.15.78:0/2643189411 learned_addr learned my addr 172.21.15.78:0/2643189411 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:55.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f4935700 1 --2- 172.21.15.78:0/2643189411 >> v2:172.21.15.78:3300/0 conn(0x7f65f0146c50 0x7f65f00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 0x7f65f006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897828400 0 0) 0x7f65f006a070 con 0x7f65f006b6e0 2023-06-09T11:12:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65d80035d0 con 0x7f65f006b6e0 2023-06-09T11:12:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4049523870 0 0) 0x7f65d80035d0 con 0x7f65f006b6e0 2023-06-09T11:12:55.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 msgr2=0x7f65f006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 0x7f65f006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 >> v2:172.21.15.78:3300/0 conn(0x7f65f0146c50 msgr2=0x7f65f00b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 --2- 172.21.15.78:0/2643189411 >> v2:172.21.15.78:3300/0 conn(0x7f65f0146c50 0x7f65f00b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f006a8d0 con 0x7f65f006b6e0 2023-06-09T11:12:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f65e0001670 con 0x7f65f006b6e0 2023-06-09T11:12:55.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f4935700 1 --2- 172.21.15.78:0/2643189411 >> v2:172.21.15.78:3300/0 conn(0x7f65f0146c50 0x7f65f00b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:55.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 >> v1:172.21.15.78:6789/0 conn(0x7f65f006b6e0 legacy=0x7f65f0160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 0x7f65d8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8003fa0 0x7f65d8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8004db0 0x7f65d8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f006a310 con 0x7f65d8004db0 2023-06-09T11:12:55.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f006a5f0 con 0x7f65d8003fa0 2023-06-09T11:12:55.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d800ba60 con 0x7f65f0161610 2023-06-09T11:12:55.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8004db0 0x7f65d8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f4935700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 0x7f65d8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65effff700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8003fa0 0x7f65d8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 -- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 msgr2=0x7f65d8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:55.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f0161610 0x7f65d8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 -- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8003fa0 msgr2=0x7f65d8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:55.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8003fa0 0x7f65d8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 -- 172.21.15.78:0/2643189411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80035d0 con 0x7f65d8004db0 2023-06-09T11:12:55.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.591+0000 7f65f5136700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8004db0 0x7f65d8005220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009fc0 tx=0x7f65d80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae44fecbae8e2f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:55.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800ebd0 con 0x7f65d8004db0 2023-06-09T11:12:55.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800f040 con 0x7f65d8004db0 2023-06-09T11:12:55.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65ef7fe700 1 -- 172.21.15.78:0/2643189411 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8014480 con 0x7f65d8004db0 2023-06-09T11:12:55.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 -- 172.21.15.78:0/2643189411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8004db0 msgr2=0x7f65d8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 --2- 172.21.15.78:0/2643189411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65d8004db0 0x7f65d8005220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009fc0 tx=0x7f65d80058a0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5136700 1 -- 172.21.15.78:0/2643189411 reap_dead start 2023-06-09T11:12:55.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 -- 172.21.15.78:0/2643189411 shutdown_connections 2023-06-09T11:12:55.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 -- 172.21.15.78:0/2643189411 >> 172.21.15.78:0/2643189411 conn(0x7f65f00b0780 msgr2=0x7f65f00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:55.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 -- 172.21.15.78:0/2643189411 shutdown_connections 2023-06-09T11:12:55.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 -- 172.21.15.78:0/2643189411 wait complete. 2023-06-09T11:12:55.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 Processor -- start 2023-06-09T11:12:55.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.595+0000 7f65f5937700 1 -- start start 2023-06-09T11:12:55.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8004db0 0x7f65f01fa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00a74b0 0x7f65f00a7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01f6560 0x7f65f01f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00ac2f0 con 0x7f65f01f6560 2023-06-09T11:12:55.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00a7e60 con 0x7f65d8004db0 2023-06-09T11:12:55.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00ab700 con 0x7f65f00a74b0 2023-06-09T11:12:55.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01f6560 0x7f65f01f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01f6560 0x7f65f01f69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38034/0 (socket says 172.21.15.78:38034) 2023-06-09T11:12:55.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 -- 172.21.15.78:0/449890448 learned_addr learned my addr 172.21.15.78:0/449890448 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:55.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65effff700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00a74b0 0x7f65f00a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f4935700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8004db0 0x7f65f01fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 -- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00a74b0 msgr2=0x7f65f00a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00a74b0 0x7f65f00a7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 -- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8004db0 msgr2=0x7f65f01fa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8004db0 0x7f65f01fa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 -- 172.21.15.78:0/449890448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f006b0d0 con 0x7f65f01f6560 2023-06-09T11:12:55.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f4935700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8004db0 0x7f65f01fa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:55.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5136700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01f6560 0x7f65f01f69d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f65d8004790 tx=0x7f65e8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:55.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65ed7fa700 1 -- 172.21.15.78:0/449890448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8007000 con 0x7f65f01f6560 2023-06-09T11:12:55.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65ed7fa700 1 -- 172.21.15.78:0/449890448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8022070 con 0x7f65f01f6560 2023-06-09T11:12:55.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65ed7fa700 1 -- 172.21.15.78:0/449890448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8029480 con 0x7f65f01f6560 2023-06-09T11:12:55.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f006abb0 con 0x7f65f01f6560 2023-06-09T11:12:55.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.599+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f00b2ad0 con 0x7f65f01f6560 2023-06-09T11:12:55.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.603+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f00ac430 con 0x7f65f01f6560 2023-06-09T11:12:55.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.603+0000 7f65ed7fa700 1 -- 172.21.15.78:0/449890448 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65e80295e0 con 0x7f65f01f6560 2023-06-09T11:12:55.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.607+0000 7f65ed7fa700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f65dc066320 0x7f65dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:55.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.607+0000 7f65ed7fa700 1 -- 172.21.15.78:0/449890448 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f65e8024070 con 0x7f65f01f6560 2023-06-09T11:12:55.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.607+0000 7f65f4935700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f65dc066320 0x7f65dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:55.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.607+0000 7f65f4935700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f65dc066320 0x7f65dc0687d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65f00aaf70 tx=0x7f65e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:55.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.611+0000 7f65ed7fa700 1 -- 172.21.15.78:0/449890448 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f65f00ac430 con 0x7f65f01f6560 2023-06-09T11:12:55.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:55.755 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:55.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.779+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65f00ac430 con 0x7f65f01f6560 2023-06-09T11:12:55.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.779+0000 7f65ed7fa700 1 -- 172.21.15.78:0/449890448 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65e8018020 con 0x7f65f01f6560 2023-06-09T11:12:55.790 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:12:55.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f65dc066320 msgr2=0x7f65dc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f65dc066320 0x7f65dc0687d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65f00aaf70 tx=0x7f65e4008040 comp rx=0 tx=0).stop 2023-06-09T11:12:55.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01f6560 msgr2=0x7f65f01f69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:55.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01f6560 0x7f65f01f69d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f65d8004790 tx=0x7f65e8009750 comp rx=0 tx=0).stop 2023-06-09T11:12:55.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 shutdown_connections 2023-06-09T11:12:55.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f65dc066320 0x7f65dc0687d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01f6560 0x7f65f01f69d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00a74b0 0x7f65f00a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 --2- 172.21.15.78:0/449890448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65d8004db0 0x7f65f01fa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:55.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 >> 172.21.15.78:0/449890448 conn(0x7f65f00b0780 msgr2=0x7f65f0163b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:55.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 shutdown_connections 2023-06-09T11:12:55.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:55.783+0000 7f65f5937700 1 -- 172.21.15.78:0/449890448 wait complete. 2023-06-09T11:12:55.811 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:12:56.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.031+0000 7fc95592a700 1 Processor -- start 2023-06-09T11:12:56.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.031+0000 7fc95592a700 1 -- start start 2023-06-09T11:12:56.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc95592a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc95015c560 0x7fc9500b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc95592a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc95015c930 0x7fc95015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc95592a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95006b6e0 con 0x7fc9501600b0 2023-06-09T11:12:56.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc95592a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9500b29e0 con 0x7fc95015c930 2023-06-09T11:12:56.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc95592a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95006adb0 con 0x7fc95015c560 2023-06-09T11:12:56.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc95015c930 0x7fc95015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc95015c930 0x7fc95015cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38038/0 (socket says 172.21.15.78:38038) 2023-06-09T11:12:56.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 -- 172.21.15.78:0/2262984143 learned_addr learned my addr 172.21.15.78:0/2262984143 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:56.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc94effd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc95015c560 0x7fc9500b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 -- 172.21.15.78:0/2262984143 >> v2:172.21.15.187:3300/0 conn(0x7fc95015c560 msgr2=0x7fc9500b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:56.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 --2- 172.21.15.78:0/2262984143 >> v2:172.21.15.187:3300/0 conn(0x7fc95015c560 0x7fc9500b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 -- 172.21.15.78:0/2262984143 >> v1:172.21.15.187:6789/0 conn(0x7fc9501600b0 legacy=0x7fc9501604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 -- 172.21.15.78:0/2262984143 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95006b090 con 0x7fc95015c930 2023-06-09T11:12:56.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc947fff700 1 --2- 172.21.15.78:0/2262984143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc95015cdb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc95006d490 tx=0x7fc938009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8880f1da710b1039 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc94e7fc700 1 -- 172.21.15.78:0/2262984143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938011830 con 0x7fc95015c930 2023-06-09T11:12:56.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc94e7fc700 1 -- 172.21.15.78:0/2262984143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938011990 con 0x7fc95015c930 2023-06-09T11:12:56.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.035+0000 7fc94e7fc700 1 -- 172.21.15.78:0/2262984143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938011d20 con 0x7fc95015c930 2023-06-09T11:12:56.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 -- 172.21.15.78:0/2262984143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 msgr2=0x7fc95015cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 --2- 172.21.15.78:0/2262984143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc95015cdb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc95006d490 tx=0x7fc938009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 -- 172.21.15.78:0/2262984143 shutdown_connections 2023-06-09T11:12:56.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 --2- 172.21.15.78:0/2262984143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc95015cdb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 --2- 172.21.15.78:0/2262984143 >> v2:172.21.15.187:3300/0 conn(0x7fc95015c560 0x7fc9500b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 -- 172.21.15.78:0/2262984143 >> 172.21.15.78:0/2262984143 conn(0x7fc9500b0780 msgr2=0x7fc9500b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 -- 172.21.15.78:0/2262984143 shutdown_connections 2023-06-09T11:12:56.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 -- 172.21.15.78:0/2262984143 wait complete. 2023-06-09T11:12:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.039+0000 7fc95592a700 1 Processor -- start 2023-06-09T11:12:56.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc95592a700 1 -- start start 2023-06-09T11:12:56.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc95592a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95015c560 0x7fc950153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc95592a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc9501573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc95592a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9501600b0 0x7fc9501561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc95592a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc950158ee0 con 0x7fc95015c930 2023-06-09T11:12:56.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc95592a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9501582f0 con 0x7fc95015c560 2023-06-09T11:12:56.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc95592a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc950157a50 con 0x7fc9501600b0 2023-06-09T11:12:56.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc9501573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc9501573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38052/0 (socket says 172.21.15.78:38052) 2023-06-09T11:12:56.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 -- 172.21.15.78:0/4113057469 learned_addr learned my addr 172.21.15.78:0/4113057469 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:56.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc94effd700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95015c560 0x7fc950153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc94f7fe700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9501600b0 0x7fc9501561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 -- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9501600b0 msgr2=0x7fc9501561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9501600b0 0x7fc9501561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 -- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95015c560 msgr2=0x7fc950153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95015c560 0x7fc950153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 -- 172.21.15.78:0/4113057469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc938009570 con 0x7fc95015c930 2023-06-09T11:12:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.043+0000 7fc947fff700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc9501573c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9500b1840 tx=0x7fc938004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.047+0000 7fc94cff9700 1 -- 172.21.15.78:0/4113057469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938004450 con 0x7fc95015c930 2023-06-09T11:12:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.047+0000 7fc94cff9700 1 -- 172.21.15.78:0/4113057469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93801f070 con 0x7fc95015c930 2023-06-09T11:12:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.047+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95015d8c0 con 0x7fc95015c930 2023-06-09T11:12:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.047+0000 7fc94cff9700 1 -- 172.21.15.78:0/4113057469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938003900 con 0x7fc95015c930 2023-06-09T11:12:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.047+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95006b370 con 0x7fc95015c930 2023-06-09T11:12:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.047+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95015d2f0 con 0x7fc95015c930 2023-06-09T11:12:56.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.047+0000 7fc94cff9700 1 -- 172.21.15.78:0/4113057469 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc938003a60 con 0x7fc95015c930 2023-06-09T11:12:56.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.051+0000 7fc94cff9700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc930066320 0x7fc9300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.051+0000 7fc94cff9700 1 -- 172.21.15.78:0/4113057469 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc938021070 con 0x7fc95015c930 2023-06-09T11:12:56.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.051+0000 7fc94effd700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc930066320 0x7fc9300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.051+0000 7fc94effd700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc930066320 0x7fc9300687d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc950071270 tx=0x7fc940009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.055+0000 7fc94cff9700 1 -- 172.21.15.78:0/4113057469 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc9380525a0 con 0x7fc95015c930 2023-06-09T11:12:56.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.227+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc950067610 con 0x7fc95015c930 2023-06-09T11:12:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.227+0000 7fc94cff9700 1 -- 172.21.15.78:0/4113057469 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9380045d0 con 0x7fc95015c930 2023-06-09T11:12:56.236 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:12:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc930066320 msgr2=0x7fc9300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc930066320 0x7fc9300687d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc950071270 tx=0x7fc940009240 comp rx=0 tx=0).stop 2023-06-09T11:12:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 msgr2=0x7fc9501573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc9501573c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9500b1840 tx=0x7fc938004770 comp rx=0 tx=0).stop 2023-06-09T11:12:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 shutdown_connections 2023-06-09T11:12:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc930066320 0x7fc9300687d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9501600b0 0x7fc9501561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc95015c930 0x7fc9501573c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 --2- 172.21.15.78:0/4113057469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95015c560 0x7fc950153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 >> 172.21.15.78:0/4113057469 conn(0x7fc9500b0780 msgr2=0x7fc95006a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 shutdown_connections 2023-06-09T11:12:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.231+0000 7fc95592a700 1 -- 172.21.15.78:0/4113057469 wait complete. 2023-06-09T11:12:56.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:12:56.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.423+0000 7f8f92245700 1 Processor -- start 2023-06-09T11:12:56.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.427+0000 7f8f92245700 1 -- start start 2023-06-09T11:12:56.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.427+0000 7f8f92245700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f8c146c50 0x7f8f8c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.427+0000 7f8f92245700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c06b6e0 0x7f8f8c160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.427+0000 7f8f92245700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8c06e6a0 con 0x7f8f8c161440 2023-06-09T11:12:56.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.427+0000 7f8f92245700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8c06a070 con 0x7f8f8c146c50 2023-06-09T11:12:56.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.427+0000 7f8f92245700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c06a310 con 0x7f8f8c06b6e0 2023-06-09T11:12:56.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91a44700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f8c161440 0x7f8f8c164510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43604/0 (socket says 172.21.15.78:43604) 2023-06-09T11:12:56.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91a44700 1 -- 172.21.15.78:0/49057951 learned_addr learned my addr 172.21.15.78:0/49057951 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:56.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91243700 1 --2- 172.21.15.78:0/49057951 >> v2:172.21.15.78:3300/0 conn(0x7f8f8c146c50 0x7f8f8c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f90a42700 1 --2- 172.21.15.78:0/49057951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c06b6e0 0x7f8f8c160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91243700 1 -- 172.21.15.78:0/49057951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c06b6e0 msgr2=0x7f8f8c160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:56.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91243700 1 --2- 172.21.15.78:0/49057951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c06b6e0 0x7f8f8c160f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91243700 1 -- 172.21.15.78:0/49057951 >> v1:172.21.15.78:6789/0 conn(0x7f8f8c161440 legacy=0x7f8f8c164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91243700 1 -- 172.21.15.78:0/49057951 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c06a5f0 con 0x7f8f8c146c50 2023-06-09T11:12:56.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f91243700 1 --2- 172.21.15.78:0/49057951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c0b2590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009850 tx=0x7f8f88009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d26fe3e816131c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f83fff700 1 -- 172.21.15.78:0/49057951 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88011830 con 0x7f8f8c146c50 2023-06-09T11:12:56.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f83fff700 1 -- 172.21.15.78:0/49057951 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f88011990 con 0x7f8f8c146c50 2023-06-09T11:12:56.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.431+0000 7f8f83fff700 1 -- 172.21.15.78:0/49057951 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88011d40 con 0x7f8f8c146c50 2023-06-09T11:12:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 -- 172.21.15.78:0/49057951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 msgr2=0x7f8f8c0b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 --2- 172.21.15.78:0/49057951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c0b2590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009850 tx=0x7f8f88009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 -- 172.21.15.78:0/49057951 shutdown_connections 2023-06-09T11:12:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 --2- 172.21.15.78:0/49057951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c06b6e0 0x7f8f8c160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 --2- 172.21.15.78:0/49057951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c0b2590 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 -- 172.21.15.78:0/49057951 >> 172.21.15.78:0/49057951 conn(0x7f8f8c0b0780 msgr2=0x7f8f8c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:56.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 -- 172.21.15.78:0/49057951 shutdown_connections 2023-06-09T11:12:56.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 -- 172.21.15.78:0/49057951 wait complete. 2023-06-09T11:12:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.435+0000 7f8f92245700 1 Processor -- start 2023-06-09T11:12:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f92245700 1 -- start start 2023-06-09T11:12:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f92245700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8c06b6e0 0x7f8f8c1f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f92245700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f92245700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c161440 0x7f8f8c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f92245700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0ce030 con 0x7f8f8c146c50 2023-06-09T11:12:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f92245700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c1fa0d0 con 0x7f8f8c06b6e0 2023-06-09T11:12:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f92245700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c1fa3b0 con 0x7f8f8c161440 2023-06-09T11:12:56.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f91243700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8c06b6e0 0x7f8f8c1f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38072/0 (socket says 172.21.15.78:38072) 2023-06-09T11:12:56.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 -- 172.21.15.78:0/2776929665 learned_addr learned my addr 172.21.15.78:0/2776929665 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:56.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f91a44700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c161440 0x7f8f8c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 -- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c161440 msgr2=0x7f8f8c15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c161440 0x7f8f8c15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 -- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8c06b6e0 msgr2=0x7f8f8c1f9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8c06b6e0 0x7f8f8c1f9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 -- 172.21.15.78:0/2776929665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880094b0 con 0x7f8f8c146c50 2023-06-09T11:12:56.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.439+0000 7f8f90a42700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c1559f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00e9d0 tx=0x7f8f7c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.443+0000 7f8f81ffb700 1 -- 172.21.15.78:0/2776929665 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c009720 con 0x7f8f8c146c50 2023-06-09T11:12:56.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.443+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c06abb0 con 0x7f8f8c146c50 2023-06-09T11:12:56.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.443+0000 7f8f81ffb700 1 -- 172.21.15.78:0/2776929665 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c00c850 con 0x7f8f8c146c50 2023-06-09T11:12:56.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.443+0000 7f8f81ffb700 1 -- 172.21.15.78:0/2776929665 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c00cbc0 con 0x7f8f8c146c50 2023-06-09T11:12:56.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.443+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c06a8d0 con 0x7f8f8c146c50 2023-06-09T11:12:56.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.443+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c06b0d0 con 0x7f8f8c146c50 2023-06-09T11:12:56.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.443+0000 7f8f81ffb700 1 -- 172.21.15.78:0/2776929665 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f7c00cd20 con 0x7f8f8c146c50 2023-06-09T11:12:56.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.447+0000 7f8f81ffb700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f700662f0 0x7f8f700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.447+0000 7f8f81ffb700 1 -- 172.21.15.78:0/2776929665 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8f7c083dd0 con 0x7f8f8c146c50 2023-06-09T11:12:56.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.447+0000 7f8f91243700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f700662f0 0x7f8f700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.447+0000 7f8f91243700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f700662f0 0x7f8f700687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f880090b0 tx=0x7f8f88008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.451+0000 7f8f81ffb700 1 -- 172.21.15.78:0/2776929665 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8f7c051210 con 0x7f8f8c146c50 2023-06-09T11:12:56.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.623+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f8c067610 con 0x7f8f8c146c50 2023-06-09T11:12:56.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.623+0000 7f8f81ffb700 1 -- 172.21.15.78:0/2776929665 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f7c017020 con 0x7f8f8c146c50 2023-06-09T11:12:56.631 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T11:12:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f700662f0 msgr2=0x7f8f700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f700662f0 0x7f8f700687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f880090b0 tx=0x7f8f88008030 comp rx=0 tx=0).stop 2023-06-09T11:12:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 msgr2=0x7f8f8c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c1559f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00e9d0 tx=0x7f8f7c00ece0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 shutdown_connections 2023-06-09T11:12:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f700662f0 0x7f8f700687a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f8c161440 0x7f8f8c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f8c146c50 0x7f8f8c1559f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 --2- 172.21.15.78:0/2776929665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8c06b6e0 0x7f8f8c1f9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 >> 172.21.15.78:0/2776929665 conn(0x7f8f8c0b0780 msgr2=0x7f8f8c0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 shutdown_connections 2023-06-09T11:12:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.627+0000 7f8f92245700 1 -- 172.21.15.78:0/2776929665 wait complete. 2023-06-09T11:12:56.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:12:56.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.823+0000 7ffb4fce7700 1 Processor -- start 2023-06-09T11:12:56.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.823+0000 7ffb4fce7700 1 -- start start 2023-06-09T11:12:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4fce7700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffb48160b60 0x7ffb4806ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4fce7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480cd470 con 0x7ffb4806b360 2023-06-09T11:12:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4fce7700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480ccbd0 con 0x7ffb48160f30 2023-06-09T11:12:56.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4fce7700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb480cb070 con 0x7ffb48160b60 2023-06-09T11:12:56.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4e284700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ffb4806b360 0x7ffb4806fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43608/0 (socket says 172.21.15.78:43608) 2023-06-09T11:12:56.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4e284700 1 -- 172.21.15.78:0/3682602374 learned_addr learned my addr 172.21.15.78:0/3682602374 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:56.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4da83700 1 --2- 172.21.15.78:0/3682602374 >> v2:172.21.15.187:3300/0 conn(0x7ffb48160b60 0x7ffb4806ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4ca81700 1 -- 172.21.15.78:0/3682602374 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093820169 0 0) 0x7ffb480cd470 con 0x7ffb4806b360 2023-06-09T11:12:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4ca81700 1 -- 172.21.15.78:0/3682602374 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb340035d0 con 0x7ffb4806b360 2023-06-09T11:12:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4da83700 1 -- 172.21.15.78:0/3682602374 >> v1:172.21.15.187:6789/0 conn(0x7ffb48160f30 legacy=0x7ffb480c1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4da83700 1 -- 172.21.15.78:0/3682602374 >> v1:172.21.15.78:6789/0 conn(0x7ffb4806b360 legacy=0x7ffb4806fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4da83700 1 -- 172.21.15.78:0/3682602374 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480cceb0 con 0x7ffb48160b60 2023-06-09T11:12:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4da83700 1 --2- 172.21.15.78:0/3682602374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 0x7ffb4806ae20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009880 tx=0x7ffb44009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b16e1a4ea14c8961 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4ca81700 1 -- 172.21.15.78:0/3682602374 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44011830 con 0x7ffb48160b60 2023-06-09T11:12:56.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4ca81700 1 -- 172.21.15.78:0/3682602374 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb44011990 con 0x7ffb48160b60 2023-06-09T11:12:56.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.827+0000 7ffb4ca81700 1 -- 172.21.15.78:0/3682602374 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44011d20 con 0x7ffb48160b60 2023-06-09T11:12:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 -- 172.21.15.78:0/3682602374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 msgr2=0x7ffb4806ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/3682602374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 0x7ffb4806ae20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009880 tx=0x7ffb44009b90 comp rx=0 tx=0).stop 2023-06-09T11:12:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 -- 172.21.15.78:0/3682602374 shutdown_connections 2023-06-09T11:12:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/3682602374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 0x7ffb4806ae20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 -- 172.21.15.78:0/3682602374 >> 172.21.15.78:0/3682602374 conn(0x7ffb480cf8b0 msgr2=0x7ffb480cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 -- 172.21.15.78:0/3682602374 shutdown_connections 2023-06-09T11:12:56.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 -- 172.21.15.78:0/3682602374 wait complete. 2023-06-09T11:12:56.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.831+0000 7ffb4fce7700 1 Processor -- start 2023-06-09T11:12:56.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4fce7700 1 -- start start 2023-06-09T11:12:56.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4fce7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb4806b360 0x7ffb4814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4fce7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 0x7ffb4815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4fce7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb48160f30 0x7ffb480c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4fce7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4815d040 con 0x7ffb4806b360 2023-06-09T11:12:56.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4fce7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4814acd0 con 0x7ffb48160b60 2023-06-09T11:12:56.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4fce7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4815bfa0 con 0x7ffb48160f30 2023-06-09T11:12:56.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb4806b360 0x7ffb4814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb4806b360 0x7ffb4814a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38088/0 (socket says 172.21.15.78:38088) 2023-06-09T11:12:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 -- 172.21.15.78:0/1630370002 learned_addr learned my addr 172.21.15.78:0/1630370002 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4d282700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 0x7ffb4815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4e284700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb48160f30 0x7ffb480c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 -- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb48160f30 msgr2=0x7ffb480c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb48160f30 0x7ffb480c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 -- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 msgr2=0x7ffb4815b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 0x7ffb4815b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:56.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 -- 172.21.15.78:0/1630370002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb440094b0 con 0x7ffb4806b360 2023-06-09T11:12:56.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb4da83700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb4806b360 0x7ffb4814a790 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009850 tx=0x7ffb44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb3e7fc700 1 -- 172.21.15.78:0/1630370002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44004400 con 0x7ffb4806b360 2023-06-09T11:12:56.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.835+0000 7ffb3e7fc700 1 -- 172.21.15.78:0/1630370002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4401f070 con 0x7ffb4806b360 2023-06-09T11:12:56.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.839+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4806f9b0 con 0x7ffb4806b360 2023-06-09T11:12:56.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.839+0000 7ffb3e7fc700 1 -- 172.21.15.78:0/1630370002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440036c0 con 0x7ffb4806b360 2023-06-09T11:12:56.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.839+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb480cd190 con 0x7ffb4806b360 2023-06-09T11:12:56.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.839+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb480cc7f0 con 0x7ffb4806b360 2023-06-09T11:12:56.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.839+0000 7ffb3e7fc700 1 -- 172.21.15.78:0/1630370002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb44021030 con 0x7ffb4806b360 2023-06-09T11:12:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.843+0000 7ffb3e7fc700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffb2c0662f0 0x7ffb2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.843+0000 7ffb3e7fc700 1 -- 172.21.15.78:0/1630370002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffb44084fd0 con 0x7ffb4806b360 2023-06-09T11:12:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.843+0000 7ffb4d282700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffb2c0662f0 0x7ffb2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:56.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.843+0000 7ffb4d282700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffb2c0662f0 0x7ffb2c0687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffb4815de30 tx=0x7ffb38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:56.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:56.847+0000 7ffb3e7fc700 1 -- 172.21.15.78:0/1630370002 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffb440524a0 con 0x7ffb4806b360 2023-06-09T11:12:57.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.015+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb480741c0 con 0x7ffb4806b360 2023-06-09T11:12:57.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.015+0000 7ffb3e7fc700 1 -- 172.21.15.78:0/1630370002 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb44055ac0 con 0x7ffb4806b360 2023-06-09T11:12:57.023 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T11:12:57.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffb2c0662f0 msgr2=0x7ffb2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffb2c0662f0 0x7ffb2c0687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffb4815de30 tx=0x7ffb38009040 comp rx=0 tx=0).stop 2023-06-09T11:12:57.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb4806b360 msgr2=0x7ffb4814a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb4806b360 0x7ffb4814a790 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009850 tx=0x7ffb44004770 comp rx=0 tx=0).stop 2023-06-09T11:12:57.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 shutdown_connections 2023-06-09T11:12:57.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffb2c0662f0 0x7ffb2c0687a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb48160f30 0x7ffb480c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb48160b60 0x7ffb4815b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 --2- 172.21.15.78:0/1630370002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb4806b360 0x7ffb4814a790 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 >> 172.21.15.78:0/1630370002 conn(0x7ffb480cf8b0 msgr2=0x7ffb48163830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:57.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 shutdown_connections 2023-06-09T11:12:57.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.019+0000 7ffb4fce7700 1 -- 172.21.15.78:0/1630370002 wait complete. 2023-06-09T11:12:57.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:57.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f98900700 1 Processor -- start 2023-06-09T11:12:57.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f98900700 1 -- start start 2023-06-09T11:12:57.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f98900700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f9415e670 0x7f8f9406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f98900700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8f940ce470 0x7f8f9406f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f98900700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f940cc8e0 con 0x7f8f9415a3e0 2023-06-09T11:12:57.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f98900700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9415a7b0 con 0x7f8f9415e670 2023-06-09T11:12:57.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f98900700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f940ccb80 con 0x7f8f940ce470 2023-06-09T11:12:57.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f92d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f9415a3e0 0x7f8f9415df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43616/0 (socket says 172.21.15.78:43616) 2023-06-09T11:12:57.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f92d9d700 1 -- 172.21.15.78:0/455199626 learned_addr learned my addr 172.21.15.78:0/455199626 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:57.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f8a59c700 1 --2- 172.21.15.78:0/455199626 >> v2:172.21.15.78:3300/0 conn(0x7f8f9415e670 0x7f8f9406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.215+0000 7f8f9359e700 1 --2- 172.21.15.78:0/455199626 >> v2:172.21.15.187:3300/0 conn(0x7f8f940ce470 0x7f8f9406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f8a59c700 1 -- 172.21.15.78:0/455199626 >> v2:172.21.15.187:3300/0 conn(0x7f8f940ce470 msgr2=0x7f8f9406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:57.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f8a59c700 1 --2- 172.21.15.78:0/455199626 >> v2:172.21.15.187:3300/0 conn(0x7f8f940ce470 0x7f8f9406f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f8a59c700 1 -- 172.21.15.78:0/455199626 >> v1:172.21.15.78:6789/0 conn(0x7f8f9415a3e0 legacy=0x7f8f9415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f8a59c700 1 -- 172.21.15.78:0/455199626 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9406b470 con 0x7f8f9415e670 2023-06-09T11:12:57.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f9259c700 1 -- 172.21.15.78:0/455199626 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953111720 0 0) 0x7f8f940cc8e0 con 0x7f8f9415a3e0 2023-06-09T11:12:57.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f8a59c700 1 --2- 172.21.15.78:0/455199626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415e670 0x7f8f9406e960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ae1e0 tx=0x7f8f7c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2e70c95f257d58 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:57.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f9259c700 1 -- 172.21.15.78:0/455199626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c011830 con 0x7f8f9415e670 2023-06-09T11:12:57.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f9259c700 1 -- 172.21.15.78:0/455199626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c011990 con 0x7f8f9415e670 2023-06-09T11:12:57.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f9259c700 1 -- 172.21.15.78:0/455199626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c011d20 con 0x7f8f9415e670 2023-06-09T11:12:57.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 -- 172.21.15.78:0/455199626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415e670 msgr2=0x7f8f9406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 --2- 172.21.15.78:0/455199626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415e670 0x7f8f9406e960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ae1e0 tx=0x7f8f7c009b30 comp rx=0 tx=0).stop 2023-06-09T11:12:57.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 -- 172.21.15.78:0/455199626 shutdown_connections 2023-06-09T11:12:57.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 --2- 172.21.15.78:0/455199626 >> v2:172.21.15.187:3300/0 conn(0x7f8f940ce470 0x7f8f9406f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 --2- 172.21.15.78:0/455199626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415e670 0x7f8f9406e960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 -- 172.21.15.78:0/455199626 >> 172.21.15.78:0/455199626 conn(0x7f8f940cf670 msgr2=0x7f8f940cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:57.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 -- 172.21.15.78:0/455199626 shutdown_connections 2023-06-09T11:12:57.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.219+0000 7f8f98900700 1 -- 172.21.15.78:0/455199626 wait complete. 2023-06-09T11:12:57.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.223+0000 7f8f98900700 1 Processor -- start 2023-06-09T11:12:57.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.223+0000 7f8f98900700 1 -- start start 2023-06-09T11:12:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f940ce470 0x7f8f940ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415a3e0 0x7f8f94144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f9415e670 0x7f8f940b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940b27a0 con 0x7f8f9415a3e0 2023-06-09T11:12:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940c8530 con 0x7f8f940ce470 2023-06-09T11:12:57.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94145330 con 0x7f8f9415e670 2023-06-09T11:12:57.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415a3e0 0x7f8f94144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415a3e0 0x7f8f94144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38116/0 (socket says 172.21.15.78:38116) 2023-06-09T11:12:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 -- 172.21.15.78:0/3244279578 learned_addr learned my addr 172.21.15.78:0/3244279578 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f92d9d700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f940ce470 0x7f8f940ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f9359e700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f9415e670 0x7f8f940b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 -- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f9415e670 msgr2=0x7f8f940b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f9415e670 0x7f8f940b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 -- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f940ce470 msgr2=0x7f8f940ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f940ce470 0x7f8f940ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 -- 172.21.15.78:0/3244279578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0094b0 con 0x7f8f9415a3e0 2023-06-09T11:12:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f92d9d700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f940ce470 0x7f8f940ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8a59c700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415a3e0 0x7f8f94144df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c014040 tx=0x7f8f7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8bfff700 1 -- 172.21.15.78:0/3244279578 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0038c0 con 0x7f8f9415a3e0 2023-06-09T11:12:57.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8bfff700 1 -- 172.21.15.78:0/3244279578 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c01e070 con 0x7f8f9415a3e0 2023-06-09T11:12:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f8bfff700 1 -- 172.21.15.78:0/3244279578 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c003c80 con 0x7f8f9415a3e0 2023-06-09T11:12:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f94070240 con 0x7f8f9415a3e0 2023-06-09T11:12:57.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.227+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9406b750 con 0x7f8f9415a3e0 2023-06-09T11:12:57.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.231+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f940703d0 con 0x7f8f9415a3e0 2023-06-09T11:12:57.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.231+0000 7f8f8bfff700 1 -- 172.21.15.78:0/3244279578 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f7c02d450 con 0x7f8f9415a3e0 2023-06-09T11:12:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.235+0000 7f8f8bfff700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f740662f0 0x7f8f740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.235+0000 7f8f8bfff700 1 -- 172.21.15.78:0/3244279578 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8f7c084d00 con 0x7f8f9415a3e0 2023-06-09T11:12:57.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.235+0000 7f8f92d9d700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f740662f0 0x7f8f740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.235+0000 7f8f92d9d700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f740662f0 0x7f8f740687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f84000f60 tx=0x7f8f84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:57.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.239+0000 7f8f8bfff700 1 -- 172.21.15.78:0/3244279578 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8f7c052130 con 0x7f8f9415a3e0 2023-06-09T11:12:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.447+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f940741c0 con 0x7f8f9415a3e0 2023-06-09T11:12:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.447+0000 7f8f8bfff700 1 -- 172.21.15.78:0/3244279578 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f8f7c015090 con 0x7f8f9415a3e0 2023-06-09T11:12:57.456 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:57.456 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:57.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f740662f0 msgr2=0x7f8f740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f740662f0 0x7f8f740687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f84000f60 tx=0x7f8f84009040 comp rx=0 tx=0).stop 2023-06-09T11:12:57.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415a3e0 msgr2=0x7f8f94144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415a3e0 0x7f8f94144df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c014040 tx=0x7f8f7c004770 comp rx=0 tx=0).stop 2023-06-09T11:12:57.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 shutdown_connections 2023-06-09T11:12:57.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8f740662f0 0x7f8f740687a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f9415e670 0x7f8f940b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f9415a3e0 0x7f8f94144df0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 --2- 172.21.15.78:0/3244279578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f940ce470 0x7f8f940ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 >> 172.21.15.78:0/3244279578 conn(0x7f8f940cf670 msgr2=0x7f8f940ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 shutdown_connections 2023-06-09T11:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.451+0000 7f8f98900700 1 -- 172.21.15.78:0/3244279578 wait complete. 2023-06-09T11:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:57.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.631+0000 7fb958861700 1 Processor -- start 2023-06-09T11:12:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.631+0000 7fb958861700 1 -- start start 2023-06-09T11:12:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb958861700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb95415a3e0 0x7fb95406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb958861700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb95406f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb958861700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb95415df60 0x7fb95415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb958861700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95415e920 con 0x7fb95415a3e0 2023-06-09T11:12:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb958861700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9540cc8e0 con 0x7fb95415df60 2023-06-09T11:12:57.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb958861700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95415a7b0 con 0x7fb9540ce470 2023-06-09T11:12:57.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb95415a3e0 0x7fb95406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb95415a3e0 0x7fb95406e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38124/0 (socket says 172.21.15.78:38124) 2023-06-09T11:12:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 -- 172.21.15.78:0/713379676 learned_addr learned my addr 172.21.15.78:0/713379676 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb952ffd700 1 --2- 172.21.15.78:0/713379676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb95406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb953fff700 1 --2- 172.21.15.78:0/713379676 >> v2:172.21.15.187:3300/0 conn(0x7fb95415df60 0x7fb95415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 -- 172.21.15.78:0/713379676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 msgr2=0x7fb95406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 --2- 172.21.15.78:0/713379676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb95406f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 -- 172.21.15.78:0/713379676 >> v2:172.21.15.187:3300/0 conn(0x7fb95415df60 msgr2=0x7fb95415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 --2- 172.21.15.78:0/713379676 >> v2:172.21.15.187:3300/0 conn(0x7fb95415df60 0x7fb95415e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 -- 172.21.15.78:0/713379676 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540ccb80 con 0x7fb95415a3e0 2023-06-09T11:12:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9537fe700 1 --2- 172.21.15.78:0/713379676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415a3e0 0x7fb95406e960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb9540ae1e0 tx=0x7fb944009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2781a27cc19f594f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.635+0000 7fb9527fc700 1 -- 172.21.15.78:0/713379676 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944011830 con 0x7fb95415a3e0 2023-06-09T11:12:57.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb9527fc700 1 -- 172.21.15.78:0/713379676 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944011990 con 0x7fb95415a3e0 2023-06-09T11:12:57.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb9527fc700 1 -- 172.21.15.78:0/713379676 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944011d20 con 0x7fb95415a3e0 2023-06-09T11:12:57.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 -- 172.21.15.78:0/713379676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415a3e0 msgr2=0x7fb95406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 --2- 172.21.15.78:0/713379676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415a3e0 0x7fb95406e960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb9540ae1e0 tx=0x7fb944009bf0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 -- 172.21.15.78:0/713379676 shutdown_connections 2023-06-09T11:12:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 --2- 172.21.15.78:0/713379676 >> v2:172.21.15.187:3300/0 conn(0x7fb95415df60 0x7fb95415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 --2- 172.21.15.78:0/713379676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb95406f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 --2- 172.21.15.78:0/713379676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415a3e0 0x7fb95406e960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 -- 172.21.15.78:0/713379676 >> 172.21.15.78:0/713379676 conn(0x7fb9540cf670 msgr2=0x7fb9540cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:57.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 -- 172.21.15.78:0/713379676 shutdown_connections 2023-06-09T11:12:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.639+0000 7fb958861700 1 -- 172.21.15.78:0/713379676 wait complete. 2023-06-09T11:12:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 Processor -- start 2023-06-09T11:12:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 -- start start 2023-06-09T11:12:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb9540b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb95415a3e0 0x7fb9540b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415df60 0x7fb95415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540af200 con 0x7fb95415df60 2023-06-09T11:12:57.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540af4e0 con 0x7fb95415a3e0 2023-06-09T11:12:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb958861700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540af7c0 con 0x7fb9540ce470 2023-06-09T11:12:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415df60 0x7fb95415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415df60 0x7fb95415bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38132/0 (socket says 172.21.15.78:38132) 2023-06-09T11:12:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 -- 172.21.15.78:0/3049765591 learned_addr learned my addr 172.21.15.78:0/3049765591 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb9537fe700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb9540b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb952ffd700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb95415a3e0 0x7fb9540b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 -- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 msgr2=0x7fb9540b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb9540b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 -- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb95415a3e0 msgr2=0x7fb9540b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb95415a3e0 0x7fb9540b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 -- 172.21.15.78:0/3049765591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944009570 con 0x7fb95415df60 2023-06-09T11:12:57.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb952ffd700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb95415a3e0 0x7fb9540b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:12:57.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.643+0000 7fb953fff700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415df60 0x7fb95415bef0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00efc0 tx=0x7fb94c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:57.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.647+0000 7fb93bfff700 1 -- 172.21.15.78:0/3049765591 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c009ba0 con 0x7fb95415df60 2023-06-09T11:12:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.647+0000 7fb93bfff700 1 -- 172.21.15.78:0/3049765591 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c00f040 con 0x7fb95415df60 2023-06-09T11:12:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.647+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95406b750 con 0x7fb95415df60 2023-06-09T11:12:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.647+0000 7fb93bfff700 1 -- 172.21.15.78:0/3049765591 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c014480 con 0x7fb95415df60 2023-06-09T11:12:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.647+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95406b470 con 0x7fb95415df60 2023-06-09T11:12:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.647+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb954070240 con 0x7fb95415df60 2023-06-09T11:12:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.651+0000 7fb93bfff700 1 -- 172.21.15.78:0/3049765591 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb94c0145e0 con 0x7fb95415df60 2023-06-09T11:12:57.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.651+0000 7fb93bfff700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb9400662f0 0x7fb9400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:57.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.651+0000 7fb93bfff700 1 -- 172.21.15.78:0/3049765591 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb94c084980 con 0x7fb95415df60 2023-06-09T11:12:57.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.651+0000 7fb9537fe700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb9400662f0 0x7fb9400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:57.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.655+0000 7fb9537fe700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb9400662f0 0x7fb9400687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb944000c00 tx=0x7fb944008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:57.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.659+0000 7fb93bfff700 1 -- 172.21.15.78:0/3049765591 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb94c051c90 con 0x7fb95415df60 2023-06-09T11:12:57.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.827+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb954067190 con 0x7fb95415df60 2023-06-09T11:12:57.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.827+0000 7fb93bfff700 1 -- 172.21.15.78:0/3049765591 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18339 (secure 0 0 0) 0x7fb94c018070 con 0x7fb95415df60 2023-06-09T11:12:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:57.837 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:49.372533+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:57.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb9400662f0 msgr2=0x7fb9400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb9400662f0 0x7fb9400687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb944000c00 tx=0x7fb944008030 comp rx=0 tx=0).stop 2023-06-09T11:12:57.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415df60 msgr2=0x7fb95415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:57.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415df60 0x7fb95415bef0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00efc0 tx=0x7fb94c00c3a0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 shutdown_connections 2023-06-09T11:12:57.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb9400662f0 0x7fb9400687a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb95415df60 0x7fb95415bef0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb95415a3e0 0x7fb9540b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 --2- 172.21.15.78:0/3049765591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9540ce470 0x7fb9540b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:57.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 >> 172.21.15.78:0/3049765591 conn(0x7fb9540cf670 msgr2=0x7fb9540c44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:57.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 shutdown_connections 2023-06-09T11:12:57.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:57.831+0000 7fb958861700 1 -- 172.21.15.78:0/3049765591 wait complete. 2023-06-09T11:12:57.861 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T11:12:57.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:58.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.027+0000 7feeaef33700 1 Processor -- start 2023-06-09T11:12:58.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.027+0000 7feeaef33700 1 -- start start 2023-06-09T11:12:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feeaef33700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7feea815dc70 0x7feea80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feeaef33700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80713a0 0x7feea80717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feeaef33700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea8159b10 con 0x7feea80af1a0 2023-06-09T11:12:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feeaef33700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea80ccaf0 con 0x7feea815dc70 2023-06-09T11:12:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feeaef33700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80b06e0 con 0x7feea80713a0 2023-06-09T11:12:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feead4d0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80713a0 0x7feea80717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feeacccf700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7feea80af1a0 0x7feea80ca380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:34994/0 (socket says 172.21.15.78:34994) 2023-06-09T11:12:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feeacccf700 1 -- 172.21.15.78:0/1642528710 learned_addr learned my addr 172.21.15.78:0/1642528710 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feea7fff700 1 --2- 172.21.15.78:0/1642528710 >> v2:172.21.15.187:3300/0 conn(0x7feea815dc70 0x7feea80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feea77fe700 1 -- 172.21.15.78:0/1642528710 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174340265 0 0) 0x7fee9c001160 con 0x7feea80af1a0 2023-06-09T11:12:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feead4d0700 1 -- 172.21.15.78:0/1642528710 >> v2:172.21.15.187:3300/0 conn(0x7feea815dc70 msgr2=0x7feea80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feead4d0700 1 --2- 172.21.15.78:0/1642528710 >> v2:172.21.15.187:3300/0 conn(0x7feea815dc70 0x7feea80cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feead4d0700 1 -- 172.21.15.78:0/1642528710 >> v1:172.21.15.187:6789/0 conn(0x7feea80af1a0 legacy=0x7feea80ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feead4d0700 1 -- 172.21.15.78:0/1642528710 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8071d20 con 0x7feea80713a0 2023-06-09T11:12:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feead4d0700 1 --2- 172.21.15.78:0/1642528710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80713a0 0x7feea80717e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feea0009d90 tx=0x7feea000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7371e270a5ccc4ae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feea77fe700 1 -- 172.21.15.78:0/1642528710 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea000e070 con 0x7feea80713a0 2023-06-09T11:12:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feea77fe700 1 -- 172.21.15.78:0/1642528710 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea000bb20 con 0x7feea80713a0 2023-06-09T11:12:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.031+0000 7feea77fe700 1 -- 172.21.15.78:0/1642528710 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0012430 con 0x7feea80713a0 2023-06-09T11:12:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 -- 172.21.15.78:0/1642528710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80713a0 msgr2=0x7feea80717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 --2- 172.21.15.78:0/1642528710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80713a0 0x7feea80717e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feea0009d90 tx=0x7feea000b330 comp rx=0 tx=0).stop 2023-06-09T11:12:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 -- 172.21.15.78:0/1642528710 shutdown_connections 2023-06-09T11:12:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 --2- 172.21.15.78:0/1642528710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80713a0 0x7feea80717e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 --2- 172.21.15.78:0/1642528710 >> v2:172.21.15.187:3300/0 conn(0x7feea815dc70 0x7feea80cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 -- 172.21.15.78:0/1642528710 >> 172.21.15.78:0/1642528710 conn(0x7feea80b2c80 msgr2=0x7feea80b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 -- 172.21.15.78:0/1642528710 shutdown_connections 2023-06-09T11:12:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.035+0000 7feeaef33700 1 -- 172.21.15.78:0/1642528710 wait complete. 2023-06-09T11:12:58.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 Processor -- start 2023-06-09T11:12:58.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 -- start start 2023-06-09T11:12:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feea80713a0 0x7feea815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80af1a0 0x7feea815bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feea815dc70 0x7feea815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c98e0 con 0x7feea815dc70 2023-06-09T11:12:58.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c8cd0 con 0x7feea80713a0 2023-06-09T11:12:58.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feeaef33700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c8fb0 con 0x7feea80af1a0 2023-06-09T11:12:58.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feead4d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feea815dc70 0x7feea815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.039+0000 7feead4d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feea815dc70 0x7feea815c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38140/0 (socket says 172.21.15.78:38140) 2023-06-09T11:12:58.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feead4d0700 1 -- 172.21.15.78:0/1862569109 learned_addr learned my addr 172.21.15.78:0/1862569109 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:58.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feeacccf700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feea80713a0 0x7feea815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feea7fff700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80af1a0 0x7feea815bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feead4d0700 1 -- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80af1a0 msgr2=0x7feea815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feead4d0700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80af1a0 0x7feea815bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feead4d0700 1 -- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feea80713a0 msgr2=0x7feea815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feead4d0700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feea80713a0 0x7feea815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feead4d0700 1 -- 172.21.15.78:0/1862569109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0009a70 con 0x7feea815dc70 2023-06-09T11:12:58.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feead4d0700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feea815dc70 0x7feea815c1b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feea0014040 tx=0x7feea0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feea57fa700 1 -- 172.21.15.78:0/1862569109 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0004780 con 0x7feea815dc70 2023-06-09T11:12:58.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feea57fa700 1 -- 172.21.15.78:0/1862569109 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0020070 con 0x7feea815dc70 2023-06-09T11:12:58.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feea57fa700 1 -- 172.21.15.78:0/1862569109 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00276c0 con 0x7feea815dc70 2023-06-09T11:12:58.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80ccce0 con 0x7feea815dc70 2023-06-09T11:12:58.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea815e0a0 con 0x7feea815dc70 2023-06-09T11:12:58.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.043+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea80ccfc0 con 0x7feea815dc70 2023-06-09T11:12:58.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.047+0000 7feea57fa700 1 -- 172.21.15.78:0/1862569109 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feea0012430 con 0x7feea815dc70 2023-06-09T11:12:58.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.047+0000 7feea57fa700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee8c066320 0x7fee8c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.047+0000 7feea57fa700 1 -- 172.21.15.78:0/1862569109 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7feea0022070 con 0x7feea815dc70 2023-06-09T11:12:58.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.047+0000 7feeacccf700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee8c066320 0x7fee8c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.051+0000 7feeacccf700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee8c066320 0x7fee8c0687d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fee9c007e90 tx=0x7fee9c007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.055+0000 7feea57fa700 1 -- 172.21.15.78:0/1862569109 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feea0052d10 con 0x7feea815dc70 2023-06-09T11:12:58.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.263+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feea8067100 con 0x7feea815dc70 2023-06-09T11:12:58.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.263+0000 7feea57fa700 1 -- 172.21.15.78:0/1862569109 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7feea8067100 con 0x7feea815dc70 2023-06-09T11:12:58.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:58.274 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:58.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee8c066320 msgr2=0x7fee8c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee8c066320 0x7fee8c0687d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fee9c007e90 tx=0x7fee9c007e20 comp rx=0 tx=0).stop 2023-06-09T11:12:58.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feea815dc70 msgr2=0x7feea815c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feea815dc70 0x7feea815c1b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feea0014040 tx=0x7feea0004af0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 shutdown_connections 2023-06-09T11:12:58.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee8c066320 0x7fee8c0687d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feea815dc70 0x7feea815c1b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feea80af1a0 0x7feea815bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 --2- 172.21.15.78:0/1862569109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feea80713a0 0x7feea815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 >> 172.21.15.78:0/1862569109 conn(0x7feea80b2c80 msgr2=0x7feea80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 shutdown_connections 2023-06-09T11:12:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.267+0000 7feeaef33700 1 -- 172.21.15.78:0/1862569109 wait complete. 2023-06-09T11:12:58.279 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:58.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:12:58.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.455+0000 7f7b15746700 1 Processor -- start 2023-06-09T11:12:58.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b15746700 1 -- start start 2023-06-09T11:12:58.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b15746700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b100d2360 0x7f7b1006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b15746700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b100d2730 0x7f7b1006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b15746700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1006c230 con 0x7f7b10160860 2023-06-09T11:12:58.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b15746700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1006b990 con 0x7f7b100d2730 2023-06-09T11:12:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b15746700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1006bc70 con 0x7f7b100d2360 2023-06-09T11:12:58.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0effd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b100d2360 0x7f7b1006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0effd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b100d2360 0x7f7b1006b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:56194/0 (socket says 172.21.15.78:56194) 2023-06-09T11:12:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0effd700 1 -- 172.21.15.78:0/664102126 learned_addr learned my addr 172.21.15.78:0/664102126 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0e7fc700 1 --2- 172.21.15.78:0/664102126 >> v2:172.21.15.187:3300/0 conn(0x7f7b100d2730 0x7f7b1006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0effd700 1 -- 172.21.15.78:0/664102126 >> v2:172.21.15.187:3300/0 conn(0x7f7b100d2730 msgr2=0x7f7b1006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0effd700 1 --2- 172.21.15.78:0/664102126 >> v2:172.21.15.187:3300/0 conn(0x7f7b100d2730 0x7f7b1006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0effd700 1 -- 172.21.15.78:0/664102126 >> v1:172.21.15.187:6789/0 conn(0x7f7b10160860 legacy=0x7f7b100cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.459+0000 7f7b0effd700 1 -- 172.21.15.78:0/664102126 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1006bf50 con 0x7f7b100d2360 2023-06-09T11:12:58.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b0effd700 1 --2- 172.21.15.78:0/664102126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b100d2360 0x7f7b1006b3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009910 tx=0x7f7b00009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c331a66a5485b159 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b0dffb700 1 -- 172.21.15.78:0/664102126 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011830 con 0x7f7b100d2360 2023-06-09T11:12:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b0dffb700 1 -- 172.21.15.78:0/664102126 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00011990 con 0x7f7b100d2360 2023-06-09T11:12:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b0dffb700 1 -- 172.21.15.78:0/664102126 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00011d40 con 0x7f7b100d2360 2023-06-09T11:12:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 -- 172.21.15.78:0/664102126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b100d2360 msgr2=0x7f7b1006b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 --2- 172.21.15.78:0/664102126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b100d2360 0x7f7b1006b3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009910 tx=0x7f7b00009c20 comp rx=0 tx=0).stop 2023-06-09T11:12:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 -- 172.21.15.78:0/664102126 shutdown_connections 2023-06-09T11:12:58.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 --2- 172.21.15.78:0/664102126 >> v2:172.21.15.187:3300/0 conn(0x7f7b100d2730 0x7f7b1006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 --2- 172.21.15.78:0/664102126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b100d2360 0x7f7b1006b3b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 -- 172.21.15.78:0/664102126 >> 172.21.15.78:0/664102126 conn(0x7f7b100d1210 msgr2=0x7f7b100d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:58.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 -- 172.21.15.78:0/664102126 shutdown_connections 2023-06-09T11:12:58.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.463+0000 7f7b15746700 1 -- 172.21.15.78:0/664102126 wait complete. 2023-06-09T11:12:58.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 Processor -- start 2023-06-09T11:12:58.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 -- start start 2023-06-09T11:12:58.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b100d2360 0x7f7b100ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100d2730 0x7f7b100ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b10160860 0x7f7b101e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100cfa70 con 0x7f7b100d2360 2023-06-09T11:12:58.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100cedf0 con 0x7f7b100d2730 2023-06-09T11:12:58.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b15746700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100cf0d0 con 0x7f7b10160860 2023-06-09T11:12:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b100d2360 0x7f7b100ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b100d2360 0x7f7b100ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38154/0 (socket says 172.21.15.78:38154) 2023-06-09T11:12:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 -- 172.21.15.78:0/2809256603 learned_addr learned my addr 172.21.15.78:0/2809256603 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0e7fc700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100d2730 0x7f7b100ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0ffff700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b10160860 0x7f7b101e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 -- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b10160860 msgr2=0x7f7b101e59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b10160860 0x7f7b101e59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 -- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100d2730 msgr2=0x7f7b100ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100d2730 0x7f7b100ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0effd700 1 -- 172.21.15.78:0/2809256603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009570 con 0x7f7b100d2360 2023-06-09T11:12:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.467+0000 7f7b0ffff700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b10160860 0x7f7b101e59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:58.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.471+0000 7f7b0effd700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b100d2360 0x7f7b100ca030 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000c00 tx=0x7f7b00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.471+0000 7f7af77fe700 1 -- 172.21.15.78:0/2809256603 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00004510 con 0x7f7b100d2360 2023-06-09T11:12:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.471+0000 7f7af77fe700 1 -- 172.21.15.78:0/2809256603 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b000036c0 con 0x7f7b100d2360 2023-06-09T11:12:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.471+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1006d720 con 0x7f7b100d2360 2023-06-09T11:12:58.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.471+0000 7f7af77fe700 1 -- 172.21.15.78:0/2809256603 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00003a70 con 0x7f7b100d2360 2023-06-09T11:12:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.471+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b10160340 con 0x7f7b100d2360 2023-06-09T11:12:58.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.471+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b100d2b80 con 0x7f7b100d2360 2023-06-09T11:12:58.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.475+0000 7f7af77fe700 1 -- 172.21.15.78:0/2809256603 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b00006d50 con 0x7f7b100d2360 2023-06-09T11:12:58.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.475+0000 7f7af77fe700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7afc0662f0 0x7f7afc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.475+0000 7f7af77fe700 1 -- 172.21.15.78:0/2809256603 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7b00085290 con 0x7f7b100d2360 2023-06-09T11:12:58.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.475+0000 7f7b0e7fc700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7afc0662f0 0x7f7afc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.479+0000 7f7b0e7fc700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7afc0662f0 0x7f7afc0687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b101f5510 tx=0x7f7b04009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.483+0000 7f7af77fe700 1 -- 172.21.15.78:0/2809256603 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7b00052640 con 0x7f7b100d2360 2023-06-09T11:12:58.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.695+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b1006d9d0 con 0x7f7b100d2360 2023-06-09T11:12:58.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.695+0000 7f7af77fe700 1 -- 172.21.15.78:0/2809256603 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f7b00055c60 con 0x7f7b100d2360 2023-06-09T11:12:58.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:58.705 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4197016136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4197016136},{"type":"v1","addr":"172.21.15.187:6837","nonce":4197016136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1617648950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1617648950},{"type":"v1","addr":"172.21.15.78:6834","nonce":1617648950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/366220032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":366220032},{"type":"v1","addr":"172.21.15.78:6835","nonce":366220032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:12:08.797648+0000","modified":"2023-06-09T11:12:12.170191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/2567299760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2567299760},{"type":"v1","addr":"172.21.15.187:6835","nonce":2567299760}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T11:12:58.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7afc0662f0 msgr2=0x7f7afc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7afc0662f0 0x7f7afc0687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b101f5510 tx=0x7f7b04009240 comp rx=0 tx=0).stop 2023-06-09T11:12:58.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b100d2360 msgr2=0x7f7b100ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b100d2360 0x7f7b100ca030 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000c00 tx=0x7f7b00004770 comp rx=0 tx=0).stop 2023-06-09T11:12:58.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 shutdown_connections 2023-06-09T11:12:58.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7afc0662f0 0x7f7afc0687a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b10160860 0x7f7b101e59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100d2730 0x7f7b100ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 --2- 172.21.15.78:0/2809256603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b100d2360 0x7f7b100ca030 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 >> 172.21.15.78:0/2809256603 conn(0x7f7b100d1210 msgr2=0x7f7b10070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:58.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 shutdown_connections 2023-06-09T11:12:58.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.699+0000 7f7b15746700 1 -- 172.21.15.78:0/2809256603 wait complete. 2023-06-09T11:12:58.710 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-06-09T11:12:58.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:12:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e91ae4700 1 Processor -- start 2023-06-09T11:12:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e91ae4700 1 -- start start 2023-06-09T11:12:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e91ae4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15a3e0 0x7f9e8c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e91ae4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e8c0ce470 0x7f9e8c06f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e91ae4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0cc8e0 con 0x7f9e8c15df60 2023-06-09T11:12:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e91ae4700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c15a7b0 con 0x7f9e8c0ce470 2023-06-09T11:12:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e91ae4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0ccb80 con 0x7f9e8c15a3e0 2023-06-09T11:12:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e90ae2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15a3e0 0x7f9e8c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e83fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e8c0ce470 0x7f9e8c06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e912e3700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9e8c15df60 0x7f9e8c070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:35006/0 (socket says 172.21.15.78:35006) 2023-06-09T11:12:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e912e3700 1 -- 172.21.15.78:0/4243047896 learned_addr learned my addr 172.21.15.78:0/4243047896 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e83fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e8c0ce470 0x7f9e8c06f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:52634/0 (socket says 172.21.15.78:52634) 2023-06-09T11:12:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e837fe700 1 -- 172.21.15.78:0/4243047896 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085694367 0 0) 0x7f9e8c0cc8e0 con 0x7f9e8c15df60 2023-06-09T11:12:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.895+0000 7f9e837fe700 1 -- 172.21.15.78:0/4243047896 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e740035d0 con 0x7f9e8c15df60 2023-06-09T11:12:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e90ae2700 1 -- 172.21.15.78:0/4243047896 >> v2:172.21.15.187:3300/0 conn(0x7f9e8c0ce470 msgr2=0x7f9e8c06f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e90ae2700 1 --2- 172.21.15.78:0/4243047896 >> v2:172.21.15.187:3300/0 conn(0x7f9e8c0ce470 0x7f9e8c06f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e90ae2700 1 -- 172.21.15.78:0/4243047896 >> v1:172.21.15.187:6789/0 conn(0x7f9e8c15df60 legacy=0x7f9e8c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e90ae2700 1 -- 172.21.15.78:0/4243047896 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c06b470 con 0x7f9e8c15a3e0 2023-06-09T11:12:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e83fff700 1 --2- 172.21.15.78:0/4243047896 >> v2:172.21.15.187:3300/0 conn(0x7f9e8c0ce470 0x7f9e8c06f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:12:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e90ae2700 1 --2- 172.21.15.78:0/4243047896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15a3e0 0x7f9e8c06e960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009850 tx=0x7f9e88009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bd7fb575238437 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e837fe700 1 -- 172.21.15.78:0/4243047896 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88011830 con 0x7f9e8c15a3e0 2023-06-09T11:12:58.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e837fe700 1 -- 172.21.15.78:0/4243047896 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88011990 con 0x7f9e8c15a3e0 2023-06-09T11:12:58.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e837fe700 1 -- 172.21.15.78:0/4243047896 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88011d40 con 0x7f9e8c15a3e0 2023-06-09T11:12:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 -- 172.21.15.78:0/4243047896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15a3e0 msgr2=0x7f9e8c06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/4243047896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15a3e0 0x7f9e8c06e960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009850 tx=0x7f9e88009b60 comp rx=0 tx=0).stop 2023-06-09T11:12:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 -- 172.21.15.78:0/4243047896 shutdown_connections 2023-06-09T11:12:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/4243047896 >> v2:172.21.15.187:3300/0 conn(0x7f9e8c0ce470 0x7f9e8c06f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/4243047896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15a3e0 0x7f9e8c06e960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 -- 172.21.15.78:0/4243047896 >> 172.21.15.78:0/4243047896 conn(0x7f9e8c0cf670 msgr2=0x7f9e8c0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:58.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 -- 172.21.15.78:0/4243047896 shutdown_connections 2023-06-09T11:12:58.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.899+0000 7f9e91ae4700 1 -- 172.21.15.78:0/4243047896 wait complete. 2023-06-09T11:12:58.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 Processor -- start 2023-06-09T11:12:58.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 -- start start 2023-06-09T11:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c0ce470 0x7f9e8c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e8c15a3e0 0x7f9e8c0b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15df60 0x7f9e8c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c15b300 con 0x7f9e8c0ce470 2023-06-09T11:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c15be80 con 0x7f9e8c15a3e0 2023-06-09T11:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c14f1b0 con 0x7f9e8c15df60 2023-06-09T11:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c0ce470 0x7f9e8c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c0ce470 0x7f9e8c14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38160/0 (socket says 172.21.15.78:38160) 2023-06-09T11:12:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 -- 172.21.15.78:0/599624409 learned_addr learned my addr 172.21.15.78:0/599624409 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e912e3700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15df60 0x7f9e8c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e83fff700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e8c15a3e0 0x7f9e8c0b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 -- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15df60 msgr2=0x7f9e8c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15df60 0x7f9e8c15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 -- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e8c15a3e0 msgr2=0x7f9e8c0b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e8c15a3e0 0x7f9e8c0b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 -- 172.21.15.78:0/599624409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0094b0 con 0x7f9e8c0ce470 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e90ae2700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c0ce470 0x7f9e8c14ec70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0cccc0 tx=0x7f9e88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e817fa700 1 -- 172.21.15.78:0/599624409 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88004480 con 0x7f9e8c0ce470 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e817fa700 1 -- 172.21.15.78:0/599624409 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8801f070 con 0x7f9e8c0ce470 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e817fa700 1 -- 172.21.15.78:0/599624409 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880038e0 con 0x7f9e8c0ce470 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e880094b0 con 0x7f9e8c0ce470 2023-06-09T11:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.903+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c15e3e0 con 0x7f9e8c0ce470 2023-06-09T11:12:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.907+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c06b750 con 0x7f9e8c0ce470 2023-06-09T11:12:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.907+0000 7f9e817fa700 1 -- 172.21.15.78:0/599624409 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e88021030 con 0x7f9e8c0ce470 2023-06-09T11:12:58.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.911+0000 7f9e817fa700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9e780662f0 0x7f9e780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:58.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.911+0000 7f9e817fa700 1 -- 172.21.15.78:0/599624409 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9e880850b0 con 0x7f9e8c0ce470 2023-06-09T11:12:58.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.911+0000 7f9e83fff700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9e780662f0 0x7f9e780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:58.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.911+0000 7f9e83fff700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9e780662f0 0x7f9e780687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0afa20 tx=0x7f9e7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:58.919+0000 7f9e817fa700 1 -- 172.21.15.78:0/599624409 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9e88052590 con 0x7f9e8c0ce470 2023-06-09T11:12:59.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.091+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e8c15e570 con 0x7f9e8c0ce470 2023-06-09T11:12:59.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.095+0000 7f9e817fa700 1 -- 172.21.15.78:0/599624409 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f9e88006ce0 con 0x7f9e8c0ce470 2023-06-09T11:12:59.103 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:12:59.104 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:12:49.372533+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:12:06.883642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T11:12:07.709423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:12:59.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9e780662f0 msgr2=0x7f9e780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:59.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9e780662f0 0x7f9e780687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0afa20 tx=0x7f9e7c008040 comp rx=0 tx=0).stop 2023-06-09T11:12:59.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c0ce470 msgr2=0x7f9e8c14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:59.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c0ce470 0x7f9e8c14ec70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0cccc0 tx=0x7f9e88004770 comp rx=0 tx=0).stop 2023-06-09T11:12:59.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 shutdown_connections 2023-06-09T11:12:59.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f9e780662f0 0x7f9e780687a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e8c15df60 0x7f9e8c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e8c15a3e0 0x7f9e8c0b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 --2- 172.21.15.78:0/599624409 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e8c0ce470 0x7f9e8c14ec70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 >> 172.21.15.78:0/599624409 conn(0x7f9e8c0cf670 msgr2=0x7f9e8c1552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:59.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 shutdown_connections 2023-06-09T11:12:59.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.099+0000 7f9e91ae4700 1 -- 172.21.15.78:0/599624409 wait complete. 2023-06-09T11:12:59.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-09T11:12:59.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.295+0000 7f2413ea3700 1 Processor -- start 2023-06-09T11:12:59.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.295+0000 7f2413ea3700 1 -- start start 2023-06-09T11:12:59.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2413ea3700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f240c15a6a0 0x7f240c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:59.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2413ea3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f240c0b5170 0x7f240c0b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:59.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2413ea3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0cf860 con 0x7f240c0b2940 2023-06-09T11:12:59.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2413ea3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0cbdb0 con 0x7f240c0b5170 2023-06-09T11:12:59.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2413ea3700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0b3d10 con 0x7f240c15a6a0 2023-06-09T11:12:59.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f241143e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f240c0b2940 0x7f240c06f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43618/0 (socket says 172.21.15.78:43618) 2023-06-09T11:12:59.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2412440700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f240c0b5170 0x7f240c0b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:59.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f241143e700 1 -- 172.21.15.78:0/949370960 learned_addr learned my addr 172.21.15.78:0/949370960 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:12:59.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2411c3f700 1 --2- 172.21.15.78:0/949370960 >> v2:172.21.15.187:3300/0 conn(0x7f240c15a6a0 0x7f240c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:59.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2412440700 1 -- 172.21.15.78:0/949370960 >> v2:172.21.15.187:3300/0 conn(0x7f240c15a6a0 msgr2=0x7f240c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:12:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2412440700 1 --2- 172.21.15.78:0/949370960 >> v2:172.21.15.187:3300/0 conn(0x7f240c15a6a0 0x7f240c0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2412440700 1 -- 172.21.15.78:0/949370960 >> v1:172.21.15.78:6789/0 conn(0x7f240c0b2940 legacy=0x7f240c06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2412440700 1 -- 172.21.15.78:0/949370960 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0cb510 con 0x7f240c0b5170 2023-06-09T11:12:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2410c3d700 1 -- 172.21.15.78:0/949370960 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906595532 0 0) 0x7f240c0cf860 con 0x7f240c0b2940 2023-06-09T11:12:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2412440700 1 --2- 172.21.15.78:0/949370960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c0b2dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f240c06d730 tx=0x7f240400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67838ba83cb41e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2410c3d700 1 -- 172.21.15.78:0/949370960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400e070 con 0x7f240c0b5170 2023-06-09T11:12:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2410c3d700 1 -- 172.21.15.78:0/949370960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240400bb20 con 0x7f240c0b5170 2023-06-09T11:12:59.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.299+0000 7f2410c3d700 1 -- 172.21.15.78:0/949370960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404012430 con 0x7f240c0b5170 2023-06-09T11:12:59.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 -- 172.21.15.78:0/949370960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 msgr2=0x7f240c0b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:59.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 --2- 172.21.15.78:0/949370960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c0b2dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f240c06d730 tx=0x7f240400b330 comp rx=0 tx=0).stop 2023-06-09T11:12:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 -- 172.21.15.78:0/949370960 shutdown_connections 2023-06-09T11:12:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 --2- 172.21.15.78:0/949370960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c0b2dc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 --2- 172.21.15.78:0/949370960 >> v2:172.21.15.187:3300/0 conn(0x7f240c15a6a0 0x7f240c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 -- 172.21.15.78:0/949370960 >> 172.21.15.78:0/949370960 conn(0x7f240c06d300 msgr2=0x7f240c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:12:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 -- 172.21.15.78:0/949370960 shutdown_connections 2023-06-09T11:12:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 -- 172.21.15.78:0/949370960 wait complete. 2023-06-09T11:12:59.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.303+0000 7f2413ea3700 1 Processor -- start 2023-06-09T11:12:59.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 -- start start 2023-06-09T11:12:59.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f240c0b2940 0x7f240c1e3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:59.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:59.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f240c15a6a0 0x7f240c15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:59.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0caef0 con 0x7f240c0b5170 2023-06-09T11:12:59.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15afb0 con 0x7f240c15a6a0 2023-06-09T11:12:59.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15b250 con 0x7f240c0b2940 2023-06-09T11:12:59.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:59.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c14ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38170/0 (socket says 172.21.15.78:38170) 2023-06-09T11:12:59.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 -- 172.21.15.78:0/2525678205 learned_addr learned my addr 172.21.15.78:0/2525678205 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:12:59.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2411c3f700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f240c0b2940 0x7f240c1e3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:59.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2412440700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f240c15a6a0 0x7f240c15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 -- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f240c0b2940 msgr2=0x7f240c1e3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f240c0b2940 0x7f240c1e3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 -- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f240c15a6a0 msgr2=0x7f240c15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:12:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f240c15a6a0 0x7f240c15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:12:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 -- 172.21.15.78:0/2525678205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404009a70 con 0x7f240c0b5170 2023-06-09T11:12:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2411c3f700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f240c0b2940 0x7f240c1e3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2412440700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f240c15a6a0 0x7f240c15aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:12:59.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f241143e700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c14ff00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00c580 tx=0x7f23fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:59.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f24027fc700 1 -- 172.21.15.78:0/2525678205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc004ca0 con 0x7f240c0b5170 2023-06-09T11:12:59.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f24027fc700 1 -- 172.21.15.78:0/2525678205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc004e00 con 0x7f240c0b5170 2023-06-09T11:12:59.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f24027fc700 1 -- 172.21.15.78:0/2525678205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0072f0 con 0x7f240c0b5170 2023-06-09T11:12:59.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.307+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c0cbad0 con 0x7f240c0b5170 2023-06-09T11:12:59.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.311+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c0cb7f0 con 0x7f240c0b5170 2023-06-09T11:12:59.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.311+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c070b60 con 0x7f240c0b5170 2023-06-09T11:12:59.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.311+0000 7f24027fc700 1 -- 172.21.15.78:0/2525678205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23fc007450 con 0x7f240c0b5170 2023-06-09T11:12:59.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.315+0000 7f24027fc700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23f00662f0 0x7f23f00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:12:59.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.315+0000 7f24027fc700 1 -- 172.21.15.78:0/2525678205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f23fc083ba0 con 0x7f240c0b5170 2023-06-09T11:12:59.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.315+0000 7f2411c3f700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23f00662f0 0x7f23f00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:12:59.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.315+0000 7f2411c3f700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23f00662f0 0x7f23f00687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2408009ba0 tx=0x7f2408008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:12:59.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.319+0000 7f24027fc700 1 -- 172.21.15.78:0/2525678205 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f23fc050f40 con 0x7f240c0b5170 2023-06-09T11:12:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:12:59.527+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f240c158f40 con 0x7f240c0b5170 2023-06-09T11:13:00.467 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-06-09T11:13:00.459+0000 7f67899f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-09T11:13:00.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.471+0000 7f24027fc700 1 -- 172.21.15.78:0/2525678205 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f23fc054560 con 0x7f240c0b5170 2023-06-09T11:13:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23f00662f0 msgr2=0x7f23f00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23f00662f0 0x7f23f00687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2408009ba0 tx=0x7f2408008040 comp rx=0 tx=0).stop 2023-06-09T11:13:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 msgr2=0x7f240c14ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:00.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c14ff00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00c580 tx=0x7f23fc00c940 comp rx=0 tx=0).stop 2023-06-09T11:13:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 shutdown_connections 2023-06-09T11:13:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f23f00662f0 0x7f23f00687a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f240c15a6a0 0x7f240c15aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f240c0b5170 0x7f240c14ff00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 --2- 172.21.15.78:0/2525678205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f240c0b2940 0x7f240c1e3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 >> 172.21.15.78:0/2525678205 conn(0x7f240c06d300 msgr2=0x7f240c06f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:00.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 shutdown_connections 2023-06-09T11:13:00.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.475+0000 7f2413ea3700 1 -- 172.21.15.78:0/2525678205 wait complete. 2023-06-09T11:13:00.486 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-09T11:13:00.495 INFO:tasks.ceph.mds.b.smithi187.stderr: -6733> 2023-06-09T11:12:14.374+0000 7f55696af700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T11:13:00.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-09T11:13:00.556 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-06-09T11:13:00.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.671+0000 7fe8ed206700 1 Processor -- start 2023-06-09T11:13:00.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.671+0000 7fe8ed206700 1 -- start start 2023-06-09T11:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8ed206700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8e80ade90 0x7fe8e806ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8ed206700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe8e80ce5b0 0x7fe8e806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8ed206700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80cd5e0 con 0x7fe8e815a490 2023-06-09T11:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8ed206700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e8069ed0 con 0x7fe8e80ade90 2023-06-09T11:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8ed206700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e815a860 con 0x7fe8e80ce5b0 2023-06-09T11:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8df7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe8e80ade90 0x7fe8e806ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8e7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe8e815a490 0x7fe8e806d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43622/0 (socket says 172.21.15.78:43622) 2023-06-09T11:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8e7fff700 1 -- 172.21.15.78:0/3121472037 learned_addr learned my addr 172.21.15.78:0/3121472037 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:00.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8df7fe700 1 -- 172.21.15.78:0/3121472037 >> v2:172.21.15.187:3300/0 conn(0x7fe8e80ce5b0 msgr2=0x7fe8e806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:00.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8eca05700 1 --2- 172.21.15.78:0/3121472037 >> v2:172.21.15.187:3300/0 conn(0x7fe8e80ce5b0 0x7fe8e806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:00.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8df7fe700 1 --2- 172.21.15.78:0/3121472037 >> v2:172.21.15.187:3300/0 conn(0x7fe8e80ce5b0 0x7fe8e806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8df7fe700 1 -- 172.21.15.78:0/3121472037 >> v1:172.21.15.78:6789/0 conn(0x7fe8e815a490 legacy=0x7fe8e806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:00.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8df7fe700 1 -- 172.21.15.78:0/3121472037 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80cd810 con 0x7fe8e80ade90 2023-06-09T11:13:00.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8eca05700 1 --2- 172.21.15.78:0/3121472037 >> v2:172.21.15.187:3300/0 conn(0x7fe8e80ce5b0 0x7fe8e806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:00.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8df7fe700 1 --2- 172.21.15.78:0/3121472037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e806ab90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80b3e50 tx=0x7fe8d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcac7b074ce7360 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:00.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8e77fe700 1 -- 172.21.15.78:0/3121472037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000e070 con 0x7fe8e80ade90 2023-06-09T11:13:00.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8e77fe700 1 -- 172.21.15.78:0/3121472037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d000bbd0 con 0x7fe8e80ade90 2023-06-09T11:13:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.675+0000 7fe8e77fe700 1 -- 172.21.15.78:0/3121472037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0012430 con 0x7fe8e80ade90 2023-06-09T11:13:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 -- 172.21.15.78:0/3121472037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 msgr2=0x7fe8e806ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3121472037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e806ab90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80b3e50 tx=0x7fe8d000b330 comp rx=0 tx=0).stop 2023-06-09T11:13:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 -- 172.21.15.78:0/3121472037 shutdown_connections 2023-06-09T11:13:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3121472037 >> v2:172.21.15.187:3300/0 conn(0x7fe8e80ce5b0 0x7fe8e806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3121472037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e806ab90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 -- 172.21.15.78:0/3121472037 >> 172.21.15.78:0/3121472037 conn(0x7fe8e80b0780 msgr2=0x7fe8e80b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 -- 172.21.15.78:0/3121472037 shutdown_connections 2023-06-09T11:13:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 -- 172.21.15.78:0/3121472037 wait complete. 2023-06-09T11:13:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.679+0000 7fe8ed206700 1 Processor -- start 2023-06-09T11:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 -- start start 2023-06-09T11:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e81567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8e80ce5b0 0x7fe8e81506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8e815a490 0x7fe8e80ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80b2650 con 0x7fe8e80ade90 2023-06-09T11:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8150bf0 con 0x7fe8e815a490 2023-06-09T11:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815cef0 con 0x7fe8e80ce5b0 2023-06-09T11:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e81567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e81567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38192/0 (socket says 172.21.15.78:38192) 2023-06-09T11:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 -- 172.21.15.78:0/3568467506 learned_addr learned my addr 172.21.15.78:0/3568467506 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:00.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8eca05700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8e815a490 0x7fe8e80ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:00.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8df7fe700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8e80ce5b0 0x7fe8e81506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:00.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 -- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8e80ce5b0 msgr2=0x7fe8e81506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8e80ce5b0 0x7fe8e81506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 -- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8e815a490 msgr2=0x7fe8e80ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8e815a490 0x7fe8e80ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 -- 172.21.15.78:0/3568467506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009a70 con 0x7fe8e80ade90 2023-06-09T11:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8eca05700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8e815a490 0x7fe8e80ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e7fff700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e81567c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8001eb0 tx=0x7fe8d800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e57fa700 1 -- 172.21.15.78:0/3568467506 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8005d90 con 0x7fe8e80ade90 2023-06-09T11:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e57fa700 1 -- 172.21.15.78:0/3568467506 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d80070d0 con 0x7fe8e80ade90 2023-06-09T11:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8e57fa700 1 -- 172.21.15.78:0/3568467506 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8007440 con 0x7fe8e80ade90 2023-06-09T11:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.683+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e806a390 con 0x7fe8e80ade90 2023-06-09T11:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.687+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e806a0b0 con 0x7fe8e80ade90 2023-06-09T11:13:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.687+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e806a670 con 0x7fe8e80ade90 2023-06-09T11:13:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.687+0000 7fe8e57fa700 1 -- 172.21.15.78:0/3568467506 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8d80075a0 con 0x7fe8e80ade90 2023-06-09T11:13:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.691+0000 7fe8e57fa700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8c80662f0 0x7fe8c80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.691+0000 7fe8e57fa700 1 -- 172.21.15.78:0/3568467506 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe8d80830f0 con 0x7fe8e80ade90 2023-06-09T11:13:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.691+0000 7fe8df7fe700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8c80662f0 0x7fe8c80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.691+0000 7fe8df7fe700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8c80662f0 0x7fe8c80687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0014040 tx=0x7fe8d0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:00.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.699+0000 7fe8e57fa700 1 -- 172.21.15.78:0/3568467506 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe8d8050620 con 0x7fe8e80ade90 2023-06-09T11:13:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:00.903+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe8e8067610 con 0x7fe8e80ade90 2023-06-09T11:13:01.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.543+0000 7fe8e57fa700 1 -- 172.21.15.78:0/3568467506 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe8d8053c40 con 0x7fe8e80ade90 2023-06-09T11:13:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8c80662f0 msgr2=0x7fe8c80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:01.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8c80662f0 0x7fe8c80687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0014040 tx=0x7fe8d0011000 comp rx=0 tx=0).stop 2023-06-09T11:13:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 msgr2=0x7fe8e81567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e81567c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8001eb0 tx=0x7fe8d800c860 comp rx=0 tx=0).stop 2023-06-09T11:13:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 shutdown_connections 2023-06-09T11:13:01.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe8c80662f0 0x7fe8c80687a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8e815a490 0x7fe8e80ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8e80ce5b0 0x7fe8e81506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 --2- 172.21.15.78:0/3568467506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8e80ade90 0x7fe8e81567c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 >> 172.21.15.78:0/3568467506 conn(0x7fe8e80b0780 msgr2=0x7fe8e80af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 shutdown_connections 2023-06-09T11:13:01.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.547+0000 7fe8ed206700 1 -- 172.21.15.78:0/3568467506 wait complete. 2023-06-09T11:13:01.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-09T11:13:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.751+0000 7f8ac088c700 1 Processor -- start 2023-06-09T11:13:01.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.751+0000 7f8ac088c700 1 -- start start 2023-06-09T11:13:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8ac088c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8abc1428c0 0x7f8abc06a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8ac088c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc06abc0 con 0x7f8abc06edb0 2023-06-09T11:13:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8ac088c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc06ba00 con 0x7f8abc0b6a30 2023-06-09T11:13:01.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8ac088c700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc06adf0 con 0x7f8abc1428c0 2023-06-09T11:13:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abb7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8abc1428c0 0x7f8abc06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abbfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8abc06edb0 0x7f8abc1431f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43636/0 (socket says 172.21.15.78:43636) 2023-06-09T11:13:01.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abbfff700 1 -- 172.21.15.78:0/27370031 learned_addr learned my addr 172.21.15.78:0/27370031 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:01.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abaffd700 1 -- 172.21.15.78:0/27370031 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398800759 0 0) 0x7f8abc06abc0 con 0x7f8abc06edb0 2023-06-09T11:13:01.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abaffd700 1 -- 172.21.15.78:0/27370031 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa80035d0 con 0x7f8abc06edb0 2023-06-09T11:13:01.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abb7fe700 1 -- 172.21.15.78:0/27370031 >> v1:172.21.15.187:6789/0 conn(0x7f8abc0b6a30 legacy=0x7f8abc06e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:01.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abb7fe700 1 -- 172.21.15.78:0/27370031 >> v1:172.21.15.78:6789/0 conn(0x7f8abc06edb0 legacy=0x7f8abc1431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:01.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abb7fe700 1 -- 172.21.15.78:0/27370031 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc06b0d0 con 0x7f8abc1428c0 2023-06-09T11:13:01.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abb7fe700 1 --2- 172.21.15.78:0/27370031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc1428c0 0x7f8abc06a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009850 tx=0x7f8aac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee30a0c9bc7fd48 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:01.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.755+0000 7f8abaffd700 1 -- 172.21.15.78:0/27370031 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac011830 con 0x7f8abc1428c0 2023-06-09T11:13:01.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8abaffd700 1 -- 172.21.15.78:0/27370031 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac011990 con 0x7f8abc1428c0 2023-06-09T11:13:01.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8abaffd700 1 -- 172.21.15.78:0/27370031 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac011d40 con 0x7f8abc1428c0 2023-06-09T11:13:01.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 -- 172.21.15.78:0/27370031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc1428c0 msgr2=0x7f8abc06a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:01.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 --2- 172.21.15.78:0/27370031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc1428c0 0x7f8abc06a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009850 tx=0x7f8aac009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:01.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 -- 172.21.15.78:0/27370031 shutdown_connections 2023-06-09T11:13:01.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 --2- 172.21.15.78:0/27370031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc1428c0 0x7f8abc06a680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:01.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 -- 172.21.15.78:0/27370031 >> 172.21.15.78:0/27370031 conn(0x7f8abc0b57d0 msgr2=0x7f8abc0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:01.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 -- 172.21.15.78:0/27370031 shutdown_connections 2023-06-09T11:13:01.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 -- 172.21.15.78:0/27370031 wait complete. 2023-06-09T11:13:01.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.759+0000 7f8ac088c700 1 Processor -- start 2023-06-09T11:13:01.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 -- start start 2023-06-09T11:13:01.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc06edb0 0x7f8abc1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:01.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc0b6a30 0x7f8abc15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:01.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8abc1428c0 0x7f8abc15e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:01.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc156720 con 0x7f8abc06edb0 2023-06-09T11:13:01.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1f1f20 con 0x7f8abc0b6a30 2023-06-09T11:13:01.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1f21c0 con 0x7f8abc1428c0 2023-06-09T11:13:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc06edb0 0x7f8abc1561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc06edb0 0x7f8abc1561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38200/0 (socket says 172.21.15.78:38200) 2023-06-09T11:13:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 -- 172.21.15.78:0/674774660 learned_addr learned my addr 172.21.15.78:0/674774660 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ab2ffd700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc0b6a30 0x7f8abc15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abbfff700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8abc1428c0 0x7f8abc15e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:01.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 -- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8abc1428c0 msgr2=0x7f8abc15e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8abc1428c0 0x7f8abc15e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 -- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc0b6a30 msgr2=0x7f8abc15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc0b6a30 0x7f8abc15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 -- 172.21.15.78:0/674774660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0094b0 con 0x7f8abc06edb0 2023-06-09T11:13:01.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8abb7fe700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc06edb0 0x7f8abc1561e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8aac014040 tx=0x7f8aac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ab8ff9700 1 -- 172.21.15.78:0/674774660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac019980 con 0x7f8abc06edb0 2023-06-09T11:13:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ab8ff9700 1 -- 172.21.15.78:0/674774660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac01e070 con 0x7f8abc06edb0 2023-06-09T11:13:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc06b690 con 0x7f8abc06edb0 2023-06-09T11:13:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ab8ff9700 1 -- 172.21.15.78:0/674774660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac019d20 con 0x7f8abc06edb0 2023-06-09T11:13:01.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.763+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc06b3b0 con 0x7f8abc06edb0 2023-06-09T11:13:01.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.767+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc0b6eb0 con 0x7f8abc06edb0 2023-06-09T11:13:01.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.767+0000 7f8ab8ff9700 1 -- 172.21.15.78:0/674774660 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8aac02d430 con 0x7f8abc06edb0 2023-06-09T11:13:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.771+0000 7f8ab8ff9700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a9c066320 0x7f8a9c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.771+0000 7f8ab8ff9700 1 -- 172.21.15.78:0/674774660 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f8aac084cd0 con 0x7f8abc06edb0 2023-06-09T11:13:01.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.771+0000 7f8ab2ffd700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a9c066320 0x7f8a9c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:01.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.771+0000 7f8ab2ffd700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a9c066320 0x7f8a9c0687d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8abc1321f0 tx=0x7f8aa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:01.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.775+0000 7f8ab8ff9700 1 -- 172.21.15.78:0/674774660 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8aac0520b0 con 0x7f8abc06edb0 2023-06-09T11:13:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:01.943+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8abc0741c0 con 0x7f8abc06edb0 2023-06-09T11:13:02.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.551+0000 7f8ab8ff9700 1 -- 172.21.15.78:0/674774660 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8aac0200d0 con 0x7f8abc06edb0 2023-06-09T11:13:02.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a9c066320 msgr2=0x7f8a9c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a9c066320 0x7f8a9c0687d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8abc1321f0 tx=0x7f8aa4009040 comp rx=0 tx=0).stop 2023-06-09T11:13:02.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc06edb0 msgr2=0x7f8abc1561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:02.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc06edb0 0x7f8abc1561e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8aac014040 tx=0x7f8aac004770 comp rx=0 tx=0).stop 2023-06-09T11:13:02.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 shutdown_connections 2023-06-09T11:13:02.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a9c066320 0x7f8a9c0687d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8abc1428c0 0x7f8abc15e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc0b6a30 0x7f8abc15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 --2- 172.21.15.78:0/674774660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc06edb0 0x7f8abc1561e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.555+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 >> 172.21.15.78:0/674774660 conn(0x7f8abc0b57d0 msgr2=0x7f8abc06d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.559+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 shutdown_connections 2023-06-09T11:13:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.559+0000 7f8ac088c700 1 -- 172.21.15.78:0/674774660 wait complete. 2023-06-09T11:13:02.569 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-06-09T11:13:02.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-09T11:13:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.763+0000 7f7f43337700 1 Processor -- start 2023-06-09T11:13:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.763+0000 7f7f43337700 1 -- start start 2023-06-09T11:13:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f43337700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f3c15aa80 0x7f7f3c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:02.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f43337700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:02.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f43337700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c06efc0 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f43337700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c06a000 con 0x7f7f3c15aa80 2023-06-09T11:13:02.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f43337700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c06a2e0 con 0x7f7f3c0ce540 2023-06-09T11:13:02.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42335700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f3c15aa80 0x7f7f3c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:02.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42b36700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:02.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42335700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f3c15aa80 0x7f7f3c06b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:52712/0 (socket says 172.21.15.78:52712) 2023-06-09T11:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42b36700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c15ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:56254/0 (socket says 172.21.15.78:56254) 2023-06-09T11:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42335700 1 -- 172.21.15.78:0/1114195823 learned_addr learned my addr 172.21.15.78:0/1114195823 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42b36700 1 -- 172.21.15.78:0/1114195823 >> v2:172.21.15.187:3300/0 conn(0x7f7f3c15aa80 msgr2=0x7f7f3c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42b36700 1 --2- 172.21.15.78:0/1114195823 >> v2:172.21.15.187:3300/0 conn(0x7f7f3c15aa80 0x7f7f3c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42b36700 1 -- 172.21.15.78:0/1114195823 >> v1:172.21.15.187:6789/0 conn(0x7f7f3c0ce0c0 legacy=0x7f7f3c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.767+0000 7f7f42b36700 1 -- 172.21.15.78:0/1114195823 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c06a5c0 con 0x7f7f3c0ce540 2023-06-09T11:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f42b36700 1 --2- 172.21.15.78:0/1114195823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c15ae50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009850 tx=0x7f7f34009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b9a22125a31bd8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f41333700 1 -- 172.21.15.78:0/1114195823 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34011830 con 0x7f7f3c0ce540 2023-06-09T11:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f41333700 1 -- 172.21.15.78:0/1114195823 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34011990 con 0x7f7f3c0ce540 2023-06-09T11:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f41333700 1 -- 172.21.15.78:0/1114195823 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34011d40 con 0x7f7f3c0ce540 2023-06-09T11:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 -- 172.21.15.78:0/1114195823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 msgr2=0x7f7f3c15ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 --2- 172.21.15.78:0/1114195823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c15ae50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009850 tx=0x7f7f34009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 -- 172.21.15.78:0/1114195823 shutdown_connections 2023-06-09T11:13:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 --2- 172.21.15.78:0/1114195823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c15ae50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 --2- 172.21.15.78:0/1114195823 >> v2:172.21.15.187:3300/0 conn(0x7f7f3c15aa80 0x7f7f3c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 -- 172.21.15.78:0/1114195823 >> 172.21.15.78:0/1114195823 conn(0x7f7f3c0b0780 msgr2=0x7f7f3c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 -- 172.21.15.78:0/1114195823 shutdown_connections 2023-06-09T11:13:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.771+0000 7f7f43337700 1 -- 172.21.15.78:0/1114195823 wait complete. 2023-06-09T11:13:02.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 Processor -- start 2023-06-09T11:13:02.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 -- start start 2023-06-09T11:13:02.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f3c0ce0c0 0x7f7f3c14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3c15aa80 0x7f7f3c0ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c14cfc0 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0ac810 con 0x7f7f3c15aa80 2023-06-09T11:13:02.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f43337700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0acab0 con 0x7f7f3c0ce540 2023-06-09T11:13:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f42335700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f3c0ce0c0 0x7f7f3c14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f42335700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f3c0ce0c0 0x7f7f3c14c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38210/0 (socket says 172.21.15.78:38210) 2023-06-09T11:13:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f42335700 1 -- 172.21.15.78:0/2727780957 learned_addr learned my addr 172.21.15.78:0/2727780957 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f41b34700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:02.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.775+0000 7f7f42b36700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3c15aa80 0x7f7f3c0ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:02.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f42335700 1 -- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 msgr2=0x7f7f3c0adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:02.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f42335700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c0adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f42335700 1 -- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3c15aa80 msgr2=0x7f7f3c0ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:02.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f42335700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3c15aa80 0x7f7f3c0ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:02.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f42335700 1 -- 172.21.15.78:0/2727780957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340094b0 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f42335700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f3c0ce0c0 0x7f7f3c14c700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800efc0 tx=0x7f7f3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f32ffd700 1 -- 172.21.15.78:0/2727780957 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800cb00 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f32ffd700 1 -- 172.21.15.78:0/2727780957 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3800f040 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c06ab80 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f32ffd700 1 -- 172.21.15.78:0/2727780957 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800ce60 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c06a8a0 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.779+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c0709a0 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.783+0000 7f7f32ffd700 1 -- 172.21.15.78:0/2727780957 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f38014480 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.783+0000 7f7f32ffd700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f200662f0 0x7f7f200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:02.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.783+0000 7f7f32ffd700 1 -- 172.21.15.78:0/2727780957 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f7f38084160 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.783+0000 7f7f41b34700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f200662f0 0x7f7f200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:02.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.787+0000 7f7f41b34700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f200662f0 0x7f7f200687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0ae440 tx=0x7f7f2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:02.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.791+0000 7f7f32ffd700 1 -- 172.21.15.78:0/2727780957 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7f380516f0 con 0x7f7f3c0ce0c0 2023-06-09T11:13:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:02.963+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f3c14d230 con 0x7f7f3c0ce0c0 2023-06-09T11:13:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.559+0000 7f7f32ffd700 1 -- 172.21.15.78:0/2727780957 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7f38009e60 con 0x7f7f3c0ce0c0 2023-06-09T11:13:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.563+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f200662f0 msgr2=0x7f7f200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.563+0000 7f7f43337700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f200662f0 0x7f7f200687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0ae440 tx=0x7f7f2c009040 comp rx=0 tx=0).stop 2023-06-09T11:13:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.563+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f3c0ce0c0 msgr2=0x7f7f3c14c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:03.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.563+0000 7f7f43337700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f3c0ce0c0 0x7f7f3c14c700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800efc0 tx=0x7f7f3800c3a0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 shutdown_connections 2023-06-09T11:13:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f200662f0 0x7f7f200687a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3c15aa80 0x7f7f3c0ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f3c0ce540 0x7f7f3c0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 --2- 172.21.15.78:0/2727780957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f3c0ce0c0 0x7f7f3c14c700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 >> 172.21.15.78:0/2727780957 conn(0x7f7f3c0b0780 msgr2=0x7f7f3c15ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 shutdown_connections 2023-06-09T11:13:03.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.567+0000 7f7f43337700 1 -- 172.21.15.78:0/2727780957 wait complete. 2023-06-09T11:13:03.576 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-06-09T11:13:03.596 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T11:13:03.596 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-09T11:13:03.596 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-09T11:13:03.596 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T11:13:03.597 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T11:13:03.597 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-09T11:13:03.597 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-09T11:13:03.597 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T11:13:03.598 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T11:13:03.598 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-09T11:13:03.598 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-09T11:13:03.598 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T11:13:03.599 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T11:13:03.599 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-09T11:13:03.600 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-09T11:13:03.600 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T11:13:03.616 INFO:tasks.ceph.mds.a:Stopped 2023-06-09T11:13:03.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T11:13:03.620 INFO:tasks.ceph.mds.c:Stopped 2023-06-09T11:13:03.620 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T11:13:03.625 INFO:tasks.ceph.mds.b:Stopped 2023-06-09T11:13:03.625 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T11:13:03.626 INFO:tasks.ceph.mds.d:Stopped 2023-06-09T11:13:03.626 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T11:13:03.668 INFO:tasks.ceph.mds.a:Started 2023-06-09T11:13:03.669 DEBUG:teuthology.parallel:result is None 2023-06-09T11:13:03.673 INFO:tasks.ceph.mds.b:Started 2023-06-09T11:13:03.674 DEBUG:teuthology.parallel:result is None 2023-06-09T11:13:03.674 INFO:tasks.ceph.mds.c:Started 2023-06-09T11:13:03.675 DEBUG:teuthology.parallel:result is None 2023-06-09T11:13:03.675 INFO:tasks.ceph.mds.d:Started 2023-06-09T11:13:03.676 DEBUG:teuthology.parallel:result is None 2023-06-09T11:13:03.676 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-09T11:13:03.795 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-06-09T11:13:03.797 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-06-09T11:13:03.797 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-06-09T11:13:03.798 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-06-09T11:13:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.851+0000 7fc03ca76700 1 Processor -- start 2023-06-09T11:13:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc03ca76700 1 -- start start 2023-06-09T11:13:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc03ca76700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc03815a3e0 0x7fc03806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc03ca76700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0380cc8e0 con 0x7fc0380ce470 2023-06-09T11:13:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc03ca76700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03815a7b0 con 0x7fc03815e670 2023-06-09T11:13:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc03ca76700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0380ccb80 con 0x7fc03815a3e0 2023-06-09T11:13:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0377fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc03815a3e0 0x7fc03806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0377fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc03815a3e0 0x7fc03806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:52748/0 (socket says 172.21.15.78:52748) 2023-06-09T11:13:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0377fe700 1 -- 172.21.15.78:0/3246124833 learned_addr learned my addr 172.21.15.78:0/3246124833 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc036ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc0380ce470 0x7fc03815df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43656/0 (socket says 172.21.15.78:43656) 2023-06-09T11:13:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0377fe700 1 -- 172.21.15.78:0/3246124833 >> v1:172.21.15.187:6789/0 conn(0x7fc03815e670 legacy=0x7fc038070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0377fe700 1 -- 172.21.15.78:0/3246124833 >> v1:172.21.15.78:6789/0 conn(0x7fc0380ce470 legacy=0x7fc03815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0377fe700 1 -- 172.21.15.78:0/3246124833 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03806b470 con 0x7fc03815a3e0 2023-06-09T11:13:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0367fc700 1 -- 172.21.15.78:0/3246124833 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204624122 0 0) 0x7fc0380cc8e0 con 0x7fc0380ce470 2023-06-09T11:13:03.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.855+0000 7fc0377fe700 1 --2- 172.21.15.78:0/3246124833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc03815a3e0 0x7fc03806e960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc028009910 tx=0x7fc028009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac24625c60dc8201 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc0367fc700 1 -- 172.21.15.78:0/3246124833 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800ba60 con 0x7fc03815a3e0 2023-06-09T11:13:03.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc0367fc700 1 -- 172.21.15.78:0/3246124833 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800bbc0 con 0x7fc03815a3e0 2023-06-09T11:13:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc0367fc700 1 -- 172.21.15.78:0/3246124833 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028009e60 con 0x7fc03815a3e0 2023-06-09T11:13:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc03ca76700 1 -- 172.21.15.78:0/3246124833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc03815a3e0 msgr2=0x7fc03806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc03ca76700 1 --2- 172.21.15.78:0/3246124833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc03815a3e0 0x7fc03806e960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc028009910 tx=0x7fc028009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc03ca76700 1 -- 172.21.15.78:0/3246124833 shutdown_connections 2023-06-09T11:13:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc03ca76700 1 --2- 172.21.15.78:0/3246124833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc03815a3e0 0x7fc03806e960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc03ca76700 1 -- 172.21.15.78:0/3246124833 >> 172.21.15.78:0/3246124833 conn(0x7fc0380cf670 msgr2=0x7fc0380cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:03.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc03ca76700 1 -- 172.21.15.78:0/3246124833 shutdown_connections 2023-06-09T11:13:03.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.859+0000 7fc03ca76700 1 -- 172.21.15.78:0/3246124833 wait complete. 2023-06-09T11:13:03.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 Processor -- start 2023-06-09T11:13:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 -- start start 2023-06-09T11:13:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0380ce470 0x7fc0380b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03815a3e0 0x7fc0381432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc03815e670 0x7fc0381581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380b0ff0 con 0x7fc03815a3e0 2023-06-09T11:13:03.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380aefe0 con 0x7fc0380ce470 2023-06-09T11:13:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380af2c0 con 0x7fc03815e670 2023-06-09T11:13:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03815a3e0 0x7fc0381432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03815a3e0 0x7fc0381432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38252/0 (socket says 172.21.15.78:38252) 2023-06-09T11:13:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 -- 172.21.15.78:0/123367493 learned_addr learned my addr 172.21.15.78:0/123367493 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc0377fe700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0380ce470 0x7fc0380b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc037fff700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc03815e670 0x7fc0381581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 -- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc03815e670 msgr2=0x7fc0381581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc03815e670 0x7fc0381581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 -- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0380ce470 msgr2=0x7fc0380b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0380ce470 0x7fc0380b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:03.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 -- 172.21.15.78:0/123367493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028009570 con 0x7fc03815a3e0 2023-06-09T11:13:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc0377fe700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0380ce470 0x7fc0380b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc036ffd700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03815a3e0 0x7fc0381432b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c550 tx=0x7fc02c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc01ffff700 1 -- 172.21.15.78:0/123367493 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c004ca0 con 0x7fc03815a3e0 2023-06-09T11:13:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03806f090 con 0x7fc03815a3e0 2023-06-09T11:13:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc01ffff700 1 -- 172.21.15.78:0/123367493 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c004e00 con 0x7fc03815a3e0 2023-06-09T11:13:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.863+0000 7fc01ffff700 1 -- 172.21.15.78:0/123367493 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c007310 con 0x7fc03815a3e0 2023-06-09T11:13:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03806b750 con 0x7fc03815a3e0 2023-06-09T11:13:03.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03806f220 con 0x7fc03815a3e0 2023-06-09T11:13:03.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.867+0000 7fc01ffff700 1 -- 172.21.15.78:0/123367493 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc02c007470 con 0x7fc03815a3e0 2023-06-09T11:13:03.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.871+0000 7fc01ffff700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc0240662f0 0x7fc0240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:03.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.871+0000 7fc01ffff700 1 -- 172.21.15.78:0/123367493 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc02c083750 con 0x7fc03815a3e0 2023-06-09T11:13:03.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.871+0000 7fc0377fe700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc0240662f0 0x7fc0240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:03.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.871+0000 7fc0377fe700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc0240662f0 0x7fc0240687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc028006f80 tx=0x7fc028008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:03.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:03.875+0000 7fc01ffff700 1 -- 172.21.15.78:0/123367493 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc02c050ee0 con 0x7fc03815a3e0 2023-06-09T11:13:04.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.075+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc0380741c0 con 0x7fc03815a3e0 2023-06-09T11:13:04.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.863+0000 7fc01ffff700 1 -- 172.21.15.78:0/123367493 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc02c007720 con 0x7fc03815a3e0 2023-06-09T11:13:04.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc0240662f0 msgr2=0x7fc0240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:04.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc0240662f0 0x7fc0240687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc028006f80 tx=0x7fc028008030 comp rx=0 tx=0).stop 2023-06-09T11:13:04.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03815a3e0 msgr2=0x7fc0381432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:04.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03815a3e0 0x7fc0381432b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00c550 tx=0x7fc02c00c910 comp rx=0 tx=0).stop 2023-06-09T11:13:04.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 shutdown_connections 2023-06-09T11:13:04.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc0240662f0 0x7fc0240687a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:04.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc03815e670 0x7fc0381581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:04.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc03815a3e0 0x7fc0381432b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:04.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 --2- 172.21.15.78:0/123367493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0380ce470 0x7fc0380b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:04.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 >> 172.21.15.78:0/123367493 conn(0x7fc0380cf670 msgr2=0x7fc0380c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:04.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 shutdown_connections 2023-06-09T11:13:04.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:04.867+0000 7fc03ca76700 1 -- 172.21.15.78:0/123367493 wait complete. 2023-06-09T11:13:04.878 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-06-09T11:13:04.900 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-09T11:13:05.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d759e700 1 Processor -- start 2023-06-09T11:13:05.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d759e700 1 -- start start 2023-06-09T11:13:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01d8160940 0x7f01d80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d806f2a0 0x7f01d81644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d759e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d80adb00 con 0x7f01d806f880 2023-06-09T11:13:05.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d81653a0 con 0x7f01d8160940 2023-06-09T11:13:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d806ba70 con 0x7f01d806f2a0 2023-06-09T11:13:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01d8160940 0x7f01d80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.067+0000 7f01d6d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f01d806f880 0x7f01d806dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52040/0 (socket says 172.21.15.78:52040) 2023-06-09T11:13:05.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d6d9d700 1 -- 172.21.15.78:0/3604715232 learned_addr learned my addr 172.21.15.78:0/3604715232 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01cdd9b700 1 --2- 172.21.15.78:0/3604715232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d806f2a0 0x7f01d81644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d659c700 1 -- 172.21.15.78:0/3604715232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d806f2a0 msgr2=0x7f01d81644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d659c700 1 --2- 172.21.15.78:0/3604715232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d806f2a0 0x7f01d81644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d659c700 1 -- 172.21.15.78:0/3604715232 >> v1:172.21.15.78:6789/0 conn(0x7f01d806f880 legacy=0x7f01d806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d659c700 1 -- 172.21.15.78:0/3604715232 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80ccb10 con 0x7f01d8160940 2023-06-09T11:13:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d5d9b700 1 -- 172.21.15.78:0/3604715232 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606921358 0 0) 0x7f01d80adb00 con 0x7f01d806f880 2023-06-09T11:13:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d659c700 1 --2- 172.21.15.78:0/3604715232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d8160940 0x7f01d80ce4a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009850 tx=0x7f01c8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d5c931c1c3320d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:05.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d5d9b700 1 -- 172.21.15.78:0/3604715232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8011830 con 0x7f01d8160940 2023-06-09T11:13:05.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d5d9b700 1 -- 172.21.15.78:0/3604715232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8011990 con 0x7f01d8160940 2023-06-09T11:13:05.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d5d9b700 1 -- 172.21.15.78:0/3604715232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8011d40 con 0x7f01d8160940 2023-06-09T11:13:05.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 -- 172.21.15.78:0/3604715232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d8160940 msgr2=0x7f01d80ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 --2- 172.21.15.78:0/3604715232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d8160940 0x7f01d80ce4a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009850 tx=0x7f01c8009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 -- 172.21.15.78:0/3604715232 shutdown_connections 2023-06-09T11:13:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 --2- 172.21.15.78:0/3604715232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d806f2a0 0x7f01d81644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 --2- 172.21.15.78:0/3604715232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d8160940 0x7f01d80ce4a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 -- 172.21.15.78:0/3604715232 >> 172.21.15.78:0/3604715232 conn(0x7f01d80cf670 msgr2=0x7f01d80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 -- 172.21.15.78:0/3604715232 shutdown_connections 2023-06-09T11:13:05.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.071+0000 7f01d759e700 1 -- 172.21.15.78:0/3604715232 wait complete. 2023-06-09T11:13:05.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 Processor -- start 2023-06-09T11:13:05.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 -- start start 2023-06-09T11:13:05.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d806f2a0 0x7f01d81f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01d806f880 0x7f01d8162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d8160940 0x7f01d81634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80b44c0 con 0x7f01d806f2a0 2023-06-09T11:13:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8158b20 con 0x7f01d806f880 2023-06-09T11:13:05.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.075+0000 7f01d759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8158d70 con 0x7f01d8160940 2023-06-09T11:13:05.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d806f2a0 0x7f01d81f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d806f2a0 0x7f01d81f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38492/0 (socket says 172.21.15.78:38492) 2023-06-09T11:13:05.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 -- 172.21.15.78:0/2840347793 learned_addr learned my addr 172.21.15.78:0/2840347793 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d6d9d700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d8160940 0x7f01d81634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01cdd9b700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01d806f880 0x7f01d8162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 -- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d8160940 msgr2=0x7f01d81634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d8160940 0x7f01d81634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 -- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01d806f880 msgr2=0x7f01d8162fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01d806f880 0x7f01d8162fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 -- 172.21.15.78:0/2840347793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c80094b0 con 0x7f01d806f2a0 2023-06-09T11:13:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d6d9d700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d8160940 0x7f01d81634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d659c700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d806f2a0 0x7f01d81f5ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01c8014040 tx=0x7f01c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:05.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01cf7fe700 1 -- 172.21.15.78:0/2840347793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8019ab0 con 0x7f01d806f2a0 2023-06-09T11:13:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01cf7fe700 1 -- 172.21.15.78:0/2840347793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c801e070 con 0x7f01d806f2a0 2023-06-09T11:13:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01cf7fe700 1 -- 172.21.15.78:0/2840347793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8019e50 con 0x7f01d806f2a0 2023-06-09T11:13:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d81650c0 con 0x7f01d806f2a0 2023-06-09T11:13:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.079+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d80add50 con 0x7f01d806f2a0 2023-06-09T11:13:05.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.083+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8161d20 con 0x7f01d806f2a0 2023-06-09T11:13:05.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.083+0000 7f01cf7fe700 1 -- 172.21.15.78:0/2840347793 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01c802d450 con 0x7f01d806f2a0 2023-06-09T11:13:05.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.083+0000 7f01cf7fe700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f01b80662f0 0x7f01b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.083+0000 7f01cf7fe700 1 -- 172.21.15.78:0/2840347793 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f01c8084ae0 con 0x7f01d806f2a0 2023-06-09T11:13:05.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.083+0000 7f01cdd9b700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f01b80662f0 0x7f01b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.087+0000 7f01cdd9b700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f01b80662f0 0x7f01b80687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01d81f98b0 tx=0x7f01c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:05.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.091+0000 7f01cf7fe700 1 -- 172.21.15.78:0/2840347793 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f01c8052220 con 0x7f01d806f2a0 2023-06-09T11:13:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.323+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f01d80741c0 con 0x7f01d806f2a0 2023-06-09T11:13:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.327+0000 7f01cf7fe700 1 -- 172.21.15.78:0/2840347793 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f01c8020090 con 0x7f01d806f2a0 2023-06-09T11:13:05.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:05.334 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T11:13:05.335 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-06-09T11:13:05.335 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.335 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-06-09T11:13:05.335 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDCCINkzS9VKRAAt4Bku4DtHWThoDQIHCViag==", 2023-06-09T11:13:05.335 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.335 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-06-09T11:13:05.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-06-09T11:13:05.336 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.336 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.336 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.336 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.337 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-06-09T11:13:05.337 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDDCINkNNnuABAAQgx5xb5v4s1u+ESTEAYvNA==", 2023-06-09T11:13:05.337 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.337 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.337 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-06-09T11:13:05.337 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-06-09T11:13:05.338 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.338 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.338 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.338 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.338 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-06-09T11:13:05.338 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDCCINkJOBNNBAAg+ZsKgRe+KNSoCtJJ7atsQ==", 2023-06-09T11:13:05.339 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.339 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.339 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-06-09T11:13:05.339 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-06-09T11:13:05.339 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.339 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.340 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.340 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.340 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-06-09T11:13:05.340 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDDCINktpKtCxAA6yEGMsTCCpG6PDBODhGDog==", 2023-06-09T11:13:05.340 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.340 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-06-09T11:13:05.341 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDGCINkoAd0NhAAZK3AQPRgux4V3wXwtw4mLw==", 2023-06-09T11:13:05.342 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.342 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.342 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.342 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDKCINkLfYuFxAA1RiDeA2lJbaLgC6ujPOhYw==", 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.343 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.344 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.344 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.344 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.344 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.344 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-06-09T11:13:05.344 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDNCINkX4m1JBAANqOrYRikkt/g1dvgbK1zew==", 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.345 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-06-09T11:13:05.346 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDQCINkqMHmMhAADiVj1QQiexIlG/oI0lv4OA==", 2023-06-09T11:13:05.346 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.346 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.346 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.346 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.346 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.347 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.347 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.347 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-06-09T11:13:05.347 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDXCINkIHW8IhAA4I1xPwaBL0+ycD6+ZFf+uQ==", 2023-06-09T11:13:05.347 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.347 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.347 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.348 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.348 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.348 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.348 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.348 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-06-09T11:13:05.348 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDaCINkI8/gMBAAWv8ahOFYW2ii8++mNlTJkw==", 2023-06-09T11:13:05.348 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-06-09T11:13:05.349 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDeCINk1TzRAhAA5HJEj3YkZ8NSnW1Oz9E6ug==", 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.350 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-06-09T11:13:05.351 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDhCINkohpOEBAAKwyp7oYRSVSu/YOb60KG8Q==", 2023-06-09T11:13:05.351 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.351 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-06-09T11:13:05.351 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-06-09T11:13:05.351 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.351 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.351 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.352 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.352 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-06-09T11:13:05.352 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDDCINkLbj/EhAAlbgZ9OqO1RLR8Gbm9TvHDw==", 2023-06-09T11:13:05.352 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.352 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.352 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-06-09T11:13:05.353 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-06-09T11:13:05.353 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-06-09T11:13:05.353 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.353 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.353 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.353 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDDCINkSOwVHxAAsI+GS1SmhUCYwyTfDNSiqA==", 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.354 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDDCINkotUUGRAA5/JE0VY5wxUaIvZ0/ohqDg==", 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-06-09T11:13:05.355 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-06-09T11:13:05.356 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.356 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.356 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.356 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-06-09T11:13:05.356 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDDCINkuJMeJRAA42MZyFPQo096ITv2Gn2hYQ==", 2023-06-09T11:13:05.356 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.356 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-06-09T11:13:05.357 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g==", 2023-06-09T11:13:05.358 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.358 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-06-09T11:13:05.358 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-06-09T11:13:05.358 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-06-09T11:13:05.358 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.358 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.358 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.359 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.359 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mds", 2023-06-09T11:13:05.359 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtCINksEVXGBAAkFWeKDSP67f6TjLrNPH67g==", 2023-06-09T11:13:05.359 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.359 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mds" 2023-06-09T11:13:05.359 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.360 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.360 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.360 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mgr", 2023-06-09T11:13:05.360 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtCINkR2ZXGBAAs9AoFnUmFje8LDMEj8vK+Q==", 2023-06-09T11:13:05.360 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.360 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-09T11:13:05.360 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-osd", 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtCINkJ4JXGBAAq+tu9F7gRuAfV8iLq3p4+A==", 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-osd" 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.361 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.362 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.362 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd", 2023-06-09T11:13:05.362 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtCINkbJpXGBAAFx6KBpQ/uGmypcEdA1Mxmw==", 2023-06-09T11:13:05.362 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.362 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-09T11:13:05.362 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.362 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.363 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.363 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-09T11:13:05.363 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtCINkH7JXGBAAygV2EPSe1Ux7/duHFlUMCg==", 2023-06-09T11:13:05.363 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.363 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-09T11:13:05.364 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.364 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.364 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.364 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rgw", 2023-06-09T11:13:05.364 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDtCINkG8tXGBAAsZg1j5mcQkAcgBvQ8zTdpA==", 2023-06-09T11:13:05.364 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDCCINkaH16IhAAi5jlGqA1ZWGycmkDceB0yQ==", 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.365 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDCCINk8mUPHBAAdXrI2h9wptCvEzNFlePjPg==", 2023-06-09T11:13:05.366 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-06-09T11:13:05.367 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-06-09T11:13:05.367 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-06-09T11:13:05.367 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-06-09T11:13:05.367 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.367 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:05.367 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-06-09T11:13:05.367 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T11:13:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f01b80662f0 msgr2=0x7f01b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f01b80662f0 0x7f01b80687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01d81f98b0 tx=0x7f01c0008040 comp rx=0 tx=0).stop 2023-06-09T11:13:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d806f2a0 msgr2=0x7f01d81f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d806f2a0 0x7f01d81f5ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01c8014040 tx=0x7f01c8004770 comp rx=0 tx=0).stop 2023-06-09T11:13:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 shutdown_connections 2023-06-09T11:13:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f01b80662f0 0x7f01b80687a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01d8160940 0x7f01d81634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01d806f880 0x7f01d8162fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 --2- 172.21.15.78:0/2840347793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d806f2a0 0x7f01d81f5ef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 >> 172.21.15.78:0/2840347793 conn(0x7f01d80cf670 msgr2=0x7f01d815af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:05.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 shutdown_connections 2023-06-09T11:13:05.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.331+0000 7f01d759e700 1 -- 172.21.15.78:0/2840347793 wait complete. 2023-06-09T11:13:05.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-09T11:13:05.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.531+0000 7f8a64a6f700 1 Processor -- start 2023-06-09T11:13:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.531+0000 7f8a64a6f700 1 -- start start 2023-06-09T11:13:05.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a64a6f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a6015fec0 0x7f8a600aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a64a6f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600ce280 con 0x7f8a600cf040 2023-06-09T11:13:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a64a6f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600ce560 con 0x7f8a600cfe80 2023-06-09T11:13:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a64a6f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600ce840 con 0x7f8a6015fec0 2023-06-09T11:13:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a57fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8a600cf040 0x7f8a600cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52054/0 (socket says 172.21.15.78:52054) 2023-06-09T11:13:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a57fff700 1 -- 172.21.15.78:0/3876694622 learned_addr learned my addr 172.21.15.78:0/3876694622 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:05.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a5f7fe700 1 --2- 172.21.15.78:0/3876694622 >> v2:172.21.15.78:3300/0 conn(0x7f8a6015fec0 0x7f8a600aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.535+0000 7f8a5effd700 1 -- 172.21.15.78:0/3876694622 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930155868 0 0) 0x7f8a600ce280 con 0x7f8a600cf040 2023-06-09T11:13:05.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5effd700 1 -- 172.21.15.78:0/3876694622 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a4c0035d0 con 0x7f8a600cf040 2023-06-09T11:13:05.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5f7fe700 1 -- 172.21.15.78:0/3876694622 >> v1:172.21.15.187:6789/0 conn(0x7f8a600cfe80 legacy=0x7f8a600ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5f7fe700 1 -- 172.21.15.78:0/3876694622 >> v1:172.21.15.78:6789/0 conn(0x7f8a600cf040 legacy=0x7f8a600cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5f7fe700 1 -- 172.21.15.78:0/3876694622 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600ceb20 con 0x7f8a6015fec0 2023-06-09T11:13:05.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5f7fe700 1 --2- 172.21.15.78:0/3876694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015fec0 0x7f8a600aedf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009850 tx=0x7f8a50009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6441c668238c4125 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:05.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5effd700 1 -- 172.21.15.78:0/3876694622 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50011830 con 0x7f8a6015fec0 2023-06-09T11:13:05.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5effd700 1 -- 172.21.15.78:0/3876694622 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50011990 con 0x7f8a6015fec0 2023-06-09T11:13:05.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a5effd700 1 -- 172.21.15.78:0/3876694622 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50011d40 con 0x7f8a6015fec0 2023-06-09T11:13:05.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3876694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015fec0 msgr2=0x7f8a600aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3876694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015fec0 0x7f8a600aedf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009850 tx=0x7f8a50009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:05.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3876694622 shutdown_connections 2023-06-09T11:13:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3876694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015fec0 0x7f8a600aedf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3876694622 >> 172.21.15.78:0/3876694622 conn(0x7f8a60098e70 msgr2=0x7f8a600b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3876694622 shutdown_connections 2023-06-09T11:13:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.539+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3876694622 wait complete. 2023-06-09T11:13:05.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.543+0000 7f8a64a6f700 1 Processor -- start 2023-06-09T11:13:05.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.543+0000 7f8a64a6f700 1 -- start start 2023-06-09T11:13:05.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a600cf040 0x7f8a6015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600cfe80 0x7f8a600c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015fec0 0x7f8a600c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6015ca60 con 0x7f8a600cf040 2023-06-09T11:13:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a601f2e00 con 0x7f8a6015fec0 2023-06-09T11:13:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600c62f0 con 0x7f8a600cfe80 2023-06-09T11:13:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a600cf040 0x7f8a6015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a600cf040 0x7f8a6015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38508/0 (socket says 172.21.15.78:38508) 2023-06-09T11:13:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 -- 172.21.15.78:0/3476400856 learned_addr learned my addr 172.21.15.78:0/3476400856 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5ffff700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015fec0 0x7f8a600c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a57fff700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600cfe80 0x7f8a600c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 -- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600cfe80 msgr2=0x7f8a600c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600cfe80 0x7f8a600c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 -- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015fec0 msgr2=0x7f8a600c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015fec0 0x7f8a600c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 -- 172.21.15.78:0/3476400856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500094b0 con 0x7f8a600cf040 2023-06-09T11:13:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5ffff700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015fec0 0x7f8a600c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5f7fe700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a600cf040 0x7f8a6015c520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8a50014040 tx=0x7f8a50004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5cff9700 1 -- 172.21.15.78:0/3476400856 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50019ab0 con 0x7f8a600cf040 2023-06-09T11:13:05.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5cff9700 1 -- 172.21.15.78:0/3476400856 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5001e070 con 0x7f8a600cf040 2023-06-09T11:13:05.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a5cff9700 1 -- 172.21.15.78:0/3476400856 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50019e50 con 0x7f8a600cf040 2023-06-09T11:13:05.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600b3310 con 0x7f8a600cf040 2023-06-09T11:13:05.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.547+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a600cdf90 con 0x7f8a600cf040 2023-06-09T11:13:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.551+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a600b5460 con 0x7f8a600cf040 2023-06-09T11:13:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.551+0000 7f8a5cff9700 1 -- 172.21.15.78:0/3476400856 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a5002d450 con 0x7f8a600cf040 2023-06-09T11:13:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.555+0000 7f8a5cff9700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a400662f0 0x7f8a400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.555+0000 7f8a5cff9700 1 -- 172.21.15.78:0/3476400856 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8a500849e0 con 0x7f8a600cf040 2023-06-09T11:13:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.555+0000 7f8a57fff700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a400662f0 0x7f8a400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.555+0000 7f8a57fff700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a400662f0 0x7f8a400687a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8a6009da20 tx=0x7f8a48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.559+0000 7f8a5cff9700 1 -- 172.21.15.78:0/3476400856 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8a50052220 con 0x7f8a600cf040 2023-06-09T11:13:05.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.787+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f8a600741c0 con 0x7f8a600cf040 2023-06-09T11:13:05.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.795+0000 7f8a5cff9700 1 -- 172.21.15.78:0/3476400856 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8a50015020 con 0x7f8a600cf040 2023-06-09T11:13:05.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a400662f0 msgr2=0x7f8a400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a400662f0 0x7f8a400687a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8a6009da20 tx=0x7f8a48009040 comp rx=0 tx=0).stop 2023-06-09T11:13:05.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a600cf040 msgr2=0x7f8a6015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:05.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a600cf040 0x7f8a6015c520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8a50014040 tx=0x7f8a50004770 comp rx=0 tx=0).stop 2023-06-09T11:13:05.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 shutdown_connections 2023-06-09T11:13:05.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8a400662f0 0x7f8a400687a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015fec0 0x7f8a600c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600cfe80 0x7f8a600c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 --2- 172.21.15.78:0/3476400856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a600cf040 0x7f8a6015c520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:05.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 >> 172.21.15.78:0/3476400856 conn(0x7f8a60098e70 msgr2=0x7f8a600ad810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 shutdown_connections 2023-06-09T11:13:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.799+0000 7f8a64a6f700 1 -- 172.21.15.78:0/3476400856 wait complete. 2023-06-09T11:13:05.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-09T11:13:06.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.991+0000 7f4f98b99700 1 Processor -- start 2023-06-09T11:13:06.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.991+0000 7f4f98b99700 1 -- start start 2023-06-09T11:13:06.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f98b99700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f940adfd0 0x7f4f94160e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f98b99700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f940cc810 0x7f4f94070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f98b99700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9406fdd0 con 0x7f4f9406d8d0 2023-06-09T11:13:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f98b99700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9406f880 con 0x7f4f940cc810 2023-06-09T11:13:06.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f98b99700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940ae3a0 con 0x7f4f940adfd0 2023-06-09T11:13:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f940cc810 0x7f4f94070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f9259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f940adfd0 0x7f4f94160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f940cc810 0x7f4f94070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:46682/0 (socket says 172.21.15.78:46682) 2023-06-09T11:13:06.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 -- 172.21.15.78:0/2253615969 learned_addr learned my addr 172.21.15.78:0/2253615969 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:06.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 -- 172.21.15.78:0/2253615969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f940adfd0 msgr2=0x7f4f94160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:06.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 --2- 172.21.15.78:0/2253615969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f940adfd0 0x7f4f94160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 -- 172.21.15.78:0/2253615969 >> v1:172.21.15.187:6789/0 conn(0x7f4f9406d8d0 legacy=0x7f4f940c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 -- 172.21.15.78:0/2253615969 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940ccf40 con 0x7f4f940cc810 2023-06-09T11:13:06.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f89d9b700 1 --2- 172.21.15.78:0/2253615969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 0x7f4f94070260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009910 tx=0x7f4f7c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a24df6f2cff63ac server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f91d9b700 1 -- 172.21.15.78:0/2253615969 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c011830 con 0x7f4f940cc810 2023-06-09T11:13:06.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f91d9b700 1 -- 172.21.15.78:0/2253615969 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c011990 con 0x7f4f940cc810 2023-06-09T11:13:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.995+0000 7f4f91d9b700 1 -- 172.21.15.78:0/2253615969 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c011d40 con 0x7f4f940cc810 2023-06-09T11:13:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 -- 172.21.15.78:0/2253615969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 msgr2=0x7f4f94070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 --2- 172.21.15.78:0/2253615969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 0x7f4f94070260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009910 tx=0x7f4f7c009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 -- 172.21.15.78:0/2253615969 shutdown_connections 2023-06-09T11:13:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 --2- 172.21.15.78:0/2253615969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 0x7f4f94070260 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 --2- 172.21.15.78:0/2253615969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f940adfd0 0x7f4f94160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 -- 172.21.15.78:0/2253615969 >> 172.21.15.78:0/2253615969 conn(0x7f4f940b1480 msgr2=0x7f4f940cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 -- 172.21.15.78:0/2253615969 shutdown_connections 2023-06-09T11:13:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:05.999+0000 7f4f98b99700 1 -- 172.21.15.78:0/2253615969 wait complete. 2023-06-09T11:13:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 Processor -- start 2023-06-09T11:13:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 -- start start 2023-06-09T11:13:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f9406d8d0 0x7f4f941e7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f940adfd0 0x7f4f940c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 0x7f4f94157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c83b0 con 0x7f4f940adfd0 2023-06-09T11:13:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c77a0 con 0x7f4f940cc810 2023-06-09T11:13:06.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f98b99700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c7a80 con 0x7f4f9406d8d0 2023-06-09T11:13:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f940adfd0 0x7f4f940c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f940adfd0 0x7f4f940c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38516/0 (socket says 172.21.15.78:38516) 2023-06-09T11:13:06.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 -- 172.21.15.78:0/104063772 learned_addr learned my addr 172.21.15.78:0/104063772 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f92d9d700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 0x7f4f94157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f9259c700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f9406d8d0 0x7f4f941e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 -- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f9406d8d0 msgr2=0x7f4f941e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f9406d8d0 0x7f4f941e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 -- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 msgr2=0x7f4f94157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 0x7f4f94157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.003+0000 7f4f89d9b700 1 -- 172.21.15.78:0/104063772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c009570 con 0x7f4f940adfd0 2023-06-09T11:13:06.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.007+0000 7f4f89d9b700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f940adfd0 0x7f4f940c8840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c000c00 tx=0x7f4f7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.007+0000 7f4f8b7fe700 1 -- 172.21.15.78:0/104063772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c004610 con 0x7f4f940adfd0 2023-06-09T11:13:06.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.007+0000 7f4f8b7fe700 1 -- 172.21.15.78:0/104063772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c0036c0 con 0x7f4f940adfd0 2023-06-09T11:13:06.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.007+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9406fa60 con 0x7f4f940adfd0 2023-06-09T11:13:06.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.007+0000 7f4f8b7fe700 1 -- 172.21.15.78:0/104063772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c003a50 con 0x7f4f940adfd0 2023-06-09T11:13:06.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.007+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f940cd220 con 0x7f4f940adfd0 2023-06-09T11:13:06.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.007+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f940ccc60 con 0x7f4f940adfd0 2023-06-09T11:13:06.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.011+0000 7f4f8b7fe700 1 -- 172.21.15.78:0/104063772 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f7c003bb0 con 0x7f4f940adfd0 2023-06-09T11:13:06.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.011+0000 7f4f8b7fe700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4f740662f0 0x7f4f740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.011+0000 7f4f8b7fe700 1 -- 172.21.15.78:0/104063772 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f7c021030 con 0x7f4f940adfd0 2023-06-09T11:13:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.011+0000 7f4f9259c700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4f740662f0 0x7f4f740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.011+0000 7f4f9259c700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4f740662f0 0x7f4f740687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f84009b80 tx=0x7f4f84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.015+0000 7f4f8b7fe700 1 -- 172.21.15.78:0/104063772 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4f7c052920 con 0x7f4f940adfd0 2023-06-09T11:13:06.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.243+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4f940741c0 con 0x7f4f940adfd0 2023-06-09T11:13:06.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.255+0000 7f4f8b7fe700 1 -- 172.21.15.78:0/104063772 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4f7c003e60 con 0x7f4f940adfd0 2023-06-09T11:13:06.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4f740662f0 msgr2=0x7f4f740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4f740662f0 0x7f4f740687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f84009b80 tx=0x7f4f84008040 comp rx=0 tx=0).stop 2023-06-09T11:13:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f940adfd0 msgr2=0x7f4f940c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f940adfd0 0x7f4f940c8840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c000c00 tx=0x7f4f7c004770 comp rx=0 tx=0).stop 2023-06-09T11:13:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 shutdown_connections 2023-06-09T11:13:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4f740662f0 0x7f4f740687a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f940cc810 0x7f4f94157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f940adfd0 0x7f4f940c8840 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 --2- 172.21.15.78:0/104063772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f9406d8d0 0x7f4f941e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 >> 172.21.15.78:0/104063772 conn(0x7f4f940b1480 msgr2=0x7f4f940ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 shutdown_connections 2023-06-09T11:13:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.259+0000 7f4f98b99700 1 -- 172.21.15.78:0/104063772 wait complete. 2023-06-09T11:13:06.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-09T11:13:06.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 Processor -- start 2023-06-09T11:13:06.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 -- start start 2023-06-09T11:13:06.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f10dc160940 0x7f10dc0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10dc06f2a0 0x7f10dc1644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc06f880 0x7f10dc164a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc1653a0 con 0x7f10dc06f2a0 2023-06-09T11:13:06.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc06ba70 con 0x7f10dc160940 2023-06-09T11:13:06.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.455+0000 7f10e24e4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0ccfa0 con 0x7f10dc06f880 2023-06-09T11:13:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10dc06f2a0 0x7f10dc1644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e14e2700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f10dc160940 0x7f10dc0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10dc06f2a0 0x7f10dc1644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38518/0 (socket says 172.21.15.78:38518) 2023-06-09T11:13:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e1ce3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc06f880 0x7f10dc164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 -- 172.21.15.78:0/377635621 learned_addr learned my addr 172.21.15.78:0/377635621 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 -- 172.21.15.78:0/377635621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc06f880 msgr2=0x7f10dc164a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 --2- 172.21.15.78:0/377635621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc06f880 0x7f10dc164a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 -- 172.21.15.78:0/377635621 >> v2:172.21.15.187:3300/0 conn(0x7f10dc160940 msgr2=0x7f10dc0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 --2- 172.21.15.78:0/377635621 >> v2:172.21.15.187:3300/0 conn(0x7f10dc160940 0x7f10dc0ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 -- 172.21.15.78:0/377635621 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0adb00 con 0x7f10dc06f2a0 2023-06-09T11:13:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e0ce1700 1 --2- 172.21.15.78:0/377635621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f2a0 0x7f10dc1644f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0b4bf0 tx=0x7f10cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67205c2b5e879fc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10d3fff700 1 -- 172.21.15.78:0/377635621 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc011830 con 0x7f10dc06f2a0 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10d3fff700 1 -- 172.21.15.78:0/377635621 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc011990 con 0x7f10dc06f2a0 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10d3fff700 1 -- 172.21.15.78:0/377635621 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc011d40 con 0x7f10dc06f2a0 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 -- 172.21.15.78:0/377635621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f2a0 msgr2=0x7f10dc1644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 --2- 172.21.15.78:0/377635621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f2a0 0x7f10dc1644f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0b4bf0 tx=0x7f10cc009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 -- 172.21.15.78:0/377635621 shutdown_connections 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 --2- 172.21.15.78:0/377635621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc06f880 0x7f10dc164a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 --2- 172.21.15.78:0/377635621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f2a0 0x7f10dc1644f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 --2- 172.21.15.78:0/377635621 >> v2:172.21.15.187:3300/0 conn(0x7f10dc160940 0x7f10dc0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 -- 172.21.15.78:0/377635621 >> 172.21.15.78:0/377635621 conn(0x7f10dc0cf670 msgr2=0x7f10dc0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:06.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.459+0000 7f10e24e4700 1 -- 172.21.15.78:0/377635621 shutdown_connections 2023-06-09T11:13:06.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.463+0000 7f10e24e4700 1 -- 172.21.15.78:0/377635621 wait complete. 2023-06-09T11:13:06.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.463+0000 7f10e24e4700 1 Processor -- start 2023-06-09T11:13:06.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.463+0000 7f10e24e4700 1 -- start start 2023-06-09T11:13:06.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e24e4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc06f2a0 0x7f10dc14a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e24e4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f880 0x7f10dc14d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e24e4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc160940 0x7f10dc15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e24e4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14e110 con 0x7f10dc06f880 2023-06-09T11:13:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e24e4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14db50 con 0x7f10dc06f2a0 2023-06-09T11:13:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e24e4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14de30 con 0x7f10dc160940 2023-06-09T11:13:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f880 0x7f10dc14d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f880 0x7f10dc14d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38528/0 (socket says 172.21.15.78:38528) 2023-06-09T11:13:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 -- 172.21.15.78:0/3268412646 learned_addr learned my addr 172.21.15.78:0/3268412646 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e14e2700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc06f2a0 0x7f10dc14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e1ce3700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc160940 0x7f10dc15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 -- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc160940 msgr2=0x7f10dc15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc160940 0x7f10dc15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 -- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc06f2a0 msgr2=0x7f10dc14a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc06f2a0 0x7f10dc14a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 -- 172.21.15.78:0/3268412646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009570 con 0x7f10dc06f880 2023-06-09T11:13:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e0ce1700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f880 0x7f10dc14d0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f10cc000c00 tx=0x7f10cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10d1ffb700 1 -- 172.21.15.78:0/3268412646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc004240 con 0x7f10dc06f880 2023-06-09T11:13:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10d1ffb700 1 -- 172.21.15.78:0/3268412646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc01f070 con 0x7f10dc06f880 2023-06-09T11:13:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc0add50 con 0x7f10dc06f880 2023-06-09T11:13:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.467+0000 7f10d1ffb700 1 -- 172.21.15.78:0/3268412646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0045c0 con 0x7f10dc06f880 2023-06-09T11:13:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.471+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc0ccb10 con 0x7f10dc06f880 2023-06-09T11:13:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.471+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc1650c0 con 0x7f10dc06f880 2023-06-09T11:13:06.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.471+0000 7f10d1ffb700 1 -- 172.21.15.78:0/3268412646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10cc021030 con 0x7f10dc06f880 2023-06-09T11:13:06.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.475+0000 7f10d1ffb700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f10c00662f0 0x7f10c00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.475+0000 7f10d1ffb700 1 -- 172.21.15.78:0/3268412646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f10cc084900 con 0x7f10dc06f880 2023-06-09T11:13:06.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.475+0000 7f10e14e2700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f10c00662f0 0x7f10c00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.475+0000 7f10e14e2700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f10c00662f0 0x7f10c00687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009b50 tx=0x7f10d8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.483+0000 7f10d1ffb700 1 -- 172.21.15.78:0/3268412646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f10cc052160 con 0x7f10dc06f880 2023-06-09T11:13:06.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.715+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f10dc0741c0 con 0x7f10dc06f880 2023-06-09T11:13:06.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.723+0000 7f10d1ffb700 1 -- 172.21.15.78:0/3268412646 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f10cc0150a0 con 0x7f10dc06f880 2023-06-09T11:13:06.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f10c00662f0 msgr2=0x7f10c00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f10c00662f0 0x7f10c00687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009b50 tx=0x7f10d8009240 comp rx=0 tx=0).stop 2023-06-09T11:13:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f880 msgr2=0x7f10dc14d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f880 0x7f10dc14d0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f10cc000c00 tx=0x7f10cc004770 comp rx=0 tx=0).stop 2023-06-09T11:13:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 shutdown_connections 2023-06-09T11:13:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f10c00662f0 0x7f10c00687a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc160940 0x7f10dc15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10dc06f880 0x7f10dc14d0e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 --2- 172.21.15.78:0/3268412646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc06f2a0 0x7f10dc14a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 >> 172.21.15.78:0/3268412646 conn(0x7f10dc0cf670 msgr2=0x7f10dc0c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 shutdown_connections 2023-06-09T11:13:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.731+0000 7f10e24e4700 1 -- 172.21.15.78:0/3268412646 wait complete. 2023-06-09T11:13:06.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-09T11:13:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.927+0000 7fd32a885700 1 Processor -- start 2023-06-09T11:13:06.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.927+0000 7fd32a885700 1 -- start start 2023-06-09T11:13:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.927+0000 7fd32a885700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd324160940 0x7fd3240ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.927+0000 7fd32a885700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd32406f2a0 0x7fd3241644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.927+0000 7fd32a885700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3240adb00 con 0x7fd32406f880 2023-06-09T11:13:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.927+0000 7fd32a885700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3241653a0 con 0x7fd324160940 2023-06-09T11:13:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.927+0000 7fd32a885700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32406ba70 con 0x7fd32406f2a0 2023-06-09T11:13:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a084700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd32406f880 0x7fd32406dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52056/0 (socket says 172.21.15.78:52056) 2023-06-09T11:13:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a084700 1 -- 172.21.15.78:0/282018730 learned_addr learned my addr 172.21.15.78:0/282018730 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329883700 1 --2- 172.21.15.78:0/282018730 >> v2:172.21.15.187:3300/0 conn(0x7fd324160940 0x7fd3240ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329082700 1 --2- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd32406f2a0 0x7fd3241644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd328881700 1 -- 172.21.15.78:0/282018730 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089381465 0 0) 0x7fd3240adb00 con 0x7fd32406f880 2023-06-09T11:13:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd328881700 1 -- 172.21.15.78:0/282018730 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3100035d0 con 0x7fd32406f880 2023-06-09T11:13:06.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329883700 1 -- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd32406f2a0 msgr2=0x7fd3241644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:06.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329883700 1 --2- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd32406f2a0 0x7fd3241644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329883700 1 -- 172.21.15.78:0/282018730 >> v1:172.21.15.78:6789/0 conn(0x7fd32406f880 legacy=0x7fd32406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329883700 1 -- 172.21.15.78:0/282018730 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240ccb10 con 0x7fd324160940 2023-06-09T11:13:06.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329082700 1 --2- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd32406f2a0 0x7fd3241644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:13:06.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd329883700 1 --2- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd324160940 0x7fd3240ce4a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd320009850 tx=0x7fd320009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=687f67afe6e4bc4f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd328881700 1 -- 172.21.15.78:0/282018730 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320011830 con 0x7fd324160940 2023-06-09T11:13:06.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd328881700 1 -- 172.21.15.78:0/282018730 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320011990 con 0x7fd324160940 2023-06-09T11:13:06.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd328881700 1 -- 172.21.15.78:0/282018730 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320011d40 con 0x7fd324160940 2023-06-09T11:13:06.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a885700 1 -- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd324160940 msgr2=0x7fd3240ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a885700 1 --2- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd324160940 0x7fd3240ce4a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd320009850 tx=0x7fd320009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:06.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a885700 1 -- 172.21.15.78:0/282018730 shutdown_connections 2023-06-09T11:13:06.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a885700 1 --2- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd32406f2a0 0x7fd3241644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a885700 1 --2- 172.21.15.78:0/282018730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd324160940 0x7fd3240ce4a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.931+0000 7fd32a885700 1 -- 172.21.15.78:0/282018730 >> 172.21.15.78:0/282018730 conn(0x7fd3240cf670 msgr2=0x7fd3240cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:06.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.935+0000 7fd32a885700 1 -- 172.21.15.78:0/282018730 shutdown_connections 2023-06-09T11:13:06.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.935+0000 7fd32a885700 1 -- 172.21.15.78:0/282018730 wait complete. 2023-06-09T11:13:06.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.935+0000 7fd32a885700 1 Processor -- start 2023-06-09T11:13:06.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.935+0000 7fd32a885700 1 -- start start 2023-06-09T11:13:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32406f2a0 0x7fd3240c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd32406f880 0x7fd3240ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd324160940 0x7fd3240aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3240c7490 con 0x7fd32406f2a0 2023-06-09T11:13:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3241f5ea0 con 0x7fd32406f880 2023-06-09T11:13:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32415a120 con 0x7fd324160940 2023-06-09T11:13:06.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32406f2a0 0x7fd3240c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32406f2a0 0x7fd3240c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38534/0 (socket says 172.21.15.78:38534) 2023-06-09T11:13:06.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 -- 172.21.15.78:0/3845350496 learned_addr learned my addr 172.21.15.78:0/3845350496 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:06.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329082700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd32406f880 0x7fd3240ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a084700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd324160940 0x7fd3240aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 -- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd324160940 msgr2=0x7fd3240aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd324160940 0x7fd3240aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 -- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd32406f880 msgr2=0x7fd3240ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd32406f880 0x7fd3240ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 -- 172.21.15.78:0/3845350496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140094b0 con 0x7fd32406f2a0 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a084700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd324160940 0x7fd3240aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd329883700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32406f2a0 0x7fd3240c8230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd320014040 tx=0x7fd320004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd31a7fc700 1 -- 172.21.15.78:0/3845350496 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3200036c0 con 0x7fd32406f2a0 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd31a7fc700 1 -- 172.21.15.78:0/3845350496 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32001e070 con 0x7fd32406f2a0 2023-06-09T11:13:06.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd31a7fc700 1 -- 172.21.15.78:0/3845350496 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320003a80 con 0x7fd32406f2a0 2023-06-09T11:13:06.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3200094b0 con 0x7fd32406f2a0 2023-06-09T11:13:06.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.939+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3241650c0 con 0x7fd32406f2a0 2023-06-09T11:13:06.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.943+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3240add50 con 0x7fd32406f2a0 2023-06-09T11:13:06.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.943+0000 7fd31a7fc700 1 -- 172.21.15.78:0/3845350496 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd320003be0 con 0x7fd32406f2a0 2023-06-09T11:13:06.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.947+0000 7fd31a7fc700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3080662f0 0x7fd3080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:06.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.947+0000 7fd31a7fc700 1 -- 172.21.15.78:0/3845350496 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd320020070 con 0x7fd32406f2a0 2023-06-09T11:13:06.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.947+0000 7fd329082700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3080662f0 0x7fd3080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:06.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.947+0000 7fd329082700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3080662f0 0x7fd3080687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd3240b11e0 tx=0x7fd314008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:06.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:06.947+0000 7fd31a7fc700 1 -- 172.21.15.78:0/3845350496 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd320052670 con 0x7fd32406f2a0 2023-06-09T11:13:07.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.175+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd324161d20 con 0x7fd32406f2a0 2023-06-09T11:13:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.183+0000 7fd31a7fc700 1 -- 172.21.15.78:0/3845350496 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd320006ce0 con 0x7fd32406f2a0 2023-06-09T11:13:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3080662f0 msgr2=0x7fd3080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3080662f0 0x7fd3080687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd3240b11e0 tx=0x7fd314008040 comp rx=0 tx=0).stop 2023-06-09T11:13:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32406f2a0 msgr2=0x7fd3240c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32406f2a0 0x7fd3240c8230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd320014040 tx=0x7fd320004770 comp rx=0 tx=0).stop 2023-06-09T11:13:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 shutdown_connections 2023-06-09T11:13:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd3080662f0 0x7fd3080687a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd324160940 0x7fd3240aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd32406f880 0x7fd3240ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 --2- 172.21.15.78:0/3845350496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32406f2a0 0x7fd3240c8230 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 >> 172.21.15.78:0/3845350496 conn(0x7fd3240cf670 msgr2=0x7fd32406fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:07.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 shutdown_connections 2023-06-09T11:13:07.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.187+0000 7fd32a885700 1 -- 172.21.15.78:0/3845350496 wait complete. 2023-06-09T11:13:07.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-09T11:13:07.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d689b4700 1 Processor -- start 2023-06-09T11:13:07.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d689b4700 1 -- start start 2023-06-09T11:13:07.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d689b4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d6406fc80 0x7f0d64070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d689b4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640c87a0 con 0x7f0d640c7cb0 2023-06-09T11:13:07.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d689b4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d64070590 con 0x7f0d6415c880 2023-06-09T11:13:07.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d689b4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6406e660 con 0x7f0d6406fc80 2023-06-09T11:13:07.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d637fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d6406fc80 0x7f0d64070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d637fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d6406fc80 0x7f0d64070050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38540/0 (socket says 172.21.15.78:38540) 2023-06-09T11:13:07.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d637fe700 1 -- 172.21.15.78:0/912324051 learned_addr learned my addr 172.21.15.78:0/912324051 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:07.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d637fe700 1 -- 172.21.15.78:0/912324051 >> v1:172.21.15.187:6789/0 conn(0x7f0d6415c880 legacy=0x7f0d6406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:07.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d637fe700 1 -- 172.21.15.78:0/912324051 >> v1:172.21.15.78:6789/0 conn(0x7f0d640c7cb0 legacy=0x7f0d6406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.387+0000 7f0d637fe700 1 -- 172.21.15.78:0/912324051 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640c81e0 con 0x7f0d6406fc80 2023-06-09T11:13:07.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d637fe700 1 --2- 172.21.15.78:0/912324051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d64070050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009940 tx=0x7f0d54009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e652235e9f5ff1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:07.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d627fc700 1 -- 172.21.15.78:0/912324051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54004230 con 0x7f0d6406fc80 2023-06-09T11:13:07.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d627fc700 1 -- 172.21.15.78:0/912324051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d54009e90 con 0x7f0d6406fc80 2023-06-09T11:13:07.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d627fc700 1 -- 172.21.15.78:0/912324051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540045b0 con 0x7f0d6406fc80 2023-06-09T11:13:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 -- 172.21.15.78:0/912324051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 msgr2=0x7f0d64070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 --2- 172.21.15.78:0/912324051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d64070050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009940 tx=0x7f0d54009c50 comp rx=0 tx=0).stop 2023-06-09T11:13:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 -- 172.21.15.78:0/912324051 shutdown_connections 2023-06-09T11:13:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 --2- 172.21.15.78:0/912324051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d64070050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 -- 172.21.15.78:0/912324051 >> 172.21.15.78:0/912324051 conn(0x7f0d640cf870 msgr2=0x7f0d640cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:07.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 -- 172.21.15.78:0/912324051 shutdown_connections 2023-06-09T11:13:07.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 -- 172.21.15.78:0/912324051 wait complete. 2023-06-09T11:13:07.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.391+0000 7f0d689b4700 1 Processor -- start 2023-06-09T11:13:07.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 -- start start 2023-06-09T11:13:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d641595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d640c7cb0 0x7f0d6415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d6415c880 0x7f0d640ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6415e3c0 con 0x7f0d6406fc80 2023-06-09T11:13:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6415e7e0 con 0x7f0d640c7cb0 2023-06-09T11:13:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6415d740 con 0x7f0d6415c880 2023-06-09T11:13:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d641595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d641595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38552/0 (socket says 172.21.15.78:38552) 2023-06-09T11:13:07.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 -- 172.21.15.78:0/1607286368 learned_addr learned my addr 172.21.15.78:0/1607286368 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:07.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d63fff700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d6415c880 0x7f0d640ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 -- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d6415c880 msgr2=0x7f0d640ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d6415c880 0x7f0d640ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 -- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d640c7cb0 msgr2=0x7f0d6415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d62ffd700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d640c7cb0 0x7f0d6415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d640c7cb0 0x7f0d6415cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 -- 172.21.15.78:0/1607286368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009570 con 0x7f0d6406fc80 2023-06-09T11:13:07.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d63fff700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d6415c880 0x7f0d640ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:07.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d62ffd700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d640c7cb0 0x7f0d6415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:07.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d637fe700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d641595c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009910 tx=0x7f0d54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:07.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d4bfff700 1 -- 172.21.15.78:0/1607286368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400bd90 con 0x7f0d6406fc80 2023-06-09T11:13:07.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d4bfff700 1 -- 172.21.15.78:0/1607286368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5401f070 con 0x7f0d6406fc80 2023-06-09T11:13:07.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6406a070 con 0x7f0d6406fc80 2023-06-09T11:13:07.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d4bfff700 1 -- 172.21.15.78:0/1607286368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54003900 con 0x7f0d6406fc80 2023-06-09T11:13:07.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.395+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640c84c0 con 0x7f0d6406fc80 2023-06-09T11:13:07.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.399+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6406a350 con 0x7f0d6406fc80 2023-06-09T11:13:07.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.399+0000 7f0d4bfff700 1 -- 172.21.15.78:0/1607286368 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d54021030 con 0x7f0d6406fc80 2023-06-09T11:13:07.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.399+0000 7f0d4bfff700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0d500662f0 0x7f0d500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.399+0000 7f0d4bfff700 1 -- 172.21.15.78:0/1607286368 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d54084de0 con 0x7f0d6406fc80 2023-06-09T11:13:07.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.403+0000 7f0d62ffd700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0d500662f0 0x7f0d500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.403+0000 7f0d62ffd700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0d500662f0 0x7f0d500687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d641f5350 tx=0x7f0d58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:07.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.407+0000 7f0d4bfff700 1 -- 172.21.15.78:0/1607286368 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0d54052510 con 0x7f0d6406fc80 2023-06-09T11:13:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.639+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0d6406a350 con 0x7f0d6406fc80 2023-06-09T11:13:07.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d4bfff700 1 -- 172.21.15.78:0/1607286368 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0d54055b30 con 0x7f0d6406fc80 2023-06-09T11:13:07.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0d500662f0 msgr2=0x7f0d500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0d500662f0 0x7f0d500687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d641f5350 tx=0x7f0d58008040 comp rx=0 tx=0).stop 2023-06-09T11:13:07.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 msgr2=0x7f0d641595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d641595c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009910 tx=0x7f0d54004770 comp rx=0 tx=0).stop 2023-06-09T11:13:07.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 shutdown_connections 2023-06-09T11:13:07.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0d500662f0 0x7f0d500687a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d6415c880 0x7f0d640ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d640c7cb0 0x7f0d6415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 --2- 172.21.15.78:0/1607286368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d6406fc80 0x7f0d641595c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 >> 172.21.15.78:0/1607286368 conn(0x7f0d640cf870 msgr2=0x7f0d640d25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:07.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 shutdown_connections 2023-06-09T11:13:07.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.651+0000 7f0d689b4700 1 -- 172.21.15.78:0/1607286368 wait complete. 2023-06-09T11:13:07.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-09T11:13:07.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.851+0000 7f6ef7501700 1 Processor -- start 2023-06-09T11:13:07.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.851+0000 7f6ef7501700 1 -- start start 2023-06-09T11:13:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6ef015a670 0x7f6ef00b1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00b20e0 con 0x7f6ef0153d50 2023-06-09T11:13:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00ce6e0 con 0x7f6ef00b1c80 2023-06-09T11:13:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00cf5e0 con 0x7f6ef015a670 2023-06-09T11:13:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef529d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6ef0153d50 0x7f6ef00cd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52078/0 (socket says 172.21.15.78:52078) 2023-06-09T11:13:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef529d700 1 -- 172.21.15.78:0/923873580 learned_addr learned my addr 172.21.15.78:0/923873580 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:07.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef4a9c700 1 --2- 172.21.15.78:0/923873580 >> v2:172.21.15.187:3300/0 conn(0x7f6ef015a670 0x7f6ef00b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ee7fff700 1 -- 172.21.15.78:0/923873580 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797775223 0 0) 0x7f6ef00b20e0 con 0x7f6ef0153d50 2023-06-09T11:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ee7fff700 1 -- 172.21.15.78:0/923873580 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6edc0057e0 con 0x7f6ef0153d50 2023-06-09T11:13:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef4a9c700 1 -- 172.21.15.78:0/923873580 >> v1:172.21.15.187:6789/0 conn(0x7f6ef00b1c80 legacy=0x7f6ef015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef4a9c700 1 -- 172.21.15.78:0/923873580 >> v1:172.21.15.78:6789/0 conn(0x7f6ef0153d50 legacy=0x7f6ef00cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef4a9c700 1 -- 172.21.15.78:0/923873580 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0071540 con 0x7f6ef015a670 2023-06-09T11:13:07.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef4a9c700 1 --2- 172.21.15.78:0/923873580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef00b1740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009850 tx=0x7f6ee0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14588e55326f3bbd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ee7fff700 1 -- 172.21.15.78:0/923873580 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011830 con 0x7f6ef015a670 2023-06-09T11:13:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ee7fff700 1 -- 172.21.15.78:0/923873580 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0011990 con 0x7f6ef015a670 2023-06-09T11:13:07.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ee7fff700 1 -- 172.21.15.78:0/923873580 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011d40 con 0x7f6ef015a670 2023-06-09T11:13:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 -- 172.21.15.78:0/923873580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 msgr2=0x7f6ef00b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 --2- 172.21.15.78:0/923873580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef00b1740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009850 tx=0x7f6ee0009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 -- 172.21.15.78:0/923873580 shutdown_connections 2023-06-09T11:13:07.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 --2- 172.21.15.78:0/923873580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef00b1740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.855+0000 7f6ef7501700 1 -- 172.21.15.78:0/923873580 >> 172.21.15.78:0/923873580 conn(0x7f6ef00cc740 msgr2=0x7f6ef00ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 -- 172.21.15.78:0/923873580 shutdown_connections 2023-06-09T11:13:07.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 -- 172.21.15.78:0/923873580 wait complete. 2023-06-09T11:13:07.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 Processor -- start 2023-06-09T11:13:07.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 -- start start 2023-06-09T11:13:07.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ef00b1c80 0x7f6ef015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef0153d50 0x7f6ef015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015d060 con 0x7f6ef0153d50 2023-06-09T11:13:07.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015bf40 con 0x7f6ef015a670 2023-06-09T11:13:07.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.859+0000 7f6ef7501700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015b610 con 0x7f6ef00b1c80 2023-06-09T11:13:07.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef0153d50 0x7f6ef015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef0153d50 0x7f6ef015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38558/0 (socket says 172.21.15.78:38558) 2023-06-09T11:13:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 -- 172.21.15.78:0/703888205 learned_addr learned my addr 172.21.15.78:0/703888205 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:07.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef529d700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ef00b1c80 0x7f6ef015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef5a9e700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 -- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ef00b1c80 msgr2=0x7f6ef015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ef00b1c80 0x7f6ef015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 -- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 msgr2=0x7f6ef014f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:07.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef014f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:07.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 -- 172.21.15.78:0/703888205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094b0 con 0x7f6ef0153d50 2023-06-09T11:13:07.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef5a9e700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:07.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef4a9c700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef0153d50 0x7f6ef015cb20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000c00 tx=0x7f6ee0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:07.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ee5ffb700 1 -- 172.21.15.78:0/703888205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee001aac0 con 0x7f6ef0153d50 2023-06-09T11:13:07.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ee5ffb700 1 -- 172.21.15.78:0/703888205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee001f070 con 0x7f6ef0153d50 2023-06-09T11:13:07.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef0159b90 con 0x7f6ef0153d50 2023-06-09T11:13:07.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ee5ffb700 1 -- 172.21.15.78:0/703888205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee001ae60 con 0x7f6ef0153d50 2023-06-09T11:13:07.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.863+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef00ce400 con 0x7f6ef0153d50 2023-06-09T11:13:07.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.867+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0159e70 con 0x7f6ef0153d50 2023-06-09T11:13:07.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.867+0000 7f6ee5ffb700 1 -- 172.21.15.78:0/703888205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ee001b430 con 0x7f6ef0153d50 2023-06-09T11:13:07.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.867+0000 7f6ee5ffb700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed40662f0 0x7f6ed40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:07.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.867+0000 7f6ee5ffb700 1 -- 172.21.15.78:0/703888205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6ee0084b40 con 0x7f6ef0153d50 2023-06-09T11:13:07.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.867+0000 7f6ef529d700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed40662f0 0x7f6ed40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.871+0000 7f6ef529d700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed40662f0 0x7f6ed40687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6eec004a30 tx=0x7f6eec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:07.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:07.871+0000 7f6ee5ffb700 1 -- 172.21.15.78:0/703888205 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6ee0052300 con 0x7f6ef0153d50 2023-06-09T11:13:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.099+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f6ef015c0b0 con 0x7f6ef0153d50 2023-06-09T11:13:08.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.107+0000 7f6ee5ffb700 1 -- 172.21.15.78:0/703888205 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6ee0015020 con 0x7f6ef0153d50 2023-06-09T11:13:08.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed40662f0 msgr2=0x7f6ed40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed40662f0 0x7f6ed40687a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6eec004a30 tx=0x7f6eec009040 comp rx=0 tx=0).stop 2023-06-09T11:13:08.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef0153d50 msgr2=0x7f6ef015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef0153d50 0x7f6ef015cb20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000c00 tx=0x7f6ee0004770 comp rx=0 tx=0).stop 2023-06-09T11:13:08.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 shutdown_connections 2023-06-09T11:13:08.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed40662f0 0x7f6ed40687a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ef015a670 0x7f6ef014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef0153d50 0x7f6ef015cb20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 --2- 172.21.15.78:0/703888205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ef00b1c80 0x7f6ef015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 >> 172.21.15.78:0/703888205 conn(0x7f6ef00cc740 msgr2=0x7f6ef00cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:08.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 shutdown_connections 2023-06-09T11:13:08.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.111+0000 7f6ef7501700 1 -- 172.21.15.78:0/703888205 wait complete. 2023-06-09T11:13:08.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:13:08.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.307+0000 7fc7e8737700 1 Processor -- start 2023-06-09T11:13:08.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.307+0000 7fc7e8737700 1 -- start start 2023-06-09T11:13:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e8737700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc7e015a4b0 0x7fc7e015a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e8737700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e0071160 con 0x7fc7e006e8f0 2023-06-09T11:13:08.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e8737700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00b47a0 con 0x7fc7e006dfe0 2023-06-09T11:13:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e8737700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e0069ed0 con 0x7fc7e015a4b0 2023-06-09T11:13:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e5cd2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc7e006e8f0 0x7fc7e006d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52086/0 (socket says 172.21.15.78:52086) 2023-06-09T11:13:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e5cd2700 1 -- 172.21.15.78:0/1534541678 learned_addr learned my addr 172.21.15.78:0/1534541678 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/1534541678 >> v2:172.21.15.187:3300/0 conn(0x7fc7e015a4b0 0x7fc7e015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681785535 0 0) 0x7fc7e0071160 con 0x7fc7e006e8f0 2023-06-09T11:13:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7cc0035d0 con 0x7fc7e006e8f0 2023-06-09T11:13:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 731067433 0 0) 0x7fc7cc0035d0 con 0x7fc7e006e8f0 2023-06-09T11:13:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 >> v2:172.21.15.187:3300/0 conn(0x7fc7e015a4b0 msgr2=0x7fc7e015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 --2- 172.21.15.78:0/1534541678 >> v2:172.21.15.187:3300/0 conn(0x7fc7e015a4b0 0x7fc7e015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 >> v1:172.21.15.187:6789/0 conn(0x7fc7e006dfe0 legacy=0x7fc7e006f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e006a0e0 con 0x7fc7e006e8f0 2023-06-09T11:13:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7fc7d0001690 con 0x7fc7e006e8f0 2023-06-09T11:13:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.311+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/1534541678 >> v2:172.21.15.187:3300/0 conn(0x7fc7e015a4b0 0x7fc7e015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:13:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 >> v1:172.21.15.78:6789/0 conn(0x7fc7e006e8f0 legacy=0x7fc7e006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7cc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7cc004870 0x7fc7cc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7cc005220 0x7fc7cc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0069ed0 con 0x7fc7cc003a20 2023-06-09T11:13:08.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc00bfd0 con 0x7fc7cc005220 2023-06-09T11:13:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc00c190 con 0x7fc7cc004870 2023-06-09T11:13:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7cc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e6cd4700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7cc005220 0x7fc7cc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e5cd2700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7cc004870 0x7fc7cc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e64d3700 1 -- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7cc004870 msgr2=0x7fc7cc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7cc004870 0x7fc7cc004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e64d3700 1 -- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7cc005220 msgr2=0x7fc7cc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:08.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7cc005220 0x7fc7cc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e64d3700 1 -- 172.21.15.78:0/1534541678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0035d0 con 0x7fc7cc003a20 2023-06-09T11:13:08.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e5cd2700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7cc004870 0x7fc7cc004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:08.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e6cd4700 1 -- 172.21.15.78:0/1534541678 reap_dead start 2023-06-09T11:13:08.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7cc003df0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0098d0 tx=0x7fc7cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565a885ec9f567a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:08.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00e7e0 con 0x7fc7cc003a20 2023-06-09T11:13:08.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00e940 con 0x7fc7cc003a20 2023-06-09T11:13:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e54d1700 1 -- 172.21.15.78:0/1534541678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00ecb0 con 0x7fc7cc003a20 2023-06-09T11:13:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e8737700 1 -- 172.21.15.78:0/1534541678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 msgr2=0x7fc7cc003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e8737700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7cc003df0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0098d0 tx=0x7fc7cc0058a0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e8737700 1 -- 172.21.15.78:0/1534541678 shutdown_connections 2023-06-09T11:13:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e8737700 1 --2- 172.21.15.78:0/1534541678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7cc003df0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e8737700 1 -- 172.21.15.78:0/1534541678 >> 172.21.15.78:0/1534541678 conn(0x7fc7e00b1480 msgr2=0x7fc7e00cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e8737700 1 -- 172.21.15.78:0/1534541678 shutdown_connections 2023-06-09T11:13:08.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.315+0000 7fc7e8737700 1 -- 172.21.15.78:0/1534541678 wait complete. 2023-06-09T11:13:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 Processor -- start 2023-06-09T11:13:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 -- start start 2023-06-09T11:13:08.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7e015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e014e5b0 0x7fc7e014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0150260 0x7fc7e01506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0152270 con 0x7fc7cc003a20 2023-06-09T11:13:08.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0152550 con 0x7fc7e0150260 2023-06-09T11:13:08.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e8737700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0152830 con 0x7fc7e014e5b0 2023-06-09T11:13:08.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e64d3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7e015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e64d3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7e015d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38586/0 (socket says 172.21.15.78:38586) 2023-06-09T11:13:08.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e64d3700 1 -- 172.21.15.78:0/962979818 learned_addr learned my addr 172.21.15.78:0/962979818 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:08.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e6cd4700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0150260 0x7fc7e01506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e5cd2700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e014e5b0 0x7fc7e014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e64d3700 1 -- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e014e5b0 msgr2=0x7fc7e014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.319+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e014e5b0 0x7fc7e014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e64d3700 1 -- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0150260 msgr2=0x7fc7e01506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0150260 0x7fc7e01506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e64d3700 1 -- 172.21.15.78:0/962979818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e006a6a0 con 0x7fc7cc003a20 2023-06-09T11:13:08.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e5cd2700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e014e5b0 0x7fc7e014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:08.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e64d3700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7e015d1b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0090b0 tx=0x7fc7dc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:08.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7d6ffd700 1 -- 172.21.15.78:0/962979818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00e7e0 con 0x7fc7cc003a20 2023-06-09T11:13:08.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7d6ffd700 1 -- 172.21.15.78:0/962979818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc0045f0 con 0x7fc7cc003a20 2023-06-09T11:13:08.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e006a3c0 con 0x7fc7cc003a20 2023-06-09T11:13:08.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7d6ffd700 1 -- 172.21.15.78:0/962979818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00eea0 con 0x7fc7cc003a20 2023-06-09T11:13:08.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e006abc0 con 0x7fc7cc003a20 2023-06-09T11:13:08.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.323+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e00741c0 con 0x7fc7cc003a20 2023-06-09T11:13:08.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.327+0000 7fc7d6ffd700 1 -- 172.21.15.78:0/962979818 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7dc01b440 con 0x7fc7cc003a20 2023-06-09T11:13:08.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.327+0000 7fc7d6ffd700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc7c40662f0 0x7fc7c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.327+0000 7fc7d6ffd700 1 -- 172.21.15.78:0/962979818 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc7dc084c50 con 0x7fc7cc003a20 2023-06-09T11:13:08.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.327+0000 7fc7e5cd2700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc7c40662f0 0x7fc7c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.327+0000 7fc7e5cd2700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc7c40662f0 0x7fc7c40687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7e014dde0 tx=0x7fc7d0000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:08.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.331+0000 7fc7d6ffd700 1 -- 172.21.15.78:0/962979818 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc7dc052410 con 0x7fc7cc003a20 2023-06-09T11:13:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.507+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7e006b350 con 0x7fc7cc003a20 2023-06-09T11:13:08.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.511+0000 7fc7d6ffd700 1 -- 172.21.15.78:0/962979818 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14603 (secure 0 0 0) 0x7fc7dc02a090 con 0x7fc7cc003a20 2023-06-09T11:13:08.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:08.519 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":33,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:04.857242+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:13:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc7c40662f0 msgr2=0x7fc7c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc7c40662f0 0x7fc7c40687a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7e014dde0 tx=0x7fc7d0000ed0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 msgr2=0x7fc7e015d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7e015d1b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0090b0 tx=0x7fc7dc0047e0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 shutdown_connections 2023-06-09T11:13:08.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc7c40662f0 0x7fc7c40687a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0150260 0x7fc7e01506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e014e5b0 0x7fc7e014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 --2- 172.21.15.78:0/962979818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc003a20 0x7fc7e015d1b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 >> 172.21.15.78:0/962979818 conn(0x7fc7e00b1480 msgr2=0x7fc7e00c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:08.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 shutdown_connections 2023-06-09T11:13:08.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.515+0000 7fc7e8737700 1 -- 172.21.15.78:0/962979818 wait complete. 2023-06-09T11:13:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T11:13:08.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:13:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.715+0000 7f2fb8924700 1 Processor -- start 2023-06-09T11:13:08.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.715+0000 7f2fb8924700 1 -- start start 2023-06-09T11:13:08.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb8924700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4146c50 0x7f2fb40b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb8924700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2fb4161610 0x7f2fb406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb8924700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb406a070 con 0x7f2fb406b6e0 2023-06-09T11:13:08.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb8924700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb406a310 con 0x7f2fb4161610 2023-06-09T11:13:08.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb8924700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb406a5f0 con 0x7f2fb4146c50 2023-06-09T11:13:08.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb2ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f2fb406b6e0 0x7f2fb4160f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:43398/0 (socket says 172.21.15.78:43398) 2023-06-09T11:13:08.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb2ffd700 1 -- 172.21.15.78:0/2582075168 learned_addr learned my addr 172.21.15.78:0/2582075168 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:08.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb37fe700 1 --2- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4146c50 0x7f2fb40b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb3fff700 1 --2- 172.21.15.78:0/2582075168 >> v2:172.21.15.187:3300/0 conn(0x7f2fb4161610 0x7f2fb406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb27fc700 1 -- 172.21.15.78:0/2582075168 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868155837 0 0) 0x7f2fb406a070 con 0x7f2fb406b6e0 2023-06-09T11:13:08.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb3fff700 1 -- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4146c50 msgr2=0x7f2fb40b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:08.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb3fff700 1 --2- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4146c50 0x7f2fb40b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.719+0000 7f2fb3fff700 1 -- 172.21.15.78:0/2582075168 >> v1:172.21.15.187:6789/0 conn(0x7f2fb406b6e0 legacy=0x7f2fb4160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb3fff700 1 -- 172.21.15.78:0/2582075168 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb406a8d0 con 0x7f2fb4161610 2023-06-09T11:13:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb3fff700 1 --2- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb4161610 0x7f2fb406d690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009d90 tx=0x7f2fac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a22b12526ad5f53c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb27fc700 1 -- 172.21.15.78:0/2582075168 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00e070 con 0x7f2fb4161610 2023-06-09T11:13:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb27fc700 1 -- 172.21.15.78:0/2582075168 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac00bb20 con 0x7f2fb4161610 2023-06-09T11:13:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb27fc700 1 -- 172.21.15.78:0/2582075168 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac012430 con 0x7f2fb4161610 2023-06-09T11:13:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 -- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb4161610 msgr2=0x7f2fb406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 --2- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb4161610 0x7f2fb406d690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009d90 tx=0x7f2fac00b330 comp rx=0 tx=0).stop 2023-06-09T11:13:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 -- 172.21.15.78:0/2582075168 shutdown_connections 2023-06-09T11:13:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 --2- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb4161610 0x7f2fb406d690 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 --2- 172.21.15.78:0/2582075168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4146c50 0x7f2fb40b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 -- 172.21.15.78:0/2582075168 >> 172.21.15.78:0/2582075168 conn(0x7f2fb40b0780 msgr2=0x7f2fb40b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 -- 172.21.15.78:0/2582075168 shutdown_connections 2023-06-09T11:13:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.723+0000 7f2fb8924700 1 -- 172.21.15.78:0/2582075168 wait complete. 2023-06-09T11:13:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 Processor -- start 2023-06-09T11:13:08.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 -- start start 2023-06-09T11:13:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406b6e0 0x7f2fb415d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4146c50 0x7f2fb4163590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4161610 0x7f2fb41455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40ca790 con 0x7f2fb4146c50 2023-06-09T11:13:08.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c8db0 con 0x7f2fb406b6e0 2023-06-09T11:13:08.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb8924700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40c9090 con 0x7f2fb4161610 2023-06-09T11:13:08.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4146c50 0x7f2fb4163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4146c50 0x7f2fb4163590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38602/0 (socket says 172.21.15.78:38602) 2023-06-09T11:13:08.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 -- 172.21.15.78:0/679790387 learned_addr learned my addr 172.21.15.78:0/679790387 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:08.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb37fe700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406b6e0 0x7f2fb415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb3fff700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4161610 0x7f2fb41455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 -- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4161610 msgr2=0x7f2fb41455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4161610 0x7f2fb41455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 -- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406b6e0 msgr2=0x7f2fb415d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406b6e0 0x7f2fb415d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.727+0000 7f2fb2ffd700 1 -- 172.21.15.78:0/679790387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac009a70 con 0x7f2fb4146c50 2023-06-09T11:13:08.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.731+0000 7f2fb2ffd700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4146c50 0x7f2fb4163590 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c4e0 tx=0x7f2fa800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:08.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.731+0000 7f2f9bfff700 1 -- 172.21.15.78:0/679790387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8004ca0 con 0x7f2fb4146c50 2023-06-09T11:13:08.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.731+0000 7f2f9bfff700 1 -- 172.21.15.78:0/679790387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa8004e20 con 0x7f2fb4146c50 2023-06-09T11:13:08.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.731+0000 7f2f9bfff700 1 -- 172.21.15.78:0/679790387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8007310 con 0x7f2fb4146c50 2023-06-09T11:13:08.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.731+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb406b0d0 con 0x7f2fb4146c50 2023-06-09T11:13:08.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.731+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb406abb0 con 0x7f2fb4146c50 2023-06-09T11:13:08.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.731+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb40b2ad0 con 0x7f2fb4146c50 2023-06-09T11:13:08.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.735+0000 7f2f9bfff700 1 -- 172.21.15.78:0/679790387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fa8007470 con 0x7f2fb4146c50 2023-06-09T11:13:08.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.735+0000 7f2f9bfff700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2fa00662f0 0x7f2fa00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.735+0000 7f2f9bfff700 1 -- 172.21.15.78:0/679790387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2fa80835b0 con 0x7f2fb4146c50 2023-06-09T11:13:08.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.735+0000 7f2fb37fe700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2fa00662f0 0x7f2fa00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.735+0000 7f2fb37fe700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2fa00662f0 0x7f2fa00687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009bf0 tx=0x7f2fa4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:08.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.743+0000 7f2f9bfff700 1 -- 172.21.15.78:0/679790387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2fa8050d70 con 0x7f2fb4146c50 2023-06-09T11:13:08.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.911+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fb4067610 con 0x7f2fb4146c50 2023-06-09T11:13:08.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.911+0000 7f2f9bfff700 1 -- 172.21.15.78:0/679790387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fa8007720 con 0x7f2fb4146c50 2023-06-09T11:13:08.920 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T11:13:08.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2fa00662f0 msgr2=0x7f2fa00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2fa00662f0 0x7f2fa00687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009bf0 tx=0x7f2fa4009240 comp rx=0 tx=0).stop 2023-06-09T11:13:08.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4146c50 msgr2=0x7f2fb4163590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:08.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4146c50 0x7f2fb4163590 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c4e0 tx=0x7f2fa800c7f0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 shutdown_connections 2023-06-09T11:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2fa00662f0 0x7f2fa00687a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb4161610 0x7f2fb41455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4146c50 0x7f2fb4163590 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 --2- 172.21.15.78:0/679790387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406b6e0 0x7f2fb415d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 >> 172.21.15.78:0/679790387 conn(0x7f2fb40b0780 msgr2=0x7f2fb40b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:08.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 shutdown_connections 2023-06-09T11:13:08.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:08.915+0000 7f2fb8924700 1 -- 172.21.15.78:0/679790387 wait complete. 2023-06-09T11:13:08.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:13:09.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0849c16700 1 Processor -- start 2023-06-09T11:13:09.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0849c16700 1 -- start start 2023-06-09T11:13:09.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0849c16700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08440cbdb0 0x7f08440c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0849c16700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440705f0 con 0x7f084406aee0 2023-06-09T11:13:09.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0849c16700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0844071190 con 0x7f084415a7c0 2023-06-09T11:13:09.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0849c16700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084406fa20 con 0x7f08440cbdb0 2023-06-09T11:13:09.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0842ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08440cbdb0 0x7f08440c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0842ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08440cbdb0 0x7f08440c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38618/0 (socket says 172.21.15.78:38618) 2023-06-09T11:13:09.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.115+0000 7f0842ffd700 1 -- 172.21.15.78:0/4157050189 learned_addr learned my addr 172.21.15.78:0/4157050189 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0842ffd700 1 -- 172.21.15.78:0/4157050189 >> v1:172.21.15.187:6789/0 conn(0x7f084415a7c0 legacy=0x7f0844070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0842ffd700 1 -- 172.21.15.78:0/4157050189 >> v1:172.21.15.78:6789/0 conn(0x7f084406aee0 legacy=0x7f08440b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0842ffd700 1 -- 172.21.15.78:0/4157050189 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084415ab90 con 0x7f08440cbdb0 2023-06-09T11:13:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0842ffd700 1 --2- 172.21.15.78:0/4157050189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08440c9270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0838009910 tx=0x7f0838009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d46922c1350e3a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f08427fc700 1 -- 172.21.15.78:0/4157050189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838004230 con 0x7f08440cbdb0 2023-06-09T11:13:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f08427fc700 1 -- 172.21.15.78:0/4157050189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838004390 con 0x7f08440cbdb0 2023-06-09T11:13:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f08427fc700 1 -- 172.21.15.78:0/4157050189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838009e60 con 0x7f08440cbdb0 2023-06-09T11:13:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0849c16700 1 -- 172.21.15.78:0/4157050189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 msgr2=0x7f08440c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0849c16700 1 --2- 172.21.15.78:0/4157050189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08440c9270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0838009910 tx=0x7f0838009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0849c16700 1 -- 172.21.15.78:0/4157050189 shutdown_connections 2023-06-09T11:13:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0849c16700 1 --2- 172.21.15.78:0/4157050189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08440c9270 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0849c16700 1 -- 172.21.15.78:0/4157050189 >> 172.21.15.78:0/4157050189 conn(0x7f08440cf8b0 msgr2=0x7f08440cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0849c16700 1 -- 172.21.15.78:0/4157050189 shutdown_connections 2023-06-09T11:13:09.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.119+0000 7f0849c16700 1 -- 172.21.15.78:0/4157050189 wait complete. 2023-06-09T11:13:09.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.123+0000 7f0849c16700 1 Processor -- start 2023-06-09T11:13:09.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.123+0000 7f0849c16700 1 -- start start 2023-06-09T11:13:09.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084406aee0 0x7f08440b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08441585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f084415a7c0 0x7f0844158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844159050 con 0x7f08440cbdb0 2023-06-09T11:13:09.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844159300 con 0x7f084406aee0 2023-06-09T11:13:09.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084414aa30 con 0x7f084415a7c0 2023-06-09T11:13:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08441585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08441585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38624/0 (socket says 172.21.15.78:38624) 2023-06-09T11:13:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 -- 172.21.15.78:0/2996654947 learned_addr learned my addr 172.21.15.78:0/2996654947 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f08437fe700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084406aee0 0x7f08440b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0843fff700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f084415a7c0 0x7f0844158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 -- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f084415a7c0 msgr2=0x7f0844158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f084415a7c0 0x7f0844158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 -- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084406aee0 msgr2=0x7f08440b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084406aee0 0x7f08440b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 -- 172.21.15.78:0/2996654947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009570 con 0x7f08440cbdb0 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0843fff700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f084415a7c0 0x7f0844158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f08437fe700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084406aee0 0x7f08440b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0842ffd700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08441585d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0838004000 tx=0x7f0838004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f082bfff700 1 -- 172.21.15.78:0/2996654947 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800be00 con 0x7f08440cbdb0 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f082bfff700 1 -- 172.21.15.78:0/2996654947 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083801f070 con 0x7f08440cbdb0 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084406ffa0 con 0x7f08440cbdb0 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f082bfff700 1 -- 172.21.15.78:0/2996654947 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838003900 con 0x7f08440cbdb0 2023-06-09T11:13:09.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084406fcc0 con 0x7f08440cbdb0 2023-06-09T11:13:09.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.127+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0844070280 con 0x7f08440cbdb0 2023-06-09T11:13:09.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.131+0000 7f082bfff700 1 -- 172.21.15.78:0/2996654947 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0838021030 con 0x7f08440cbdb0 2023-06-09T11:13:09.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.131+0000 7f082bfff700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08300662f0 0x7f08300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.131+0000 7f082bfff700 1 -- 172.21.15.78:0/2996654947 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0838085140 con 0x7f08440cbdb0 2023-06-09T11:13:09.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.131+0000 7f08437fe700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08300662f0 0x7f08300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.135+0000 7f08437fe700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08300662f0 0x7f08300687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f083400a8f0 tx=0x7f0834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.139+0000 7f082bfff700 1 -- 172.21.15.78:0/2996654947 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0838052900 con 0x7f08440cbdb0 2023-06-09T11:13:09.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.307+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0844070280 con 0x7f08440cbdb0 2023-06-09T11:13:09.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.307+0000 7f082bfff700 1 -- 172.21.15.78:0/2996654947 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0838055f20 con 0x7f08440cbdb0 2023-06-09T11:13:09.316 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T11:13:09.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08300662f0 msgr2=0x7f08300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08300662f0 0x7f08300687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f083400a8f0 tx=0x7f0834008040 comp rx=0 tx=0).stop 2023-06-09T11:13:09.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 msgr2=0x7f08441585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08441585d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0838004000 tx=0x7f0838004770 comp rx=0 tx=0).stop 2023-06-09T11:13:09.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 shutdown_connections 2023-06-09T11:13:09.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08300662f0 0x7f08300687a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f084415a7c0 0x7f0844158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08440cbdb0 0x7f08441585d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 --2- 172.21.15.78:0/2996654947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084406aee0 0x7f08440b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 >> 172.21.15.78:0/2996654947 conn(0x7f08440cf8b0 msgr2=0x7f08440afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:09.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 shutdown_connections 2023-06-09T11:13:09.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.311+0000 7f0849c16700 1 -- 172.21.15.78:0/2996654947 wait complete. 2023-06-09T11:13:09.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T11:13:09.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee3ea62700 1 Processor -- start 2023-06-09T11:13:09.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee3ea62700 1 -- start start 2023-06-09T11:13:09.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee3ea62700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee3815a3e0 0x7fee3806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee3ea62700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee380ce470 0x7fee3806f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee3ea62700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee380cc8e0 con 0x7fee3815df60 2023-06-09T11:13:09.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee3ea62700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3815a7b0 con 0x7fee3815a3e0 2023-06-09T11:13:09.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee3ea62700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee380ccb80 con 0x7fee380ce470 2023-06-09T11:13:09.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee37fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee3815a3e0 0x7fee3806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee37fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee3815a3e0 0x7fee3806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38628/0 (socket says 172.21.15.78:38628) 2023-06-09T11:13:09.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee37fff700 1 -- 172.21.15.78:0/1274581369 learned_addr learned my addr 172.21.15.78:0/1274581369 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:09.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee377fe700 1 --2- 172.21.15.78:0/1274581369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee380ce470 0x7fee3806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.507+0000 7fee37fff700 1 -- 172.21.15.78:0/1274581369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee380ce470 msgr2=0x7fee3806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:09.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee37fff700 1 --2- 172.21.15.78:0/1274581369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee380ce470 0x7fee3806f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee37fff700 1 -- 172.21.15.78:0/1274581369 >> v1:172.21.15.78:6789/0 conn(0x7fee3815df60 legacy=0x7fee38070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee37fff700 1 -- 172.21.15.78:0/1274581369 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3806b470 con 0x7fee3815a3e0 2023-06-09T11:13:09.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee377fe700 1 --2- 172.21.15.78:0/1274581369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee380ce470 0x7fee3806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:09.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee37fff700 1 --2- 172.21.15.78:0/1274581369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815a3e0 0x7fee3806e960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fee30009910 tx=0x7fee30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56969cbc19e6e2f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee36ffd700 1 -- 172.21.15.78:0/1274581369 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000ba60 con 0x7fee3815a3e0 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee36ffd700 1 -- 172.21.15.78:0/1274581369 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3000bbc0 con 0x7fee3815a3e0 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee36ffd700 1 -- 172.21.15.78:0/1274581369 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30009e60 con 0x7fee3815a3e0 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 -- 172.21.15.78:0/1274581369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815a3e0 msgr2=0x7fee3806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1274581369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815a3e0 0x7fee3806e960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fee30009910 tx=0x7fee30009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 -- 172.21.15.78:0/1274581369 shutdown_connections 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1274581369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee380ce470 0x7fee3806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1274581369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815a3e0 0x7fee3806e960 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 -- 172.21.15.78:0/1274581369 >> 172.21.15.78:0/1274581369 conn(0x7fee380cf670 msgr2=0x7fee380cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:09.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 -- 172.21.15.78:0/1274581369 shutdown_connections 2023-06-09T11:13:09.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.511+0000 7fee3ea62700 1 -- 172.21.15.78:0/1274581369 wait complete. 2023-06-09T11:13:09.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 Processor -- start 2023-06-09T11:13:09.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 -- start start 2023-06-09T11:13:09.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee380ce470 0x7fee381f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee3815a3e0 0x7fee380ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815df60 0x7fee381552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee381e4090 con 0x7fee3815df60 2023-06-09T11:13:09.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee381f2310 con 0x7fee380ce470 2023-06-09T11:13:09.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.515+0000 7fee3ea62700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee380b04f0 con 0x7fee3815a3e0 2023-06-09T11:13:09.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815df60 0x7fee381552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815df60 0x7fee381552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38632/0 (socket says 172.21.15.78:38632) 2023-06-09T11:13:09.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 -- 172.21.15.78:0/1546651160 learned_addr learned my addr 172.21.15.78:0/1546651160 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:09.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee37fff700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee380ce470 0x7fee381f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee377fe700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee3815a3e0 0x7fee380ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 -- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee3815a3e0 msgr2=0x7fee380ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee3815a3e0 0x7fee380ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 -- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee380ce470 msgr2=0x7fee381f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee380ce470 0x7fee381f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 -- 172.21.15.78:0/1546651160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009570 con 0x7fee3815df60 2023-06-09T11:13:09.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3cfff700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815df60 0x7fee381552e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c430 tx=0x7fee2000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee34ff9700 1 -- 172.21.15.78:0/1546651160 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee200052d0 con 0x7fee3815df60 2023-06-09T11:13:09.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee34ff9700 1 -- 172.21.15.78:0/1546651160 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee20005430 con 0x7fee3815df60 2023-06-09T11:13:09.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3815e3e0 con 0x7fee3815df60 2023-06-09T11:13:09.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee34ff9700 1 -- 172.21.15.78:0/1546651160 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee200055a0 con 0x7fee3815df60 2023-06-09T11:13:09.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3806b750 con 0x7fee3815df60 2023-06-09T11:13:09.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.519+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3815e570 con 0x7fee3815df60 2023-06-09T11:13:09.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.523+0000 7fee34ff9700 1 -- 172.21.15.78:0/1546651160 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee200038e0 con 0x7fee3815df60 2023-06-09T11:13:09.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.523+0000 7fee34ff9700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee180662f0 0x7fee180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.523+0000 7fee34ff9700 1 -- 172.21.15.78:0/1546651160 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fee20082d10 con 0x7fee3815df60 2023-06-09T11:13:09.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.527+0000 7fee37fff700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee180662f0 0x7fee180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.527+0000 7fee37fff700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee180662f0 0x7fee180687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee30009c60 tx=0x7fee30008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.531+0000 7fee34ff9700 1 -- 172.21.15.78:0/1546651160 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fee20050570 con 0x7fee3815df60 2023-06-09T11:13:09.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.711+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fee380b09e0 con 0x7fee3815df60 2023-06-09T11:13:09.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.711+0000 7fee34ff9700 1 -- 172.21.15.78:0/1546651160 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7fee20053b90 con 0x7fee3815df60 2023-06-09T11:13:09.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:09.722 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-06-09T11:13:09.722 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:09.722 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-06-09T11:13:09.722 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-06-09T11:13:09.722 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-09T11:13:09.723 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-09T11:13:09.723 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-06-09T11:13:09.723 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-06-09T11:13:09.723 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-09T11:13:09.724 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-06-09T11:13:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee180662f0 msgr2=0x7fee180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee180662f0 0x7fee180687a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee30009c60 tx=0x7fee30008030 comp rx=0 tx=0).stop 2023-06-09T11:13:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815df60 msgr2=0x7fee381552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815df60 0x7fee381552e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c430 tx=0x7fee2000c7f0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 shutdown_connections 2023-06-09T11:13:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fee180662f0 0x7fee180687a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee3815df60 0x7fee381552e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee3815a3e0 0x7fee380ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 --2- 172.21.15.78:0/1546651160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee380ce470 0x7fee381f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 >> 172.21.15.78:0/1546651160 conn(0x7fee380cf670 msgr2=0x7fee380b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:09.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 shutdown_connections 2023-06-09T11:13:09.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.715+0000 7fee3ea62700 1 -- 172.21.15.78:0/1546651160 wait complete. 2023-06-09T11:13:09.744 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T11:13:09.745 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T11:13:09.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.919+0000 7fcc9359e700 1 Processor -- start 2023-06-09T11:13:09.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.919+0000 7fcc9359e700 1 -- start start 2023-06-09T11:13:09.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc941428c0 0x7fcc9406a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc9359e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcc940b6a30 0x7fcc9406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc9359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc9406ebe0 0x7fcc9406f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc9359e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9406abc0 con 0x7fcc9406ebe0 2023-06-09T11:13:09.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc9359e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9406ba00 con 0x7fcc940b6a30 2023-06-09T11:13:09.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc9359e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9406f020 con 0x7fcc941428c0 2023-06-09T11:13:09.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc92d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc9406ebe0 0x7fcc9406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc9259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc941428c0 0x7fcc9406a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc91d9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcc940b6a30 0x7fcc9406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc92d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc9406ebe0 0x7fcc9406f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38648/0 (socket says 172.21.15.78:38648) 2023-06-09T11:13:09.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.923+0000 7fcc92d9d700 1 -- 172.21.15.78:0/3710961840 learned_addr learned my addr 172.21.15.78:0/3710961840 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:09.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc92d9d700 1 -- 172.21.15.78:0/3710961840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc941428c0 msgr2=0x7fcc9406a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:09.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc92d9d700 1 --2- 172.21.15.78:0/3710961840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc941428c0 0x7fcc9406a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc92d9d700 1 -- 172.21.15.78:0/3710961840 >> v2:172.21.15.187:3300/0 conn(0x7fcc940b6a30 msgr2=0x7fcc9406e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:09.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc92d9d700 1 --2- 172.21.15.78:0/3710961840 >> v2:172.21.15.187:3300/0 conn(0x7fcc940b6a30 0x7fcc9406e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc92d9d700 1 -- 172.21.15.78:0/3710961840 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9406adf0 con 0x7fcc9406ebe0 2023-06-09T11:13:09.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc92d9d700 1 --2- 172.21.15.78:0/3710961840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9406ebe0 0x7fcc9406f880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcc940d3600 tx=0x7fcc8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db299ba7a4d4cb6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9159a700 1 -- 172.21.15.78:0/3710961840 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00e070 con 0x7fcc9406ebe0 2023-06-09T11:13:09.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9159a700 1 -- 172.21.15.78:0/3710961840 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00b910 con 0x7fcc9406ebe0 2023-06-09T11:13:09.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9159a700 1 -- 172.21.15.78:0/3710961840 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00bcc0 con 0x7fcc9406ebe0 2023-06-09T11:13:09.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 -- 172.21.15.78:0/3710961840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9406ebe0 msgr2=0x7fcc9406f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 --2- 172.21.15.78:0/3710961840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9406ebe0 0x7fcc9406f880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcc940d3600 tx=0x7fcc8c00b330 comp rx=0 tx=0).stop 2023-06-09T11:13:09.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 -- 172.21.15.78:0/3710961840 shutdown_connections 2023-06-09T11:13:09.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 --2- 172.21.15.78:0/3710961840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9406ebe0 0x7fcc9406f880 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 --2- 172.21.15.78:0/3710961840 >> v2:172.21.15.187:3300/0 conn(0x7fcc940b6a30 0x7fcc9406e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 --2- 172.21.15.78:0/3710961840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc941428c0 0x7fcc9406a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 -- 172.21.15.78:0/3710961840 >> 172.21.15.78:0/3710961840 conn(0x7fcc940b57d0 msgr2=0x7fcc940d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:09.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 -- 172.21.15.78:0/3710961840 shutdown_connections 2023-06-09T11:13:09.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.927+0000 7fcc9359e700 1 -- 172.21.15.78:0/3710961840 wait complete. 2023-06-09T11:13:09.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 Processor -- start 2023-06-09T11:13:09.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 -- start start 2023-06-09T11:13:09.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9406ebe0 0x7fcc9415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc940b6a30 0x7fcc941fa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc941428c0 0x7fcc94142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940d1350 con 0x7fcc940b6a30 2023-06-09T11:13:09.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940d1bd0 con 0x7fcc941428c0 2023-06-09T11:13:09.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9359e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc94141e80 con 0x7fcc9406ebe0 2023-06-09T11:13:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc91d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc940b6a30 0x7fcc941fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc91d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc940b6a30 0x7fcc941fa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38654/0 (socket says 172.21.15.78:38654) 2023-06-09T11:13:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc91d9b700 1 -- 172.21.15.78:0/759664223 learned_addr learned my addr 172.21.15.78:0/759664223 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc92d9d700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc941428c0 0x7fcc94142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc9259c700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9406ebe0 0x7fcc9415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc91d9b700 1 -- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9406ebe0 msgr2=0x7fcc9415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.931+0000 7fcc91d9b700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9406ebe0 0x7fcc9415ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc91d9b700 1 -- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc941428c0 msgr2=0x7fcc94142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc91d9b700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc941428c0 0x7fcc94142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc91d9b700 1 -- 172.21.15.78:0/759664223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c009b30 con 0x7fcc940b6a30 2023-06-09T11:13:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc9259c700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9406ebe0 0x7fcc9415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:09.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc92d9d700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc941428c0 0x7fcc94142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:09.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc91d9b700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc940b6a30 0x7fcc941fa190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9d0 tx=0x7fcc8800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc82ffd700 1 -- 172.21.15.78:0/759664223 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88009720 con 0x7fcc940b6a30 2023-06-09T11:13:09.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc82ffd700 1 -- 172.21.15.78:0/759664223 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800c850 con 0x7fcc940b6a30 2023-06-09T11:13:09.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc82ffd700 1 -- 172.21.15.78:0/759664223 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800cbc0 con 0x7fcc940b6a30 2023-06-09T11:13:09.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9406b3b0 con 0x7fcc940b6a30 2023-06-09T11:13:09.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9406b0d0 con 0x7fcc940b6a30 2023-06-09T11:13:09.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9406b690 con 0x7fcc940b6a30 2023-06-09T11:13:09.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.935+0000 7fcc82ffd700 1 -- 172.21.15.78:0/759664223 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc8800cd20 con 0x7fcc940b6a30 2023-06-09T11:13:09.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.939+0000 7fcc82ffd700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcc74066320 0x7fcc740687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:09.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.939+0000 7fcc82ffd700 1 -- 172.21.15.78:0/759664223 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcc88083ac0 con 0x7fcc940b6a30 2023-06-09T11:13:09.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.939+0000 7fcc9259c700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcc74066320 0x7fcc740687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:09.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.939+0000 7fcc9259c700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcc74066320 0x7fcc740687d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009b20 tx=0x7fcc84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:09.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:09.943+0000 7fcc82ffd700 1 -- 172.21.15.78:0/759664223 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcc88054d20 con 0x7fcc940b6a30 2023-06-09T11:13:10.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.111+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcc940d1d80 con 0x7fcc940b6a30 2023-06-09T11:13:10.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.631+0000 7fcc82ffd700 1 -- 172.21.15.78:0/759664223 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcc940d1d80 con 0x7fcc940b6a30 2023-06-09T11:13:10.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.635+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcc74066320 msgr2=0x7fcc740687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:10.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.635+0000 7fcc9359e700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcc74066320 0x7fcc740687d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009b20 tx=0x7fcc84008040 comp rx=0 tx=0).stop 2023-06-09T11:13:10.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.635+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc940b6a30 msgr2=0x7fcc941fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:10.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.635+0000 7fcc9359e700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc940b6a30 0x7fcc941fa190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9d0 tx=0x7fcc8800ed90 comp rx=0 tx=0).stop 2023-06-09T11:13:10.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 shutdown_connections 2023-06-09T11:13:10.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fcc74066320 0x7fcc740687d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc941428c0 0x7fcc94142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc940b6a30 0x7fcc941fa190 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 --2- 172.21.15.78:0/759664223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9406ebe0 0x7fcc9415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 >> 172.21.15.78:0/759664223 conn(0x7fcc940b57d0 msgr2=0x7fcc9415edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 shutdown_connections 2023-06-09T11:13:10.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.639+0000 7fcc9359e700 1 -- 172.21.15.78:0/759664223 wait complete. 2023-06-09T11:13:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-06-09T11:13:10.672 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T11:13:10.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.843+0000 7f7decc45700 1 Processor -- start 2023-06-09T11:13:10.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.843+0000 7f7decc45700 1 -- start start 2023-06-09T11:13:10.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7decc45700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7de80c3e00 0x7f7de806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7decc45700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7de80c41d0 0x7f7de8160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7decc45700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7decc45700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de8069ed0 con 0x7f7de80c41d0 2023-06-09T11:13:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7decc45700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de8160770 con 0x7f7de80c3e00 2023-06-09T11:13:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7decc45700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8160980 con 0x7f7de806a5e0 2023-06-09T11:13:10.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7de6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7de80c41d0 0x7f7de8160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7de6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7de80c41d0 0x7f7de8160230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38668/0 (socket says 172.21.15.78:38668) 2023-06-09T11:13:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7de6ffd700 1 -- 172.21.15.78:0/3087087313 learned_addr learned my addr 172.21.15.78:0/3087087313 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7de77fe700 1 --2- 172.21.15.78:0/3087087313 >> v2:172.21.15.187:3300/0 conn(0x7f7de80c3e00 0x7f7de806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.847+0000 7f7de7fff700 1 --2- 172.21.15.78:0/3087087313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de6ffd700 1 -- 172.21.15.78:0/3087087313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 msgr2=0x7f7de806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de6ffd700 1 --2- 172.21.15.78:0/3087087313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de6ffd700 1 -- 172.21.15.78:0/3087087313 >> v2:172.21.15.187:3300/0 conn(0x7f7de80c3e00 msgr2=0x7f7de806b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de6ffd700 1 --2- 172.21.15.78:0/3087087313 >> v2:172.21.15.187:3300/0 conn(0x7f7de80c3e00 0x7f7de806b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de6ffd700 1 -- 172.21.15.78:0/3087087313 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8160c60 con 0x7f7de80c41d0 2023-06-09T11:13:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de7fff700 1 --2- 172.21.15.78:0/3087087313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:13:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de77fe700 1 --2- 172.21.15.78:0/3087087313 >> v2:172.21.15.187:3300/0 conn(0x7f7de80c3e00 0x7f7de806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:13:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de6ffd700 1 --2- 172.21.15.78:0/3087087313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de8160230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7de80cb550 tx=0x7f7ddc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01d60baf1016f7d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de67fc700 1 -- 172.21.15.78:0/3087087313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc011830 con 0x7f7de80c41d0 2023-06-09T11:13:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de67fc700 1 -- 172.21.15.78:0/3087087313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc011990 con 0x7f7de80c41d0 2023-06-09T11:13:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7de67fc700 1 -- 172.21.15.78:0/3087087313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc011d20 con 0x7f7de80c41d0 2023-06-09T11:13:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 -- 172.21.15.78:0/3087087313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 msgr2=0x7f7de8160230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 --2- 172.21.15.78:0/3087087313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de8160230 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7de80cb550 tx=0x7f7ddc009bf0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 -- 172.21.15.78:0/3087087313 shutdown_connections 2023-06-09T11:13:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 --2- 172.21.15.78:0/3087087313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 --2- 172.21.15.78:0/3087087313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de8160230 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 --2- 172.21.15.78:0/3087087313 >> v2:172.21.15.187:3300/0 conn(0x7f7de80c3e00 0x7f7de806b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 -- 172.21.15.78:0/3087087313 >> 172.21.15.78:0/3087087313 conn(0x7f7de80ceb00 msgr2=0x7f7de80cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 -- 172.21.15.78:0/3087087313 shutdown_connections 2023-06-09T11:13:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.851+0000 7f7decc45700 1 -- 172.21.15.78:0/3087087313 wait complete. 2023-06-09T11:13:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 Processor -- start 2023-06-09T11:13:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 -- start start 2023-06-09T11:13:10.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de80c3e00 0x7f7de80b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de815f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b1b40 con 0x7f7de80c41d0 2023-06-09T11:13:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b1e20 con 0x7f7de80c3e00 2023-06-09T11:13:10.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.855+0000 7f7decc45700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b2100 con 0x7f7de806a5e0 2023-06-09T11:13:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de815f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38676/0 (socket says 172.21.15.78:38676) 2023-06-09T11:13:10.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 -- 172.21.15.78:0/3112744381 learned_addr learned my addr 172.21.15.78:0/3112744381 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de6ffd700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de80c3e00 0x7f7de80b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de77fe700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 -- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 msgr2=0x7f7de814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 -- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de80c3e00 msgr2=0x7f7de80b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de80c3e00 0x7f7de80b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:10.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 -- 172.21.15.78:0/3112744381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de0009a70 con 0x7f7de80c41d0 2023-06-09T11:13:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7de7fff700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de815f130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7de000eed0 tx=0x7f7de000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7dcffff700 1 -- 172.21.15.78:0/3112744381 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0010040 con 0x7f7de80c41d0 2023-06-09T11:13:10.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7dcffff700 1 -- 172.21.15.78:0/3112744381 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de000ba80 con 0x7f7de80c41d0 2023-06-09T11:13:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7dcffff700 1 -- 172.21.15.78:0/3112744381 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de000be10 con 0x7f7de80c41d0 2023-06-09T11:13:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd80094b0 con 0x7f7de80c41d0 2023-06-09T11:13:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc009570 con 0x7f7de80c41d0 2023-06-09T11:13:10.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.859+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de806a0e0 con 0x7f7de80c41d0 2023-06-09T11:13:10.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.863+0000 7f7dcffff700 1 -- 172.21.15.78:0/3112744381 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7de0003a40 con 0x7f7de80c41d0 2023-06-09T11:13:10.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.863+0000 7f7dcffff700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7dd40662f0 0x7f7dd40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:10.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.863+0000 7f7dcffff700 1 -- 172.21.15.78:0/3112744381 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7de00846f0 con 0x7f7de80c41d0 2023-06-09T11:13:10.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.867+0000 7f7de77fe700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7dd40662f0 0x7f7dd40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.867+0000 7f7de77fe700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7dd40662f0 0x7f7dd40687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009d80 tx=0x7f7dd8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:10.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:10.871+0000 7f7dcffff700 1 -- 172.21.15.78:0/3112744381 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7de0051dc0 con 0x7f7de80c41d0 2023-06-09T11:13:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.039+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7de806aa60 con 0x7f7de80c41d0 2023-06-09T11:13:11.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.639+0000 7f7dcffff700 1 -- 172.21.15.78:0/3112744381 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7de00553e0 con 0x7f7de80c41d0 2023-06-09T11:13:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.647+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7dd40662f0 msgr2=0x7f7dd40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.647+0000 7f7decc45700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7dd40662f0 0x7f7dd40687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009d80 tx=0x7f7dd8009240 comp rx=0 tx=0).stop 2023-06-09T11:13:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.647+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 msgr2=0x7f7de815f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:11.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.651+0000 7f7decc45700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de815f130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7de000eed0 tx=0x7f7de000b390 comp rx=0 tx=0).stop 2023-06-09T11:13:11.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.655+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 shutdown_connections 2023-06-09T11:13:11.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.655+0000 7f7decc45700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7dd40662f0 0x7f7dd40687a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:11.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.655+0000 7f7decc45700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7de80c41d0 0x7f7de815f130 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:11.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.655+0000 7f7decc45700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7de80c3e00 0x7f7de80b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:11.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.655+0000 7f7decc45700 1 --2- 172.21.15.78:0/3112744381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7de806a5e0 0x7f7de814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:11.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.655+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 >> 172.21.15.78:0/3112744381 conn(0x7f7de80ceb00 msgr2=0x7f7de80abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:11.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.659+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 shutdown_connections 2023-06-09T11:13:11.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.659+0000 7f7decc45700 1 -- 172.21.15.78:0/3112744381 wait complete. 2023-06-09T11:13:11.673 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-06-09T11:13:11.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T11:13:11.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.851+0000 7fe966a16700 1 Processor -- start 2023-06-09T11:13:11.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.851+0000 7fe966a16700 1 -- start start 2023-06-09T11:13:11.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe966a16700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9600cbdb0 0x7fe9600c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:11.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe966a16700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9600705f0 con 0x7fe96006aee0 2023-06-09T11:13:11.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe966a16700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe960071190 con 0x7fe96015a7c0 2023-06-09T11:13:11.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe966a16700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96006fa20 con 0x7fe9600cbdb0 2023-06-09T11:13:11.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe9577fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9600cbdb0 0x7fe9600c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:11.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe9577fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe9600cbdb0 0x7fe9600c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38682/0 (socket says 172.21.15.78:38682) 2023-06-09T11:13:11.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe964fb3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe96006aee0 0x7fe9600b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52112/0 (socket says 172.21.15.78:52112) 2023-06-09T11:13:11.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe9577fe700 1 -- 172.21.15.78:0/3421815994 learned_addr learned my addr 172.21.15.78:0/3421815994 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:11.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe9577fe700 1 -- 172.21.15.78:0/3421815994 >> v1:172.21.15.187:6789/0 conn(0x7fe96015a7c0 legacy=0x7fe960070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:11.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe9577fe700 1 -- 172.21.15.78:0/3421815994 >> v1:172.21.15.78:6789/0 conn(0x7fe96006aee0 legacy=0x7fe9600b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:11.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe9577fe700 1 -- 172.21.15.78:0/3421815994 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96015ab90 con 0x7fe9600cbdb0 2023-06-09T11:13:11.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe95f7fe700 1 -- 172.21.15.78:0/3421815994 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054733939 0 0) 0x7fe9600705f0 con 0x7fe96006aee0 2023-06-09T11:13:11.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe9577fe700 1 --2- 172.21.15.78:0/3421815994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9600cbdb0 0x7fe9600c9270 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe948009910 tx=0x7fe948009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a8aea322213d73 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:11.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe95f7fe700 1 -- 172.21.15.78:0/3421815994 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94800ba60 con 0x7fe9600cbdb0 2023-06-09T11:13:11.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe95f7fe700 1 -- 172.21.15.78:0/3421815994 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94800bbc0 con 0x7fe9600cbdb0 2023-06-09T11:13:11.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe95f7fe700 1 -- 172.21.15.78:0/3421815994 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948009e60 con 0x7fe9600cbdb0 2023-06-09T11:13:11.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe966a16700 1 -- 172.21.15.78:0/3421815994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9600cbdb0 msgr2=0x7fe9600c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:11.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.855+0000 7fe966a16700 1 --2- 172.21.15.78:0/3421815994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9600cbdb0 0x7fe9600c9270 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe948009910 tx=0x7fe948009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:11.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.859+0000 7fe966a16700 1 -- 172.21.15.78:0/3421815994 shutdown_connections 2023-06-09T11:13:11.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.859+0000 7fe966a16700 1 --2- 172.21.15.78:0/3421815994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9600cbdb0 0x7fe9600c9270 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:11.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.859+0000 7fe966a16700 1 -- 172.21.15.78:0/3421815994 >> 172.21.15.78:0/3421815994 conn(0x7fe9600cf8b0 msgr2=0x7fe9600cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:11.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.859+0000 7fe966a16700 1 -- 172.21.15.78:0/3421815994 shutdown_connections 2023-06-09T11:13:11.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.859+0000 7fe966a16700 1 -- 172.21.15.78:0/3421815994 wait complete. 2023-06-09T11:13:11.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.859+0000 7fe966a16700 1 Processor -- start 2023-06-09T11:13:11.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.859+0000 7fe966a16700 1 -- start start 2023-06-09T11:13:11.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe96006aee0 0x7fe960158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:11.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9600cbdb0 0x7fe9600cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96015a7c0 0x7fe9600ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600acca0 con 0x7fe96015a7c0 2023-06-09T11:13:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600ad7e0 con 0x7fe9600cbdb0 2023-06-09T11:13:11.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600aceb0 con 0x7fe96006aee0 2023-06-09T11:13:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96015a7c0 0x7fe9600ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:11.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96015a7c0 0x7fe9600ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38698/0 (socket says 172.21.15.78:38698) 2023-06-09T11:13:11.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 -- 172.21.15.78:0/3470476593 learned_addr learned my addr 172.21.15.78:0/3470476593 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:11.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe95ffff700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe96006aee0 0x7fe960158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:11.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe9577fe700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9600cbdb0 0x7fe9600cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:11.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 -- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe96006aee0 msgr2=0x7fe960158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:11.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe96006aee0 0x7fe960158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:11.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 -- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9600cbdb0 msgr2=0x7fe9600cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:11.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9600cbdb0 0x7fe9600cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:11.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 -- 172.21.15.78:0/3470476593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe948009570 con 0x7fe96015a7c0 2023-06-09T11:13:11.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe964fb3700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96015a7c0 0x7fe9600ce300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe958002230 tx=0x7fe95800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:11.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe95d7fa700 1 -- 172.21.15.78:0/3470476593 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800ac20 con 0x7fe96015a7c0 2023-06-09T11:13:11.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe95d7fa700 1 -- 172.21.15.78:0/3470476593 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95800ada0 con 0x7fe96015a7c0 2023-06-09T11:13:11.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96006ffa0 con 0x7fe96015a7c0 2023-06-09T11:13:11.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe95d7fa700 1 -- 172.21.15.78:0/3470476593 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958007310 con 0x7fe96015a7c0 2023-06-09T11:13:11.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.863+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96006fcc0 con 0x7fe96015a7c0 2023-06-09T11:13:11.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.867+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe960070280 con 0x7fe96015a7c0 2023-06-09T11:13:11.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.867+0000 7fe95d7fa700 1 -- 172.21.15.78:0/3470476593 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe958007470 con 0x7fe96015a7c0 2023-06-09T11:13:11.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.871+0000 7fe95d7fa700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9440662f0 0x7fe9440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:11.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.871+0000 7fe95d7fa700 1 -- 172.21.15.78:0/3470476593 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe9580838c0 con 0x7fe96015a7c0 2023-06-09T11:13:11.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.871+0000 7fe95ffff700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9440662f0 0x7fe9440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.871+0000 7fe95ffff700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9440662f0 0x7fe9440687a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe960159350 tx=0x7fe950009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:11.875+0000 7fe95d7fa700 1 -- 172.21.15.78:0/3470476593 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe958050d00 con 0x7fe96015a7c0 2023-06-09T11:13:12.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.087+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe9600ad590 con 0x7fe96015a7c0 2023-06-09T11:13:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.099+0000 7fe95d7fa700 1 -- 172.21.15.78:0/3470476593 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe9580180c0 con 0x7fe96015a7c0 2023-06-09T11:13:12.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.107+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9440662f0 msgr2=0x7fe9440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.107+0000 7fe966a16700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9440662f0 0x7fe9440687a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe960159350 tx=0x7fe950009040 comp rx=0 tx=0).stop 2023-06-09T11:13:12.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.107+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96015a7c0 msgr2=0x7fe9600ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.107+0000 7fe966a16700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96015a7c0 0x7fe9600ce300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe958002230 tx=0x7fe95800a060 comp rx=0 tx=0).stop 2023-06-09T11:13:12.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 shutdown_connections 2023-06-09T11:13:12.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9440662f0 0x7fe9440687a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe96015a7c0 0x7fe9600ce300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9600cbdb0 0x7fe9600cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 --2- 172.21.15.78:0/3470476593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe96006aee0 0x7fe960158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 >> 172.21.15.78:0/3470476593 conn(0x7fe9600cf8b0 msgr2=0x7fe9600b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:12.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 shutdown_connections 2023-06-09T11:13:12.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.115+0000 7fe966a16700 1 -- 172.21.15.78:0/3470476593 wait complete. 2023-06-09T11:13:12.130 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 5 and data pool 6 2023-06-09T11:13:12.151 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:13:12.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.307+0000 7fc782786700 1 Processor -- start 2023-06-09T11:13:12.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.307+0000 7fc782786700 1 -- start start 2023-06-09T11:13:12.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc77c0c7f70 0x7fc77c0d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc77c15ca40 0x7fc77c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c0c8d40 con 0x7fc77c15c670 2023-06-09T11:13:12.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c0c84a0 con 0x7fc77c15ca40 2023-06-09T11:13:12.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c0c8780 con 0x7fc77c0c7f70 2023-06-09T11:13:12.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc77c15ca40 0x7fc77c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc77c15ca40 0x7fc77c0cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38712/0 (socket says 172.21.15.78:38712) 2023-06-09T11:13:12.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 -- 172.21.15.78:0/1499704238 learned_addr learned my addr 172.21.15.78:0/1499704238 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:12.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc7737fe700 1 --2- 172.21.15.78:0/1499704238 >> v2:172.21.15.187:3300/0 conn(0x7fc77c0c7f70 0x7fc77c0d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 -- 172.21.15.78:0/1499704238 >> v2:172.21.15.187:3300/0 conn(0x7fc77c0c7f70 msgr2=0x7fc77c0d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:12.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 --2- 172.21.15.78:0/1499704238 >> v2:172.21.15.187:3300/0 conn(0x7fc77c0c7f70 0x7fc77c0d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 -- 172.21.15.78:0/1499704238 >> v1:172.21.15.187:6789/0 conn(0x7fc77c15c670 legacy=0x7fc77c160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:12.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 -- 172.21.15.78:0/1499704238 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c0c8a60 con 0x7fc77c15ca40 2023-06-09T11:13:12.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc780d23700 1 --2- 172.21.15.78:0/1499704238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15ca40 0x7fc77c0cf910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0c9f30 tx=0x7fc77400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7a89952dd562c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:12.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc77b7fe700 1 -- 172.21.15.78:0/1499704238 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400e070 con 0x7fc77c15ca40 2023-06-09T11:13:12.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc77b7fe700 1 -- 172.21.15.78:0/1499704238 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774003a40 con 0x7fc77c15ca40 2023-06-09T11:13:12.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc77b7fe700 1 -- 172.21.15.78:0/1499704238 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774003df0 con 0x7fc77c15ca40 2023-06-09T11:13:12.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- 172.21.15.78:0/1499704238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15ca40 msgr2=0x7fc77c0cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 --2- 172.21.15.78:0/1499704238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15ca40 0x7fc77c0cf910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0c9f30 tx=0x7fc77400b330 comp rx=0 tx=0).stop 2023-06-09T11:13:12.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- 172.21.15.78:0/1499704238 shutdown_connections 2023-06-09T11:13:12.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 --2- 172.21.15.78:0/1499704238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15ca40 0x7fc77c0cf910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 --2- 172.21.15.78:0/1499704238 >> v2:172.21.15.187:3300/0 conn(0x7fc77c0c7f70 0x7fc77c0d0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- 172.21.15.78:0/1499704238 >> 172.21.15.78:0/1499704238 conn(0x7fc77c0b4d00 msgr2=0x7fc77c0b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:12.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- 172.21.15.78:0/1499704238 shutdown_connections 2023-06-09T11:13:12.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.311+0000 7fc782786700 1 -- 172.21.15.78:0/1499704238 wait complete. 2023-06-09T11:13:12.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.315+0000 7fc782786700 1 Processor -- start 2023-06-09T11:13:12.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.315+0000 7fc782786700 1 -- start start 2023-06-09T11:13:12.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc77c0c7f70 0x7fc77c0b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15c670 0x7fc77c153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc77c15ca40 0x7fc77c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15d450 con 0x7fc77c15c670 2023-06-09T11:13:12.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15d730 con 0x7fc77c0c7f70 2023-06-09T11:13:12.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15da10 con 0x7fc77c15ca40 2023-06-09T11:13:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15c670 0x7fc77c153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15c670 0x7fc77c153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38722/0 (socket says 172.21.15.78:38722) 2023-06-09T11:13:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 -- 172.21.15.78:0/4055755332 learned_addr learned my addr 172.21.15.78:0/4055755332 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc780d23700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc77c15ca40 0x7fc77c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc77bfff700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc77c0c7f70 0x7fc77c0b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 -- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc77c15ca40 msgr2=0x7fc77c157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc77c15ca40 0x7fc77c157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 -- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc77c0c7f70 msgr2=0x7fc77c0b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc77c0c7f70 0x7fc77c0b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 -- 172.21.15.78:0/4055755332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774009b30 con 0x7fc77c15c670 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7737fe700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15c670 0x7fc77c153ca0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc76400d800 tx=0x7fc76400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7797fa700 1 -- 172.21.15.78:0/4055755332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640126b0 con 0x7fc77c15c670 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7797fa700 1 -- 172.21.15.78:0/4055755332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764012830 con 0x7fc77c15c670 2023-06-09T11:13:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c0d11e0 con 0x7fc77c15c670 2023-06-09T11:13:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc7797fa700 1 -- 172.21.15.78:0/4055755332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764012be0 con 0x7fc77c15c670 2023-06-09T11:13:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.319+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c06fa00 con 0x7fc77c15c670 2023-06-09T11:13:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.323+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c0d1370 con 0x7fc77c15c670 2023-06-09T11:13:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.323+0000 7fc7797fa700 1 -- 172.21.15.78:0/4055755332 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc764012d40 con 0x7fc77c15c670 2023-06-09T11:13:12.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.327+0000 7fc7797fa700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc75c0662f0 0x7fc75c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.327+0000 7fc7797fa700 1 -- 172.21.15.78:0/4055755332 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc764083eb0 con 0x7fc77c15c670 2023-06-09T11:13:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.327+0000 7fc77bfff700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc75c0662f0 0x7fc75c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.327+0000 7fc77bfff700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc75c0662f0 0x7fc75c0687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc76c005150 tx=0x7fc76c007ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.331+0000 7fc7797fa700 1 -- 172.21.15.78:0/4055755332 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc764051320 con 0x7fc77c15c670 2023-06-09T11:13:12.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.499+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc77c0741c0 con 0x7fc77c15c670 2023-06-09T11:13:12.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.503+0000 7fc7797fa700 1 -- 172.21.15.78:0/4055755332 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18328 (secure 0 0 0) 0x7fc764054940 con 0x7fc77c15c670 2023-06-09T11:13:12.512 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:12.513 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:12.091780+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:13:10.180078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T11:13:11.109063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:13:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc75c0662f0 msgr2=0x7fc75c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc75c0662f0 0x7fc75c0687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc76c005150 tx=0x7fc76c007ee0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15c670 msgr2=0x7fc77c153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15c670 0x7fc77c153ca0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc76400d800 tx=0x7fc76400db10 comp rx=0 tx=0).stop 2023-06-09T11:13:12.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 shutdown_connections 2023-06-09T11:13:12.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc75c0662f0 0x7fc75c0687a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc77c15ca40 0x7fc77c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77c15c670 0x7fc77c153ca0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 --2- 172.21.15.78:0/4055755332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc77c0c7f70 0x7fc77c0b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 >> 172.21.15.78:0/4055755332 conn(0x7fc77c0b4d00 msgr2=0x7fc77c06d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:12.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 shutdown_connections 2023-06-09T11:13:12.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.507+0000 7fc782786700 1 -- 172.21.15.78:0/4055755332 wait complete. 2023-06-09T11:13:12.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:13:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.699+0000 7f74b4cdd700 1 Processor -- start 2023-06-09T11:13:12.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.699+0000 7f74b4cdd700 1 -- start start 2023-06-09T11:13:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74b4cdd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74b00ade00 0x7f74b006ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74b4cdd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b006f1d0 0x7f74b00cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74b4cdd700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b015a010 con 0x7f74b00cdd20 2023-06-09T11:13:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74b4cdd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b006e800 con 0x7f74b00ade00 2023-06-09T11:13:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74b4cdd700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0153e00 con 0x7f74b006f1d0 2023-06-09T11:13:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74b00ade00 0x7f74b006ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f74b00ade00 0x7f74b006ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38726/0 (socket says 172.21.15.78:38726) 2023-06-09T11:13:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 -- 172.21.15.78:0/3531684368 learned_addr learned my addr 172.21.15.78:0/3531684368 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74affff700 1 --2- 172.21.15.78:0/3531684368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b006f1d0 0x7f74b00cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 -- 172.21.15.78:0/3531684368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b006f1d0 msgr2=0x7f74b00cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 --2- 172.21.15.78:0/3531684368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b006f1d0 0x7f74b00cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 -- 172.21.15.78:0/3531684368 >> v1:172.21.15.187:6789/0 conn(0x7f74b00cdd20 legacy=0x7f74b0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 -- 172.21.15.78:0/3531684368 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b015a250 con 0x7f74b00ade00 2023-06-09T11:13:12.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.703+0000 7f74a7fff700 1 --2- 172.21.15.78:0/3531684368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b006ec90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7498009910 tx=0x7f7498009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38060de8cadefd1e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74aeffd700 1 -- 172.21.15.78:0/3531684368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498011830 con 0x7f74b00ade00 2023-06-09T11:13:12.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74aeffd700 1 -- 172.21.15.78:0/3531684368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498011990 con 0x7f74b00ade00 2023-06-09T11:13:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74aeffd700 1 -- 172.21.15.78:0/3531684368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498011d40 con 0x7f74b00ade00 2023-06-09T11:13:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 -- 172.21.15.78:0/3531684368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 msgr2=0x7f74b006ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/3531684368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b006ec90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7498009910 tx=0x7f7498009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 -- 172.21.15.78:0/3531684368 shutdown_connections 2023-06-09T11:13:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/3531684368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b006f1d0 0x7f74b00cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/3531684368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b006ec90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 -- 172.21.15.78:0/3531684368 >> 172.21.15.78:0/3531684368 conn(0x7f74b00cf670 msgr2=0x7f74b00cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 -- 172.21.15.78:0/3531684368 shutdown_connections 2023-06-09T11:13:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 -- 172.21.15.78:0/3531684368 wait complete. 2023-06-09T11:13:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 Processor -- start 2023-06-09T11:13:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.707+0000 7f74b4cdd700 1 -- start start 2023-06-09T11:13:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b006f1d0 0x7f74b00b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b01462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b00cdd20 0x7f74b00afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00afa40 con 0x7f74b00ade00 2023-06-09T11:13:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00b4840 con 0x7f74b006f1d0 2023-06-09T11:13:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00aedc0 con 0x7f74b00cdd20 2023-06-09T11:13:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b01462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b01462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38734/0 (socket says 172.21.15.78:38734) 2023-06-09T11:13:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 -- 172.21.15.78:0/944296805 learned_addr learned my addr 172.21.15.78:0/944296805 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74affff700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b00cdd20 0x7f74b00afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74af7fe700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b006f1d0 0x7f74b00b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 -- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b00cdd20 msgr2=0x7f74b00afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b00cdd20 0x7f74b00afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 -- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b006f1d0 msgr2=0x7f74b00b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b006f1d0 0x7f74b00b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 -- 172.21.15.78:0/944296805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498009570 con 0x7f74b00ade00 2023-06-09T11:13:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74a7fff700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b01462e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7498000c00 tx=0x7f7498004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74acff9700 1 -- 172.21.15.78:0/944296805 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498004510 con 0x7f74b00ade00 2023-06-09T11:13:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74acff9700 1 -- 172.21.15.78:0/944296805 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74980036c0 con 0x7f74b00ade00 2023-06-09T11:13:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b006e490 con 0x7f74b00ade00 2023-06-09T11:13:12.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74acff9700 1 -- 172.21.15.78:0/944296805 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498003a70 con 0x7f74b00ade00 2023-06-09T11:13:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.711+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b015a530 con 0x7f74b00ade00 2023-06-09T11:13:12.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.715+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b015a810 con 0x7f74b00ade00 2023-06-09T11:13:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.715+0000 7f74acff9700 1 -- 172.21.15.78:0/944296805 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7498003bd0 con 0x7f74b00ade00 2023-06-09T11:13:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.719+0000 7f74acff9700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f74900662f0 0x7f74900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.719+0000 7f74acff9700 1 -- 172.21.15.78:0/944296805 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7498021030 con 0x7f74b00ade00 2023-06-09T11:13:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.719+0000 7f74af7fe700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f74900662f0 0x7f74900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.719+0000 7f74af7fe700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f74900662f0 0x7f74900687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000f60 tx=0x7f74a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:12.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.723+0000 7f74acff9700 1 -- 172.21.15.78:0/944296805 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7498052780 con 0x7f74b00ade00 2023-06-09T11:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.891+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74b00afb80 con 0x7f74b00ade00 2023-06-09T11:13:12.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.891+0000 7f74acff9700 1 -- 172.21.15.78:0/944296805 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18328 (secure 0 0 0) 0x7f74b00afb80 con 0x7f74b00ade00 2023-06-09T11:13:12.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:12.900 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":36,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:12.091780+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:13:10.180078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T11:13:11.109063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f74900662f0 msgr2=0x7f74900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f74900662f0 0x7f74900687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000f60 tx=0x7f74a0009040 comp rx=0 tx=0).stop 2023-06-09T11:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 msgr2=0x7f74b01462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b01462e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7498000c00 tx=0x7f7498004770 comp rx=0 tx=0).stop 2023-06-09T11:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 shutdown_connections 2023-06-09T11:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f74900662f0 0x7f74900687a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b00cdd20 0x7f74b00afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b00ade00 0x7f74b01462e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 --2- 172.21.15.78:0/944296805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b006f1d0 0x7f74b00b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 >> 172.21.15.78:0/944296805 conn(0x7f74b00cf670 msgr2=0x7f74b015ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 shutdown_connections 2023-06-09T11:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:12.895+0000 7f74b4cdd700 1 -- 172.21.15.78:0/944296805 wait complete. 2023-06-09T11:13:12.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T11:13:13.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe95759e700 1 Processor -- start 2023-06-09T11:13:13.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe95759e700 1 -- start start 2023-06-09T11:13:13.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe95759e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe95815a160 0x7fe95815cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:13.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe95759e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95806d730 con 0x7fe9580d26d0 2023-06-09T11:13:13.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe95759e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95815a530 con 0x7fe958070890 2023-06-09T11:13:13.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe95759e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9580d1190 con 0x7fe95815a160 2023-06-09T11:13:13.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe955d9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe9580d26d0 0x7fe9580d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52114/0 (socket says 172.21.15.78:52114) 2023-06-09T11:13:13.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.095+0000 7fe955d9b700 1 -- 172.21.15.78:0/3974191228 learned_addr learned my addr 172.21.15.78:0/3974191228 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:13.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.099+0000 7fe95659c700 1 --2- 172.21.15.78:0/3974191228 >> v2:172.21.15.187:3300/0 conn(0x7fe95815a160 0x7fe95815cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:13.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.099+0000 7fe95559a700 1 -- 172.21.15.78:0/3974191228 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282771639 0 0) 0x7fe95806d730 con 0x7fe9580d26d0 2023-06-09T11:13:13.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.099+0000 7fe95559a700 1 -- 172.21.15.78:0/3974191228 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9400035d0 con 0x7fe9580d26d0 2023-06-09T11:13:13.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.099+0000 7fe95659c700 1 -- 172.21.15.78:0/3974191228 >> v1:172.21.15.187:6789/0 conn(0x7fe958070890 legacy=0x7fe958070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:13.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.099+0000 7fe95659c700 1 -- 172.21.15.78:0/3974191228 >> v1:172.21.15.78:6789/0 conn(0x7fe9580d26d0 legacy=0x7fe9580d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:13.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.099+0000 7fe95659c700 1 -- 172.21.15.78:0/3974191228 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95815d180 con 0x7fe95815a160 2023-06-09T11:13:13.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.099+0000 7fe95659c700 1 --2- 172.21.15.78:0/3974191228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 0x7fe95815cb30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe948009850 tx=0x7fe948009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8b608f3cb57311 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:13.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.103+0000 7fe95559a700 1 -- 172.21.15.78:0/3974191228 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948011830 con 0x7fe95815a160 2023-06-09T11:13:13.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.103+0000 7fe95559a700 1 -- 172.21.15.78:0/3974191228 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe948011990 con 0x7fe95815a160 2023-06-09T11:13:13.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.103+0000 7fe95559a700 1 -- 172.21.15.78:0/3974191228 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948011d40 con 0x7fe95815a160 2023-06-09T11:13:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 -- 172.21.15.78:0/3974191228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 msgr2=0x7fe95815cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 --2- 172.21.15.78:0/3974191228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 0x7fe95815cb30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe948009850 tx=0x7fe948009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 -- 172.21.15.78:0/3974191228 shutdown_connections 2023-06-09T11:13:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 --2- 172.21.15.78:0/3974191228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 0x7fe95815cb30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 -- 172.21.15.78:0/3974191228 >> 172.21.15.78:0/3974191228 conn(0x7fe9580cf930 msgr2=0x7fe9580cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 -- 172.21.15.78:0/3974191228 shutdown_connections 2023-06-09T11:13:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 -- 172.21.15.78:0/3974191228 wait complete. 2023-06-09T11:13:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.107+0000 7fe95759e700 1 Processor -- start 2023-06-09T11:13:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95759e700 1 -- start start 2023-06-09T11:13:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe958070890 0x7fe958158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9580d26d0 0x7fe95815b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 0x7fe9581f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581f6210 con 0x7fe958070890 2023-06-09T11:13:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95759e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581f64f0 con 0x7fe95815a160 2023-06-09T11:13:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581f67d0 con 0x7fe9580d26d0 2023-06-09T11:13:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe958070890 0x7fe958158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe958070890 0x7fe958158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38744/0 (socket says 172.21.15.78:38744) 2023-06-09T11:13:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 -- 172.21.15.78:0/17990560 learned_addr learned my addr 172.21.15.78:0/17990560 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe955d9b700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9580d26d0 0x7fe95815b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe956d9d700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 0x7fe9581f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:13.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 -- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9580d26d0 msgr2=0x7fe95815b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:13.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9580d26d0 0x7fe95815b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:13.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 -- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 msgr2=0x7fe9581f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 0x7fe9581f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 -- 172.21.15.78:0/17990560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9480094b0 con 0x7fe958070890 2023-06-09T11:13:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.111+0000 7fe95659c700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe958070890 0x7fe958158800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe948000c00 tx=0x7fe948004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.115+0000 7fe946ffd700 1 -- 172.21.15.78:0/17990560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94801aac0 con 0x7fe958070890 2023-06-09T11:13:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.115+0000 7fe946ffd700 1 -- 172.21.15.78:0/17990560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94801f070 con 0x7fe958070890 2023-06-09T11:13:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.115+0000 7fe946ffd700 1 -- 172.21.15.78:0/17990560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94801ae60 con 0x7fe958070890 2023-06-09T11:13:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.115+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95815d740 con 0x7fe958070890 2023-06-09T11:13:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.115+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95815d460 con 0x7fe958070890 2023-06-09T11:13:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.115+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95815da20 con 0x7fe958070890 2023-06-09T11:13:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.115+0000 7fe946ffd700 1 -- 172.21.15.78:0/17990560 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe94801b430 con 0x7fe958070890 2023-06-09T11:13:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.119+0000 7fe946ffd700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9380662f0 0x7fe9380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.119+0000 7fe946ffd700 1 -- 172.21.15.78:0/17990560 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe948084ef0 con 0x7fe958070890 2023-06-09T11:13:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.119+0000 7fe955d9b700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9380662f0 0x7fe9380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:13.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.119+0000 7fe955d9b700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9380662f0 0x7fe9380687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe9581596a0 tx=0x7fe94c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:13.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.123+0000 7fe946ffd700 1 -- 172.21.15.78:0/17990560 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe948052360 con 0x7fe958070890 2023-06-09T11:13:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:13.331+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe958065e90 con 0x7fe958070890 2023-06-09T11:13:14.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.123+0000 7fe946ffd700 1 -- 172.21.15.78:0/17990560 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe948015020 con 0x7fe958070890 2023-06-09T11:13:14.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9380662f0 msgr2=0x7fe9380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:14.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9380662f0 0x7fe9380687a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe9581596a0 tx=0x7fe94c009040 comp rx=0 tx=0).stop 2023-06-09T11:13:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe958070890 msgr2=0x7fe958158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe958070890 0x7fe958158800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe948000c00 tx=0x7fe948004770 comp rx=0 tx=0).stop 2023-06-09T11:13:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 shutdown_connections 2023-06-09T11:13:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe9380662f0 0x7fe9380687a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe95815a160 0x7fe9581f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9580d26d0 0x7fe95815b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 --2- 172.21.15.78:0/17990560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe958070890 0x7fe958158800 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 >> 172.21.15.78:0/17990560 conn(0x7fe9580cf930 msgr2=0x7fe95806dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 shutdown_connections 2023-06-09T11:13:14.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.127+0000 7fe95759e700 1 -- 172.21.15.78:0/17990560 wait complete. 2023-06-09T11:13:14.159 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T11:13:14.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T11:13:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.331+0000 7f7f4608a700 1 Processor -- start 2023-06-09T11:13:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.331+0000 7f7f4608a700 1 -- start start 2023-06-09T11:13:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f4608a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f4015a7c0 0x7f7f40070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f4608a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f400c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f4608a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f400705f0 con 0x7f7f400c97b0 2023-06-09T11:13:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f4608a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f400c9c30 con 0x7f7f4015a7c0 2023-06-09T11:13:14.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f4608a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4006fa20 con 0x7f7f400cbdb0 2023-06-09T11:13:14.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f4015a7c0 0x7f7f40070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:14.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7f400c97b0 0x7f7f400b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52122/0 (socket says 172.21.15.78:52122) 2023-06-09T11:13:14.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3ffff700 1 -- 172.21.15.78:0/2563756438 learned_addr learned my addr 172.21.15.78:0/2563756438 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:14.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3effd700 1 --2- 172.21.15.78:0/2563756438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f400c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3f7fe700 1 -- 172.21.15.78:0/2563756438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 msgr2=0x7f7f400c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3f7fe700 1 --2- 172.21.15.78:0/2563756438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f400c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3f7fe700 1 -- 172.21.15.78:0/2563756438 >> v1:172.21.15.78:6789/0 conn(0x7f7f400c97b0 legacy=0x7f7f400b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3f7fe700 1 -- 172.21.15.78:0/2563756438 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4015ab90 con 0x7f7f4015a7c0 2023-06-09T11:13:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3effd700 1 --2- 172.21.15.78:0/2563756438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f400c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:13:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3f7fe700 1 --2- 172.21.15.78:0/2563756438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f4015a7c0 0x7f7f40070a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009850 tx=0x7f7f30009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5a3cd57f3a9aca server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3e7fc700 1 -- 172.21.15.78:0/2563756438 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30011830 con 0x7f7f4015a7c0 2023-06-09T11:13:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3e7fc700 1 -- 172.21.15.78:0/2563756438 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30011990 con 0x7f7f4015a7c0 2023-06-09T11:13:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.335+0000 7f7f3e7fc700 1 -- 172.21.15.78:0/2563756438 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30011d40 con 0x7f7f4015a7c0 2023-06-09T11:13:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 -- 172.21.15.78:0/2563756438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f4015a7c0 msgr2=0x7f7f40070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2563756438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f4015a7c0 0x7f7f40070a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009850 tx=0x7f7f30009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 -- 172.21.15.78:0/2563756438 shutdown_connections 2023-06-09T11:13:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2563756438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f400c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2563756438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f4015a7c0 0x7f7f40070a80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 -- 172.21.15.78:0/2563756438 >> 172.21.15.78:0/2563756438 conn(0x7f7f400cf8b0 msgr2=0x7f7f400cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 -- 172.21.15.78:0/2563756438 shutdown_connections 2023-06-09T11:13:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 -- 172.21.15.78:0/2563756438 wait complete. 2023-06-09T11:13:14.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.339+0000 7f7f4608a700 1 Processor -- start 2023-06-09T11:13:14.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 -- start start 2023-06-09T11:13:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f400c97b0 0x7f7f400acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f4015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f4015a7c0 0x7f7f4015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4015dcf0 con 0x7f7f400c97b0 2023-06-09T11:13:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4015d320 con 0x7f7f4015a7c0 2023-06-09T11:13:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4015b400 con 0x7f7f400cbdb0 2023-06-09T11:13:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f400c97b0 0x7f7f400acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f400c97b0 0x7f7f400acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38758/0 (socket says 172.21.15.78:38758) 2023-06-09T11:13:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 -- 172.21.15.78:0/2309282529 learned_addr learned my addr 172.21.15.78:0/2309282529 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:14.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3ffff700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f4015a7c0 0x7f7f4015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:14.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3effd700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f4015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:14.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 -- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 msgr2=0x7f7f4015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:14.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f4015d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 -- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f4015a7c0 msgr2=0x7f7f4015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:14.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f4015a7c0 0x7f7f4015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:14.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 -- 172.21.15.78:0/2309282529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340094b0 con 0x7f7f400c97b0 2023-06-09T11:13:14.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3ffff700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f4015a7c0 0x7f7f4015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:14.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f3f7fe700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f400c97b0 0x7f7f400acdb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009eb0 tx=0x7f7f30004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:14.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f27fff700 1 -- 172.21.15.78:0/2309282529 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30004560 con 0x7f7f400c97b0 2023-06-09T11:13:14.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f27fff700 1 -- 172.21.15.78:0/2309282529 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3001f070 con 0x7f7f400c97b0 2023-06-09T11:13:14.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f300094b0 con 0x7f7f400c97b0 2023-06-09T11:13:14.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f27fff700 1 -- 172.21.15.78:0/2309282529 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f300038e0 con 0x7f7f400c97b0 2023-06-09T11:13:14.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.343+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4006ffa0 con 0x7f7f400c97b0 2023-06-09T11:13:14.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.347+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f400ad520 con 0x7f7f400c97b0 2023-06-09T11:13:14.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.347+0000 7f7f27fff700 1 -- 172.21.15.78:0/2309282529 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f30021030 con 0x7f7f400c97b0 2023-06-09T11:13:14.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.351+0000 7f7f27fff700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f2c0662f0 0x7f7f2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:14.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.351+0000 7f7f27fff700 1 -- 172.21.15.78:0/2309282529 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f30085220 con 0x7f7f400c97b0 2023-06-09T11:13:14.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.351+0000 7f7f3effd700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f2c0662f0 0x7f7f2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:14.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.351+0000 7f7f3effd700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f2c0662f0 0x7f7f2c0687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f400ad9c0 tx=0x7f7f34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:14.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.359+0000 7f7f27fff700 1 -- 172.21.15.78:0/2309282529 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7f300527b0 con 0x7f7f400c97b0 2023-06-09T11:13:14.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:14.563+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7f40070280 con 0x7f7f400c97b0 2023-06-09T11:13:14.603 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T11:13:14.593+0000 7f8528b55700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T11:13:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.135+0000 7f7f27fff700 1 -- 172.21.15.78:0/2309282529 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7f30055dd0 con 0x7f7f400c97b0 2023-06-09T11:13:15.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f2c0662f0 msgr2=0x7f7f2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f2c0662f0 0x7f7f2c0687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f400ad9c0 tx=0x7f7f34008040 comp rx=0 tx=0).stop 2023-06-09T11:13:15.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f400c97b0 msgr2=0x7f7f400acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f400c97b0 0x7f7f400acdb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009eb0 tx=0x7f7f30004770 comp rx=0 tx=0).stop 2023-06-09T11:13:15.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 shutdown_connections 2023-06-09T11:13:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7f2c0662f0 0x7f7f2c0687a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f4015a7c0 0x7f7f4015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f400cbdb0 0x7f7f4015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 --2- 172.21.15.78:0/2309282529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f400c97b0 0x7f7f400acdb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 >> 172.21.15.78:0/2309282529 conn(0x7f7f400cf8b0 msgr2=0x7f7f400b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 shutdown_connections 2023-06-09T11:13:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.139+0000 7f7f4608a700 1 -- 172.21.15.78:0/2309282529 wait complete. 2023-06-09T11:13:15.172 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T11:13:15.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:13:15.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.343+0000 7ff8d2825700 1 Processor -- start 2023-06-09T11:13:15.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8d2825700 1 -- start start 2023-06-09T11:13:15.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8d2825700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8cc06dfe0 0x7ff8cc15a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8d2825700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc071160 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8d2825700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc0b47a0 con 0x7ff8cc15a4b0 2023-06-09T11:13:15.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8d2825700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc069ed0 con 0x7ff8cc06dfe0 2023-06-09T11:13:15.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8d0dc2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff8cc06e8f0 0x7ff8cc06f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50566/0 (socket says 172.21.15.78:50566) 2023-06-09T11:13:15.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8d0dc2700 1 -- 172.21.15.78:0/3271759812 learned_addr learned my addr 172.21.15.78:0/3271759812 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:15.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8cb7fe700 1 --2- 172.21.15.78:0/3271759812 >> v2:172.21.15.187:3300/0 conn(0x7ff8cc06dfe0 0x7ff8cc15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8caffd700 1 -- 172.21.15.78:0/3271759812 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303627963 0 0) 0x7ff8cc071160 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8caffd700 1 -- 172.21.15.78:0/3271759812 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b80035d0 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8cb7fe700 1 -- 172.21.15.78:0/3271759812 >> v1:172.21.15.187:6789/0 conn(0x7ff8cc15a4b0 legacy=0x7ff8cc06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8caffd700 1 -- 172.21.15.78:0/3271759812 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049380714 0 0) 0x7ff8cc0b47a0 con 0x7ff8cc15a4b0 2023-06-09T11:13:15.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8cb7fe700 1 -- 172.21.15.78:0/3271759812 >> v1:172.21.15.78:6789/0 conn(0x7ff8cc06e8f0 legacy=0x7ff8cc06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.347+0000 7ff8cb7fe700 1 -- 172.21.15.78:0/3271759812 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc06a0e0 con 0x7ff8cc06dfe0 2023-06-09T11:13:15.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8cb7fe700 1 --2- 172.21.15.78:0/3271759812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 0x7ff8cc15a880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009d90 tx=0x7ff8bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36418723374bfdd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:15.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8caffd700 1 -- 172.21.15.78:0/3271759812 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00e070 con 0x7ff8cc06dfe0 2023-06-09T11:13:15.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8caffd700 1 -- 172.21.15.78:0/3271759812 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00bb20 con 0x7ff8cc06dfe0 2023-06-09T11:13:15.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8caffd700 1 -- 172.21.15.78:0/3271759812 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00bed0 con 0x7ff8cc06dfe0 2023-06-09T11:13:15.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8d2825700 1 -- 172.21.15.78:0/3271759812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 msgr2=0x7ff8cc15a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8d2825700 1 --2- 172.21.15.78:0/3271759812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 0x7ff8cc15a880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009d90 tx=0x7ff8bc00b330 comp rx=0 tx=0).stop 2023-06-09T11:13:15.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8d2825700 1 -- 172.21.15.78:0/3271759812 shutdown_connections 2023-06-09T11:13:15.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8d2825700 1 --2- 172.21.15.78:0/3271759812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 0x7ff8cc15a880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8d2825700 1 -- 172.21.15.78:0/3271759812 >> 172.21.15.78:0/3271759812 conn(0x7ff8cc0b1480 msgr2=0x7ff8cc0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:15.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8d2825700 1 -- 172.21.15.78:0/3271759812 shutdown_connections 2023-06-09T11:13:15.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.351+0000 7ff8d2825700 1 -- 172.21.15.78:0/3271759812 wait complete. 2023-06-09T11:13:15.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 Processor -- start 2023-06-09T11:13:15.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 -- start start 2023-06-09T11:13:15.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 0x7ff8cc0a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc06e8f0 0x7ff8cc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8cc15a4b0 0x7ff8cc0a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0c7020 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0c6410 con 0x7ff8cc06dfe0 2023-06-09T11:13:15.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d2825700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0c66f0 con 0x7ff8cc15a4b0 2023-06-09T11:13:15.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc06e8f0 0x7ff8cc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc06e8f0 0x7ff8cc0c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58140/0 (socket says 172.21.15.78:58140) 2023-06-09T11:13:15.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 -- 172.21.15.78:0/2963120916 learned_addr learned my addr 172.21.15.78:0/2963120916 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:15.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cbfff700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 0x7ff8cc0a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d0dc2700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8cc15a4b0 0x7ff8cc0a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 -- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8cc15a4b0 msgr2=0x7ff8cc0a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8cc15a4b0 0x7ff8cc0a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 -- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 msgr2=0x7ff8cc0a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 0x7ff8cc0a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8cb7fe700 1 -- 172.21.15.78:0/2963120916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009a70 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.355+0000 7ff8d0dc2700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8cc15a4b0 0x7ff8cc0a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:15.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8cb7fe700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc06e8f0 0x7ff8cc0c5d10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc014040 tx=0x7ff8bc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:15.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8c8ff9700 1 -- 172.21.15.78:0/2963120916 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc01b810 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8c8ff9700 1 -- 172.21.15.78:0/2963120916 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc020070 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8c8ff9700 1 -- 172.21.15.78:0/2963120916 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc01bbb0 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc06a6a0 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc06a3c0 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc06abc0 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.359+0000 7ff8c8ff9700 1 -- 172.21.15.78:0/2963120916 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8bc01bd10 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.363+0000 7ff8c8ff9700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8ac066320 0x7ff8ac0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.363+0000 7ff8c8ff9700 1 -- 172.21.15.78:0/2963120916 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8bc022070 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.363+0000 7ff8cbfff700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8ac066320 0x7ff8ac0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.363+0000 7ff8cbfff700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8ac066320 0x7ff8ac0687d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4000f60 tx=0x7ff8c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:15.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.367+0000 7ff8c8ff9700 1 -- 172.21.15.78:0/2963120916 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff8bc057030 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.575+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8cc0741c0 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8c8ff9700 1 -- 172.21.15.78:0/2963120916 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7ff8bc056bc0 con 0x7ff8cc06e8f0 2023-06-09T11:13:15.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:15.587 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3399791462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3399791462},{"type":"v1","addr":"172.21.15.187:6837","nonce":3399791462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/658938311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":658938311},{"type":"v1","addr":"172.21.15.78:6834","nonce":658938311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/952789446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":952789446},{"type":"v1","addr":"172.21.15.78:6835","nonce":952789446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:13:12.092475+0000","modified":"2023-06-09T11:13:15.123169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5137":{"gid":5137,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.187:6835/1349991607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1349991607},{"type":"v1","addr":"172.21.15.187:6835","nonce":1349991607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T11:13:15.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8ac066320 msgr2=0x7ff8ac0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8ac066320 0x7ff8ac0687d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4000f60 tx=0x7ff8c4009040 comp rx=0 tx=0).stop 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc06e8f0 msgr2=0x7ff8cc0c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc06e8f0 0x7ff8cc0c5d10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc014040 tx=0x7ff8bc004af0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 shutdown_connections 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff8ac066320 0x7ff8ac0687d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8cc15a4b0 0x7ff8cc0a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8cc06e8f0 0x7ff8cc0c5d10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 --2- 172.21.15.78:0/2963120916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06dfe0 0x7ff8cc0a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.579+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 >> 172.21.15.78:0/2963120916 conn(0x7ff8cc0b1480 msgr2=0x7ff8cc0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:15.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.583+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 shutdown_connections 2023-06-09T11:13:15.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.583+0000 7ff8d2825700 1 -- 172.21.15.78:0/2963120916 wait complete. 2023-06-09T11:13:15.592 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2023-06-09T11:13:15.611 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:13:15.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.771+0000 7f19d231f700 1 Processor -- start 2023-06-09T11:13:15.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.771+0000 7f19d231f700 1 -- start start 2023-06-09T11:13:15.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.771+0000 7f19d231f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 0x7f19cc0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.771+0000 7f19d231f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f19cc06f2a0 0x7f19cc1644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.771+0000 7f19d231f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc0adb00 con 0x7f19cc06f880 2023-06-09T11:13:15.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.771+0000 7f19d231f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19cc1653a0 con 0x7f19cc06f2a0 2023-06-09T11:13:15.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.771+0000 7f19d231f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc06ba70 con 0x7f19cc160940 2023-06-09T11:13:15.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d1b1e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f19cc06f880 0x7f19cc06dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50568/0 (socket says 172.21.15.78:50568) 2023-06-09T11:13:15.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d1b1e700 1 -- 172.21.15.78:0/343431969 learned_addr learned my addr 172.21.15.78:0/343431969 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:15.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 0x7f19cc0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d0b1c700 1 --2- 172.21.15.78:0/343431969 >> v2:172.21.15.187:3300/0 conn(0x7f19cc06f2a0 0x7f19cc1644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835983995 0 0) 0x7f19cc0adb00 con 0x7f19cc06f880 2023-06-09T11:13:15.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b80035d0 con 0x7f19cc06f880 2023-06-09T11:13:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1579736052 0 0) 0x7f19b80035d0 con 0x7f19cc06f880 2023-06-09T11:13:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 msgr2=0x7f19cc0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 0x7f19cc0ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 >> v2:172.21.15.187:3300/0 conn(0x7f19cc06f2a0 msgr2=0x7f19cc1644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 --2- 172.21.15.78:0/343431969 >> v2:172.21.15.187:3300/0 conn(0x7f19cc06f2a0 0x7f19cc1644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc0ccb10 con 0x7f19cc06f880 2023-06-09T11:13:15.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7f19c40019f0 con 0x7f19cc06f880 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 >> v1:172.21.15.78:6789/0 conn(0x7f19cc06f880 legacy=0x7f19cc06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19b8003a20 0x7f19b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 0x7f19b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8004db0 0x7f19b8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc1653a0 con 0x7f19b8003a20 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc06ba70 con 0x7f19b8004db0 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b800ba30 con 0x7f19cc160940 2023-06-09T11:13:15.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19b8003a20 0x7f19b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d0b1c700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 0x7f19b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d1b1e700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8004db0 0x7f19b8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 -- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 msgr2=0x7f19b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc160940 0x7f19b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 -- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8004db0 msgr2=0x7f19b8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8004db0 0x7f19b8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 -- 172.21.15.78:0/343431969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80035d0 con 0x7f19b8003a20 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d1b1e700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8004db0 0x7f19b8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19d131d700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19b8003a20 0x7f19b8003e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009b70 tx=0x7f19b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818211e9fec63c07 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800e6c0 con 0x7f19b8003a20 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c800e820 con 0x7f19b8003a20 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.775+0000 7f19c3fff700 1 -- 172.21.15.78:0/343431969 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c800eb90 con 0x7f19b8003a20 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 -- 172.21.15.78:0/343431969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19b8003a20 msgr2=0x7f19b8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 --2- 172.21.15.78:0/343431969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19b8003a20 0x7f19b8003e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009b70 tx=0x7f19b80058a0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d1b1e700 1 -- 172.21.15.78:0/343431969 reap_dead start 2023-06-09T11:13:15.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 -- 172.21.15.78:0/343431969 shutdown_connections 2023-06-09T11:13:15.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 -- 172.21.15.78:0/343431969 >> 172.21.15.78:0/343431969 conn(0x7f19cc0cf670 msgr2=0x7f19cc0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:15.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 -- 172.21.15.78:0/343431969 shutdown_connections 2023-06-09T11:13:15.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 -- 172.21.15.78:0/343431969 wait complete. 2023-06-09T11:13:15.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 Processor -- start 2023-06-09T11:13:15.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.779+0000 7f19d231f700 1 -- start start 2023-06-09T11:13:15.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8003a20 0x7f19cc144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc154e90 0x7f19cc0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19cc06de30 0x7f19cc06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0c8660 con 0x7f19cc06de30 2023-06-09T11:13:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc06e7f0 con 0x7f19b8003a20 2023-06-09T11:13:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc147cb0 con 0x7f19cc154e90 2023-06-09T11:13:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19cc06de30 0x7f19cc06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19cc06de30 0x7f19cc06e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58160/0 (socket says 172.21.15.78:58160) 2023-06-09T11:13:15.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 -- 172.21.15.78:0/21142309 learned_addr learned my addr 172.21.15.78:0/21142309 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:15.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d0b1c700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc154e90 0x7f19cc0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d131d700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8003a20 0x7f19cc144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 -- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc154e90 msgr2=0x7f19cc0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc154e90 0x7f19cc0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 -- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8003a20 msgr2=0x7f19cc144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8003a20 0x7f19cc144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 -- 172.21.15.78:0/21142309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc1650c0 con 0x7f19cc06de30 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d0b1c700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc154e90 0x7f19cc0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d1b1e700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19cc06de30 0x7f19cc06e2b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0c8f30 tx=0x7f19c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19c1ffb700 1 -- 172.21.15.78:0/21142309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c40074e0 con 0x7f19cc06de30 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19c1ffb700 1 -- 172.21.15.78:0/21142309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4007640 con 0x7f19cc06de30 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc0add50 con 0x7f19cc06de30 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19c1ffb700 1 -- 172.21.15.78:0/21142309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c40079b0 con 0x7f19cc06de30 2023-06-09T11:13:15.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.783+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc161d20 con 0x7f19cc06de30 2023-06-09T11:13:15.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.787+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc06ec80 con 0x7f19cc06de30 2023-06-09T11:13:15.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.787+0000 7f19c1ffb700 1 -- 172.21.15.78:0/21142309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19c40123d0 con 0x7f19cc06de30 2023-06-09T11:13:15.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.791+0000 7f19c1ffb700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f19b00662f0 0x7f19b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:15.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.791+0000 7f19c1ffb700 1 -- 172.21.15.78:0/21142309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19c4083a70 con 0x7f19cc06de30 2023-06-09T11:13:15.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.791+0000 7f19d131d700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f19b00662f0 0x7f19b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.791+0000 7f19d131d700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f19b00662f0 0x7f19b00687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f19c80090b0 tx=0x7f19c801f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.795+0000 7f19c1ffb700 1 -- 172.21.15.78:0/21142309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f19c4050f80 con 0x7f19cc06de30 2023-06-09T11:13:15.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.967+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19cc0c87a0 con 0x7f19cc06de30 2023-06-09T11:13:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.971+0000 7f19c1ffb700 1 -- 172.21.15.78:0/21142309 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f19cc0c87a0 con 0x7f19cc06de30 2023-06-09T11:13:15.981 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:15.982 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:13.098471+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:13:10.180078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T11:13:11.109063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:13:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f19b00662f0 msgr2=0x7f19b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f19b00662f0 0x7f19b00687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f19c80090b0 tx=0x7f19c801f040 comp rx=0 tx=0).stop 2023-06-09T11:13:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19cc06de30 msgr2=0x7f19cc06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19cc06de30 0x7f19cc06e2b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0c8f30 tx=0x7f19c400dbb0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 shutdown_connections 2023-06-09T11:13:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f19b00662f0 0x7f19b00687a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19cc06de30 0x7f19cc06e2b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19cc154e90 0x7f19cc0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 --2- 172.21.15.78:0/21142309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19b8003a20 0x7f19cc144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 >> 172.21.15.78:0/21142309 conn(0x7f19cc0cf670 msgr2=0x7f19cc0c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 shutdown_connections 2023-06-09T11:13:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:15.975+0000 7f19d231f700 1 -- 172.21.15.78:0/21142309 wait complete. 2023-06-09T11:13:16.007 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T11:13:16.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:13:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.151+0000 7f2f15307700 1 Processor -- start 2023-06-09T11:13:16.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.151+0000 7f2f15307700 1 -- start start 2023-06-09T11:13:16.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f15307700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f10158b60 0x7f2f100ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f15307700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2f10070290 0x7f2f1006a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f15307700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1006b100 con 0x7f2f1006aca0 2023-06-09T11:13:16.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f15307700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f10158f30 con 0x7f2f10158b60 2023-06-09T11:13:16.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f15307700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100cd830 con 0x7f2f10070290 2023-06-09T11:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f10158b60 0x7f2f100ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f10158b60 0x7f2f100ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58172/0 (socket says 172.21.15.78:58172) 2023-06-09T11:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 -- 172.21.15.78:0/3705622685 learned_addr learned my addr 172.21.15.78:0/3705622685 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f14b06700 1 --1- 172.21.15.78:0/3705622685 >> v1:172.21.15.78:6789/0 conn(0x7f2f1006aca0 0x7f2f100c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50578/0 (socket says 172.21.15.78:50578) 2023-06-09T11:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f07fff700 1 --2- 172.21.15.78:0/3705622685 >> v2:172.21.15.187:3300/0 conn(0x7f2f10070290 0x7f2f1006a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 -- 172.21.15.78:0/3705622685 >> v2:172.21.15.187:3300/0 conn(0x7f2f10070290 msgr2=0x7f2f1006a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 --2- 172.21.15.78:0/3705622685 >> v2:172.21.15.187:3300/0 conn(0x7f2f10070290 0x7f2f1006a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 -- 172.21.15.78:0/3705622685 >> v1:172.21.15.78:6789/0 conn(0x7f2f1006aca0 legacy=0x7f2f100c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0f7fe700 1 -- 172.21.15.78:0/3705622685 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955073132 0 0) 0x7f2f1006b100 con 0x7f2f1006aca0 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 -- 172.21.15.78:0/3705622685 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100cd270 con 0x7f2f10158b60 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0ffff700 1 --2- 172.21.15.78:0/3705622685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10158b60 0x7f2f100ae020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006d140 tx=0x7f2f00007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ff69a9eee8de22 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0f7fe700 1 -- 172.21.15.78:0/3705622685 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000a070 con 0x7f2f10158b60 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0f7fe700 1 -- 172.21.15.78:0/3705622685 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000b830 con 0x7f2f10158b60 2023-06-09T11:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.155+0000 7f2f0f7fe700 1 -- 172.21.15.78:0/3705622685 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000bbe0 con 0x7f2f10158b60 2023-06-09T11:13:16.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 -- 172.21.15.78:0/3705622685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10158b60 msgr2=0x7f2f100ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 --2- 172.21.15.78:0/3705622685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10158b60 0x7f2f100ae020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f1006d140 tx=0x7f2f00007b50 comp rx=0 tx=0).stop 2023-06-09T11:13:16.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 -- 172.21.15.78:0/3705622685 shutdown_connections 2023-06-09T11:13:16.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 --2- 172.21.15.78:0/3705622685 >> v2:172.21.15.187:3300/0 conn(0x7f2f10070290 0x7f2f1006a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 --2- 172.21.15.78:0/3705622685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10158b60 0x7f2f100ae020 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 -- 172.21.15.78:0/3705622685 >> 172.21.15.78:0/3705622685 conn(0x7f2f100cf670 msgr2=0x7f2f100cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:16.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 -- 172.21.15.78:0/3705622685 shutdown_connections 2023-06-09T11:13:16.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 -- 172.21.15.78:0/3705622685 wait complete. 2023-06-09T11:13:16.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.159+0000 7f2f15307700 1 Processor -- start 2023-06-09T11:13:16.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 -- start start 2023-06-09T11:13:16.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1006aca0 0x7f2f101e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f10070290 0x7f2f100acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f10158b60 0x7f2f1014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f101e18c0 con 0x7f2f1006aca0 2023-06-09T11:13:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100ad4b0 con 0x7f2f10158b60 2023-06-09T11:13:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1014c360 con 0x7f2f10070290 2023-06-09T11:13:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1006aca0 0x7f2f101e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1006aca0 0x7f2f101e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58182/0 (socket says 172.21.15.78:58182) 2023-06-09T11:13:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 -- 172.21.15.78:0/642134527 learned_addr learned my addr 172.21.15.78:0/642134527 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:16.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f07fff700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f10070290 0x7f2f100acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f14b06700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f10158b60 0x7f2f1014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 -- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f10070290 msgr2=0x7f2f100acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f10070290 0x7f2f100acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 -- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f10158b60 msgr2=0x7f2f1014be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f10158b60 0x7f2f1014be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 -- 172.21.15.78:0/642134527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000074d0 con 0x7f2f1006aca0 2023-06-09T11:13:16.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0ffff700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1006aca0 0x7f2f101e1d50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f00000c00 tx=0x7f2f00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:16.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0d7fa700 1 -- 172.21.15.78:0/642134527 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000038c0 con 0x7f2f1006aca0 2023-06-09T11:13:16.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0d7fa700 1 -- 172.21.15.78:0/642134527 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f00003a20 con 0x7f2f1006aca0 2023-06-09T11:13:16.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f100c3f00 con 0x7f2f1006aca0 2023-06-09T11:13:16.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.163+0000 7f2f0d7fa700 1 -- 172.21.15.78:0/642134527 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00003dd0 con 0x7f2f1006aca0 2023-06-09T11:13:16.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.167+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f100cd550 con 0x7f2f1006aca0 2023-06-09T11:13:16.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.167+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f100c41e0 con 0x7f2f1006aca0 2023-06-09T11:13:16.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.167+0000 7f2f0d7fa700 1 -- 172.21.15.78:0/642134527 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f00022070 con 0x7f2f1006aca0 2023-06-09T11:13:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.171+0000 7f2f0d7fa700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ef00662f0 0x7f2ef00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.171+0000 7f2f0d7fa700 1 -- 172.21.15.78:0/642134527 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f00085d10 con 0x7f2f1006aca0 2023-06-09T11:13:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.171+0000 7f2f07fff700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ef00662f0 0x7f2ef00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.171+0000 7f2f07fff700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ef00662f0 0x7f2ef00687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2f101f5380 tx=0x7f2ef8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.179+0000 7f2f0d7fa700 1 -- 172.21.15.78:0/642134527 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2f00053220 con 0x7f2f1006aca0 2023-06-09T11:13:16.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.343+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f101e1a00 con 0x7f2ef00662f0 2023-06-09T11:13:16.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.359+0000 7f2f0d7fa700 1 -- 172.21.15.78:0/642134527 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296422 (secure 0 0 0) 0x7f2ef8011720 con 0x7f2ef00662f0 2023-06-09T11:13:16.372 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ef00662f0 msgr2=0x7f2ef00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ef00662f0 0x7f2ef00687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2f101f5380 tx=0x7f2ef8008040 comp rx=0 tx=0).stop 2023-06-09T11:13:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1006aca0 msgr2=0x7f2f101e1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1006aca0 0x7f2f101e1d50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f00000c00 tx=0x7f2f00004770 comp rx=0 tx=0).stop 2023-06-09T11:13:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 shutdown_connections 2023-06-09T11:13:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2ef00662f0 0x7f2ef00687a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f10158b60 0x7f2f1014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f10070290 0x7f2f100acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 --2- 172.21.15.78:0/642134527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f1006aca0 0x7f2f101e1d50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 >> 172.21.15.78:0/642134527 conn(0x7f2f100cf670 msgr2=0x7f2f100af030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 shutdown_connections 2023-06-09T11:13:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.371+0000 7f2f15307700 1 -- 172.21.15.78:0/642134527 wait complete. 2023-06-09T11:13:16.381 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:13:16.399 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-06-09T11:13:15.628355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68464,"kb_used_data":4080,"kb_used_omap":0,"kb_used_meta":64320,"kb_avail":754906256,"statfs":{"total":773094113280,"available":773024006144,"internally_reserved":0,"allocated":4177920,"data_stored":2376359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65863680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.995701"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640817+0000","last_change":"2023-06-09T11:13:10.640817+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640817+0000","last_undegraded":"2023-06-09T11:13:10.640817+0000","last_fullsized":"2023-06-09T11:13:10.640817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639786+0000","last_change":"2023-06-09T11:13:10.639786+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639786+0000","last_undegraded":"2023-06-09T11:13:10.639786+0000","last_fullsized":"2023-06-09T11:13:10.639786+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641023+0000","last_change":"2023-06-09T11:13:10.641023+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641023+0000","last_undegraded":"2023-06-09T11:13:10.641023+0000","last_fullsized":"2023-06-09T11:13:10.641023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641195+0000","last_change":"2023-06-09T11:13:10.641195+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641195+0000","last_undegraded":"2023-06-09T11:13:10.641195+0000","last_fullsized":"2023-06-09T11:13:10.641195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636352+0000","last_change":"2023-06-09T11:13:10.636352+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636352+0000","last_undegraded":"2023-06-09T11:13:10.636352+0000","last_fullsized":"2023-06-09T11:13:10.636352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637505+0000","last_change":"2023-06-09T11:13:10.637505+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637505+0000","last_undegraded":"2023-06-09T11:13:10.637505+0000","last_fullsized":"2023-06-09T11:13:10.637505+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641693+0000","last_change":"2023-06-09T11:13:10.641693+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641693+0000","last_undegraded":"2023-06-09T11:13:10.641693+0000","last_fullsized":"2023-06-09T11:13:10.641693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641411+0000","last_change":"2023-06-09T11:13:10.641411+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641411+0000","last_undegraded":"2023-06-09T11:13:10.641411+0000","last_fullsized":"2023-06-09T11:13:10.641411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635951+0000","last_change":"2023-06-09T11:13:10.635951+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635951+0000","last_undegraded":"2023-06-09T11:13:10.635951+0000","last_fullsized":"2023-06-09T11:13:10.635951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636510+0000","last_change":"2023-06-09T11:13:10.636510+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636510+0000","last_undegraded":"2023-06-09T11:13:10.636510+0000","last_fullsized":"2023-06-09T11:13:10.636510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637428+0000","last_change":"2023-06-09T11:13:10.637428+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637428+0000","last_undegraded":"2023-06-09T11:13:10.637428+0000","last_fullsized":"2023-06-09T11:13:10.637428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635965+0000","last_change":"2023-06-09T11:13:10.635965+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635965+0000","last_undegraded":"2023-06-09T11:13:10.635965+0000","last_fullsized":"2023-06-09T11:13:10.635965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635928+0000","last_change":"2023-06-09T11:13:10.635928+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635928+0000","last_undegraded":"2023-06-09T11:13:10.635928+0000","last_fullsized":"2023-06-09T11:13:10.635928+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640492+0000","last_change":"2023-06-09T11:13:10.640492+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640492+0000","last_undegraded":"2023-06-09T11:13:10.640492+0000","last_fullsized":"2023-06-09T11:13:10.640492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640829+0000","last_change":"2023-06-09T11:13:10.640829+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640829+0000","last_undegraded":"2023-06-09T11:13:10.640829+0000","last_fullsized":"2023-06-09T11:13:10.640829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637259+0000","last_change":"2023-06-09T11:13:10.637259+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637259+0000","last_undegraded":"2023-06-09T11:13:10.637259+0000","last_fullsized":"2023-06-09T11:13:10.637259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637159+0000","last_change":"2023-06-09T11:13:10.637159+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637159+0000","last_undegraded":"2023-06-09T11:13:10.637159+0000","last_fullsized":"2023-06-09T11:13:10.637159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640954+0000","last_change":"2023-06-09T11:13:10.640954+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640954+0000","last_undegraded":"2023-06-09T11:13:10.640954+0000","last_fullsized":"2023-06-09T11:13:10.640954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644060+0000","last_change":"2023-06-09T11:13:10.644060+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644060+0000","last_undegraded":"2023-06-09T11:13:10.644060+0000","last_fullsized":"2023-06-09T11:13:10.644060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640396+0000","last_change":"2023-06-09T11:13:10.640396+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640396+0000","last_undegraded":"2023-06-09T11:13:10.640396+0000","last_fullsized":"2023-06-09T11:13:10.640396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644021+0000","last_change":"2023-06-09T11:13:10.644021+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644021+0000","last_undegraded":"2023-06-09T11:13:10.644021+0000","last_fullsized":"2023-06-09T11:13:10.644021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.643854+0000","last_change":"2023-06-09T11:13:10.643854+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.643854+0000","last_undegraded":"2023-06-09T11:13:10.643854+0000","last_fullsized":"2023-06-09T11:13:10.643854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637094+0000","last_change":"2023-06-09T11:13:10.637094+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637094+0000","last_undegraded":"2023-06-09T11:13:10.637094+0000","last_fullsized":"2023-06-09T11:13:10.637094+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.643986+0000","last_change":"2023-06-09T11:13:10.643986+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.643986+0000","last_undegraded":"2023-06-09T11:13:10.643986+0000","last_fullsized":"2023-06-09T11:13:10.643986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639061+0000","last_change":"2023-06-09T11:13:10.639061+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639061+0000","last_undegraded":"2023-06-09T11:13:10.639061+0000","last_fullsized":"2023-06-09T11:13:10.639061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.639311+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:13:10.639311+0000","last_peered":"2023-06-09T11:13:10.639311+0000","last_clean":"2023-06-09T11:13:10.639311+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:13:10.639311+0000","last_undegraded":"2023-06-09T11:13:10.639311+0000","last_fullsized":"2023-06-09T11:13:10.639311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:40:24.637855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.638587+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:13:10.638587+0000","last_peered":"2023-06-09T11:13:10.638587+0000","last_clean":"2023-06-09T11:13:10.638587+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:13:10.638587+0000","last_undegraded":"2023-06-09T11:13:10.638587+0000","last_fullsized":"2023-06-09T11:13:10.638587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:29.942265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636472+0000","last_change":"2023-06-09T11:13:10.636472+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636472+0000","last_undegraded":"2023-06-09T11:13:10.636472+0000","last_fullsized":"2023-06-09T11:13:10.636472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.639100+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:13:10.639100+0000","last_peered":"2023-06-09T11:13:10.639100+0000","last_clean":"2023-06-09T11:13:10.639100+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:13:10.639100+0000","last_undegraded":"2023-06-09T11:13:10.639100+0000","last_fullsized":"2023-06-09T11:13:10.639100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:22:59.667374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644335+0000","last_change":"2023-06-09T11:13:10.644335+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644335+0000","last_undegraded":"2023-06-09T11:13:10.644335+0000","last_fullsized":"2023-06-09T11:13:10.644335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.645080+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:13:10.645080+0000","last_peered":"2023-06-09T11:13:10.645080+0000","last_clean":"2023-06-09T11:13:10.645080+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:13:10.645080+0000","last_undegraded":"2023-06-09T11:13:10.645080+0000","last_fullsized":"2023-06-09T11:13:10.645080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:55:46.578471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639929+0000","last_change":"2023-06-09T11:13:10.639929+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639929+0000","last_undegraded":"2023-06-09T11:13:10.639929+0000","last_fullsized":"2023-06-09T11:13:10.639929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.638405+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:13:10.638405+0000","last_peered":"2023-06-09T11:13:10.638405+0000","last_clean":"2023-06-09T11:13:10.638405+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:13:10.638405+0000","last_undegraded":"2023-06-09T11:13:10.638405+0000","last_fullsized":"2023-06-09T11:13:10.638405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:24:16.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639873+0000","last_change":"2023-06-09T11:13:10.639873+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639873+0000","last_undegraded":"2023-06-09T11:13:10.639873+0000","last_fullsized":"2023-06-09T11:13:10.639873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.643123+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:13:10.643123+0000","last_peered":"2023-06-09T11:13:10.643123+0000","last_clean":"2023-06-09T11:13:10.643123+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:13:10.643123+0000","last_undegraded":"2023-06-09T11:13:10.643123+0000","last_fullsized":"2023-06-09T11:13:10.643123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:59.027006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640754+0000","last_change":"2023-06-09T11:13:10.640754+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640754+0000","last_undegraded":"2023-06-09T11:13:10.640754+0000","last_fullsized":"2023-06-09T11:13:10.640754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.636519+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:13:10.636519+0000","last_peered":"2023-06-09T11:13:10.636519+0000","last_clean":"2023-06-09T11:13:10.636519+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:13:10.636519+0000","last_undegraded":"2023-06-09T11:13:10.636519+0000","last_fullsized":"2023-06-09T11:13:10.636519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:29.942265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640960+0000","last_change":"2023-06-09T11:13:10.640960+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640960+0000","last_undegraded":"2023-06-09T11:13:10.640960+0000","last_fullsized":"2023-06-09T11:13:10.640960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.643160+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:13:10.643160+0000","last_peered":"2023-06-09T11:13:10.643160+0000","last_clean":"2023-06-09T11:13:10.643160+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:13:10.643160+0000","last_undegraded":"2023-06-09T11:13:10.643160+0000","last_fullsized":"2023-06-09T11:13:10.643160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:25:32.467942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635938+0000","last_change":"2023-06-09T11:13:10.635938+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635938+0000","last_undegraded":"2023-06-09T11:13:10.635938+0000","last_fullsized":"2023-06-09T11:13:10.635938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.642061+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:13:10.642061+0000","last_peered":"2023-06-09T11:13:10.642061+0000","last_clean":"2023-06-09T11:13:10.642061+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:13:10.642061+0000","last_undegraded":"2023-06-09T11:13:10.642061+0000","last_fullsized":"2023-06-09T11:13:10.642061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:38:34.563451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9412,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362428,"statfs":{"total":96636764160,"available":96627126272,"internally_reserved":0,"allocated":978944,"data_stored":745347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.163}]},{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.548},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.349}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.121},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.0660000000000001}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.028},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4730000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.27},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4359999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.52},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.5860000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.306},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.274}]},{"osd":1,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.387}]},{"osd":2,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2509999999999999}]},{"osd":3,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.181},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":6.0339999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":1.45},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":5.8029999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.079},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.357},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.427}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4530000000000001}]},{"osd":1,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.468},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.359}]},{"osd":3,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3280000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.107},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.274}]},{"osd":6,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1519999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.2350000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.083},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.016}]},{"osd":1,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.238}]},{"osd":3,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.266},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.1680000000000001,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.478}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.0209999999999999}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.258},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.3360000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.2909999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.367}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":3.2400000000000002,"5min":3.2400000000000002,"15min":3.2400000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.1950000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":8.8629999999999995,"5min":8.8629999999999995,"15min":8.8629999999999995},"last":1.165},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.2210000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.093}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.625},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0469999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.83699999999999997}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.339},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.206},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.405}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9396,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362444,"statfs":{"total":96636764160,"available":96627142656,"internally_reserved":0,"allocated":962560,"data_stored":738158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.218}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.175}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3919999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.353},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.454}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.516},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.492}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:13:16.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:13:16.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.603+0000 7f79f8fb4700 1 Processor -- start 2023-06-09T11:13:16.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.603+0000 7f79f8fb4700 1 -- start start 2023-06-09T11:13:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f8fb4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f79f415c780 0x7f79f40c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f8fb4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f406e160 con 0x7f79f406dca0 2023-06-09T11:13:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f8fb4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40cc980 con 0x7f79f415c3b0 2023-06-09T11:13:16.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f8fb4700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f40ccc20 con 0x7f79f415c780 2023-06-09T11:13:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f3fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f79f406dca0 0x7f79f4070530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50580/0 (socket says 172.21.15.78:50580) 2023-06-09T11:13:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f3fff700 1 -- 172.21.15.78:0/4256249247 learned_addr learned my addr 172.21.15.78:0/4256249247 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79eaffd700 1 --2- 172.21.15.78:0/4256249247 >> v2:172.21.15.187:3300/0 conn(0x7f79f415c780 0x7f79f40c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f2ffd700 1 -- 172.21.15.78:0/4256249247 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931868080 0 0) 0x7f79f406e160 con 0x7f79f406dca0 2023-06-09T11:13:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79f2ffd700 1 -- 172.21.15.78:0/4256249247 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e00035d0 con 0x7f79f406dca0 2023-06-09T11:13:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79eaffd700 1 -- 172.21.15.78:0/4256249247 >> v1:172.21.15.187:6789/0 conn(0x7f79f415c3b0 legacy=0x7f79f406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79eaffd700 1 -- 172.21.15.78:0/4256249247 >> v1:172.21.15.78:6789/0 conn(0x7f79f406dca0 legacy=0x7f79f4070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.607+0000 7f79eaffd700 1 -- 172.21.15.78:0/4256249247 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f406e400 con 0x7f79f415c780 2023-06-09T11:13:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79eaffd700 1 --2- 172.21.15.78:0/4256249247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f415c780 0x7f79f40c8fa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009850 tx=0x7f79dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07e25d4d1d654ec server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f2ffd700 1 -- 172.21.15.78:0/4256249247 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc011830 con 0x7f79f415c780 2023-06-09T11:13:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f2ffd700 1 -- 172.21.15.78:0/4256249247 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc011990 con 0x7f79f415c780 2023-06-09T11:13:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f2ffd700 1 -- 172.21.15.78:0/4256249247 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc011d40 con 0x7f79f415c780 2023-06-09T11:13:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f8fb4700 1 -- 172.21.15.78:0/4256249247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f415c780 msgr2=0x7f79f40c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/4256249247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f415c780 0x7f79f40c8fa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009850 tx=0x7f79dc009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f8fb4700 1 -- 172.21.15.78:0/4256249247 shutdown_connections 2023-06-09T11:13:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/4256249247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f415c780 0x7f79f40c8fa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f8fb4700 1 -- 172.21.15.78:0/4256249247 >> 172.21.15.78:0/4256249247 conn(0x7f79f40cf670 msgr2=0x7f79f40cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f8fb4700 1 -- 172.21.15.78:0/4256249247 shutdown_connections 2023-06-09T11:13:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.611+0000 7f79f8fb4700 1 -- 172.21.15.78:0/4256249247 wait complete. 2023-06-09T11:13:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.615+0000 7f79f8fb4700 1 Processor -- start 2023-06-09T11:13:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.615+0000 7f79f8fb4700 1 -- start start 2023-06-09T11:13:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79f406dca0 0x7f79f41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f415c3b0 0x7f79f40ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f40adfd0 0x7f79f41f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40c8310 con 0x7f79f415c3b0 2023-06-09T11:13:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40ae450 con 0x7f79f40adfd0 2023-06-09T11:13:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40c7450 con 0x7f79f406dca0 2023-06-09T11:13:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f415c3b0 0x7f79f40ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f415c3b0 0x7f79f40ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58190/0 (socket says 172.21.15.78:58190) 2023-06-09T11:13:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 -- 172.21.15.78:0/617879858 learned_addr learned my addr 172.21.15.78:0/617879858 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f3fff700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f40adfd0 0x7f79f41f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f37fe700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79f406dca0 0x7f79f41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 -- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79f406dca0 msgr2=0x7f79f41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79f406dca0 0x7f79f41591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 -- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f40adfd0 msgr2=0x7f79f41f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f40adfd0 0x7f79f41f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 -- 172.21.15.78:0/617879858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0094b0 con 0x7f79f415c3b0 2023-06-09T11:13:16.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79eaffd700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f415c3b0 0x7f79f40ada90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79dc014040 tx=0x7f79dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:16.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f0ff9700 1 -- 172.21.15.78:0/617879858 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc019ab0 con 0x7f79f415c3b0 2023-06-09T11:13:16.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f0ff9700 1 -- 172.21.15.78:0/617879858 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc01e070 con 0x7f79f415c3b0 2023-06-09T11:13:16.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f40ccf00 con 0x7f79f415c3b0 2023-06-09T11:13:16.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f0ff9700 1 -- 172.21.15.78:0/617879858 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc019e50 con 0x7f79f415c3b0 2023-06-09T11:13:16.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.619+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f40ce680 con 0x7f79f415c3b0 2023-06-09T11:13:16.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.623+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f40cd090 con 0x7f79f415c3b0 2023-06-09T11:13:16.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.623+0000 7f79f0ff9700 1 -- 172.21.15.78:0/617879858 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79dc02d450 con 0x7f79f415c3b0 2023-06-09T11:13:16.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.623+0000 7f79f0ff9700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f79d40662f0 0x7f79d40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:16.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.623+0000 7f79f0ff9700 1 -- 172.21.15.78:0/617879858 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79dc084e80 con 0x7f79f415c3b0 2023-06-09T11:13:16.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.627+0000 7f79f37fe700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f79d40662f0 0x7f79d40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:16.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.627+0000 7f79f37fe700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f79d40662f0 0x7f79d40687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f79e4000f60 tx=0x7f79e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:16.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.631+0000 7f79f0ff9700 1 -- 172.21.15.78:0/617879858 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f79dc0522f0 con 0x7f79f415c3b0 2023-06-09T11:13:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.803+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79f40c8450 con 0x7f79d40662f0 2023-06-09T11:13:16.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.819+0000 7f79f0ff9700 1 -- 172.21.15.78:0/617879858 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296422 (secure 0 0 0) 0x7f79f40c8450 con 0x7f79d40662f0 2023-06-09T11:13:16.834 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:16.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f79d40662f0 msgr2=0x7f79d40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f79d40662f0 0x7f79d40687a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f79e4000f60 tx=0x7f79e4009040 comp rx=0 tx=0).stop 2023-06-09T11:13:16.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f415c3b0 msgr2=0x7f79f40ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:16.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f415c3b0 0x7f79f40ada90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79dc014040 tx=0x7f79dc004770 comp rx=0 tx=0).stop 2023-06-09T11:13:16.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 shutdown_connections 2023-06-09T11:13:16.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f79d40662f0 0x7f79d40687a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79f40adfd0 0x7f79f41f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f415c3b0 0x7f79f40ada90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 --2- 172.21.15.78:0/617879858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79f406dca0 0x7f79f41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:16.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 >> 172.21.15.78:0/617879858 conn(0x7f79f40cf670 msgr2=0x7f79f406e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:16.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 shutdown_connections 2023-06-09T11:13:16.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:16.827+0000 7f79f8fb4700 1 -- 172.21.15.78:0/617879858 wait complete. 2023-06-09T11:13:16.841 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:13:16.859 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-06-09T11:13:15.628355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68464,"kb_used_data":4080,"kb_used_omap":0,"kb_used_meta":64320,"kb_avail":754906256,"statfs":{"total":773094113280,"available":773024006144,"internally_reserved":0,"allocated":4177920,"data_stored":2376359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65863680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.995701"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640817+0000","last_change":"2023-06-09T11:13:10.640817+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640817+0000","last_undegraded":"2023-06-09T11:13:10.640817+0000","last_fullsized":"2023-06-09T11:13:10.640817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639786+0000","last_change":"2023-06-09T11:13:10.639786+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639786+0000","last_undegraded":"2023-06-09T11:13:10.639786+0000","last_fullsized":"2023-06-09T11:13:10.639786+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641023+0000","last_change":"2023-06-09T11:13:10.641023+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641023+0000","last_undegraded":"2023-06-09T11:13:10.641023+0000","last_fullsized":"2023-06-09T11:13:10.641023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641195+0000","last_change":"2023-06-09T11:13:10.641195+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641195+0000","last_undegraded":"2023-06-09T11:13:10.641195+0000","last_fullsized":"2023-06-09T11:13:10.641195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636352+0000","last_change":"2023-06-09T11:13:10.636352+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636352+0000","last_undegraded":"2023-06-09T11:13:10.636352+0000","last_fullsized":"2023-06-09T11:13:10.636352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637505+0000","last_change":"2023-06-09T11:13:10.637505+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637505+0000","last_undegraded":"2023-06-09T11:13:10.637505+0000","last_fullsized":"2023-06-09T11:13:10.637505+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641693+0000","last_change":"2023-06-09T11:13:10.641693+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641693+0000","last_undegraded":"2023-06-09T11:13:10.641693+0000","last_fullsized":"2023-06-09T11:13:10.641693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641411+0000","last_change":"2023-06-09T11:13:10.641411+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641411+0000","last_undegraded":"2023-06-09T11:13:10.641411+0000","last_fullsized":"2023-06-09T11:13:10.641411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635951+0000","last_change":"2023-06-09T11:13:10.635951+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635951+0000","last_undegraded":"2023-06-09T11:13:10.635951+0000","last_fullsized":"2023-06-09T11:13:10.635951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636510+0000","last_change":"2023-06-09T11:13:10.636510+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636510+0000","last_undegraded":"2023-06-09T11:13:10.636510+0000","last_fullsized":"2023-06-09T11:13:10.636510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637428+0000","last_change":"2023-06-09T11:13:10.637428+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637428+0000","last_undegraded":"2023-06-09T11:13:10.637428+0000","last_fullsized":"2023-06-09T11:13:10.637428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635965+0000","last_change":"2023-06-09T11:13:10.635965+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635965+0000","last_undegraded":"2023-06-09T11:13:10.635965+0000","last_fullsized":"2023-06-09T11:13:10.635965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635928+0000","last_change":"2023-06-09T11:13:10.635928+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635928+0000","last_undegraded":"2023-06-09T11:13:10.635928+0000","last_fullsized":"2023-06-09T11:13:10.635928+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640492+0000","last_change":"2023-06-09T11:13:10.640492+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640492+0000","last_undegraded":"2023-06-09T11:13:10.640492+0000","last_fullsized":"2023-06-09T11:13:10.640492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640829+0000","last_change":"2023-06-09T11:13:10.640829+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640829+0000","last_undegraded":"2023-06-09T11:13:10.640829+0000","last_fullsized":"2023-06-09T11:13:10.640829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637259+0000","last_change":"2023-06-09T11:13:10.637259+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637259+0000","last_undegraded":"2023-06-09T11:13:10.637259+0000","last_fullsized":"2023-06-09T11:13:10.637259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637159+0000","last_change":"2023-06-09T11:13:10.637159+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637159+0000","last_undegraded":"2023-06-09T11:13:10.637159+0000","last_fullsized":"2023-06-09T11:13:10.637159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640954+0000","last_change":"2023-06-09T11:13:10.640954+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640954+0000","last_undegraded":"2023-06-09T11:13:10.640954+0000","last_fullsized":"2023-06-09T11:13:10.640954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644060+0000","last_change":"2023-06-09T11:13:10.644060+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644060+0000","last_undegraded":"2023-06-09T11:13:10.644060+0000","last_fullsized":"2023-06-09T11:13:10.644060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640396+0000","last_change":"2023-06-09T11:13:10.640396+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640396+0000","last_undegraded":"2023-06-09T11:13:10.640396+0000","last_fullsized":"2023-06-09T11:13:10.640396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644021+0000","last_change":"2023-06-09T11:13:10.644021+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644021+0000","last_undegraded":"2023-06-09T11:13:10.644021+0000","last_fullsized":"2023-06-09T11:13:10.644021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.643854+0000","last_change":"2023-06-09T11:13:10.643854+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.643854+0000","last_undegraded":"2023-06-09T11:13:10.643854+0000","last_fullsized":"2023-06-09T11:13:10.643854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637094+0000","last_change":"2023-06-09T11:13:10.637094+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637094+0000","last_undegraded":"2023-06-09T11:13:10.637094+0000","last_fullsized":"2023-06-09T11:13:10.637094+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.643986+0000","last_change":"2023-06-09T11:13:10.643986+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.643986+0000","last_undegraded":"2023-06-09T11:13:10.643986+0000","last_fullsized":"2023-06-09T11:13:10.643986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639061+0000","last_change":"2023-06-09T11:13:10.639061+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639061+0000","last_undegraded":"2023-06-09T11:13:10.639061+0000","last_fullsized":"2023-06-09T11:13:10.639061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.639311+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:13:10.639311+0000","last_peered":"2023-06-09T11:13:10.639311+0000","last_clean":"2023-06-09T11:13:10.639311+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:13:10.639311+0000","last_undegraded":"2023-06-09T11:13:10.639311+0000","last_fullsized":"2023-06-09T11:13:10.639311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:40:24.637855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.638587+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:13:10.638587+0000","last_peered":"2023-06-09T11:13:10.638587+0000","last_clean":"2023-06-09T11:13:10.638587+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:13:10.638587+0000","last_undegraded":"2023-06-09T11:13:10.638587+0000","last_fullsized":"2023-06-09T11:13:10.638587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:29.942265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636472+0000","last_change":"2023-06-09T11:13:10.636472+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636472+0000","last_undegraded":"2023-06-09T11:13:10.636472+0000","last_fullsized":"2023-06-09T11:13:10.636472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.639100+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:13:10.639100+0000","last_peered":"2023-06-09T11:13:10.639100+0000","last_clean":"2023-06-09T11:13:10.639100+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:13:10.639100+0000","last_undegraded":"2023-06-09T11:13:10.639100+0000","last_fullsized":"2023-06-09T11:13:10.639100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:22:59.667374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644335+0000","last_change":"2023-06-09T11:13:10.644335+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644335+0000","last_undegraded":"2023-06-09T11:13:10.644335+0000","last_fullsized":"2023-06-09T11:13:10.644335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.645080+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:13:10.645080+0000","last_peered":"2023-06-09T11:13:10.645080+0000","last_clean":"2023-06-09T11:13:10.645080+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:13:10.645080+0000","last_undegraded":"2023-06-09T11:13:10.645080+0000","last_fullsized":"2023-06-09T11:13:10.645080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:55:46.578471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639929+0000","last_change":"2023-06-09T11:13:10.639929+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639929+0000","last_undegraded":"2023-06-09T11:13:10.639929+0000","last_fullsized":"2023-06-09T11:13:10.639929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.638405+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:13:10.638405+0000","last_peered":"2023-06-09T11:13:10.638405+0000","last_clean":"2023-06-09T11:13:10.638405+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:13:10.638405+0000","last_undegraded":"2023-06-09T11:13:10.638405+0000","last_fullsized":"2023-06-09T11:13:10.638405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:24:16.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639873+0000","last_change":"2023-06-09T11:13:10.639873+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639873+0000","last_undegraded":"2023-06-09T11:13:10.639873+0000","last_fullsized":"2023-06-09T11:13:10.639873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.643123+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:13:10.643123+0000","last_peered":"2023-06-09T11:13:10.643123+0000","last_clean":"2023-06-09T11:13:10.643123+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:13:10.643123+0000","last_undegraded":"2023-06-09T11:13:10.643123+0000","last_fullsized":"2023-06-09T11:13:10.643123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:59.027006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640754+0000","last_change":"2023-06-09T11:13:10.640754+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640754+0000","last_undegraded":"2023-06-09T11:13:10.640754+0000","last_fullsized":"2023-06-09T11:13:10.640754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.636519+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:13:10.636519+0000","last_peered":"2023-06-09T11:13:10.636519+0000","last_clean":"2023-06-09T11:13:10.636519+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:13:10.636519+0000","last_undegraded":"2023-06-09T11:13:10.636519+0000","last_fullsized":"2023-06-09T11:13:10.636519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:29.942265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640960+0000","last_change":"2023-06-09T11:13:10.640960+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640960+0000","last_undegraded":"2023-06-09T11:13:10.640960+0000","last_fullsized":"2023-06-09T11:13:10.640960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.643160+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:13:10.643160+0000","last_peered":"2023-06-09T11:13:10.643160+0000","last_clean":"2023-06-09T11:13:10.643160+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:13:10.643160+0000","last_undegraded":"2023-06-09T11:13:10.643160+0000","last_fullsized":"2023-06-09T11:13:10.643160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:25:32.467942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635938+0000","last_change":"2023-06-09T11:13:10.635938+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635938+0000","last_undegraded":"2023-06-09T11:13:10.635938+0000","last_fullsized":"2023-06-09T11:13:10.635938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.642061+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:13:10.642061+0000","last_peered":"2023-06-09T11:13:10.642061+0000","last_clean":"2023-06-09T11:13:10.642061+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:13:10.642061+0000","last_undegraded":"2023-06-09T11:13:10.642061+0000","last_fullsized":"2023-06-09T11:13:10.642061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:38:34.563451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9412,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362428,"statfs":{"total":96636764160,"available":96627126272,"internally_reserved":0,"allocated":978944,"data_stored":745347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.163}]},{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.548},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.349}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.121},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.0660000000000001}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.028},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4730000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.27},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4359999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.52},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.5860000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.306},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.274}]},{"osd":1,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.387}]},{"osd":2,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2509999999999999}]},{"osd":3,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.181},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":6.0339999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":1.45},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":5.8029999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.079},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.357},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.427}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4530000000000001}]},{"osd":1,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.468},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.359}]},{"osd":3,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3280000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.107},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.274}]},{"osd":6,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1519999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.2350000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.083},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.016}]},{"osd":1,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.238}]},{"osd":3,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.266},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.1680000000000001,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.478}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.0209999999999999}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.258},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.3360000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.2909999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.367}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":3.2400000000000002,"5min":3.2400000000000002,"15min":3.2400000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.1950000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":8.8629999999999995,"5min":8.8629999999999995,"15min":8.8629999999999995},"last":1.165},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.2210000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.093}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.625},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0469999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.83699999999999997}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.339},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.206},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.405}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9396,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362444,"statfs":{"total":96636764160,"available":96627142656,"internally_reserved":0,"allocated":962560,"data_stored":738158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.218}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.175}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3919999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.353},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.454}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.516},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.492}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:13:16.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:13:17.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.067+0000 7f6ef1645700 1 Processor -- start 2023-06-09T11:13:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.067+0000 7f6ef1645700 1 -- start start 2023-06-09T11:13:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6ef1645700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6eec15c3b0 0x7f6eec0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6ef1645700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec06e160 con 0x7f6eec15c780 2023-06-09T11:13:17.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6ef1645700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec0cc980 con 0x7f6eec06dca0 2023-06-09T11:13:17.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6ef1645700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eec0ccc20 con 0x7f6eec15c3b0 2023-06-09T11:13:17.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eebfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6eec15c3b0 0x7f6eec0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eebfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6eec15c3b0 0x7f6eec0c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58196/0 (socket says 172.21.15.78:58196) 2023-06-09T11:13:17.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eebfff700 1 -- 172.21.15.78:0/2368279349 learned_addr learned my addr 172.21.15.78:0/2368279349 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:17.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eeb7fe700 1 --1- 172.21.15.78:0/2368279349 >> v1:172.21.15.78:6789/0 conn(0x7f6eec15c780 0x7f6eec06d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50590/0 (socket says 172.21.15.78:50590) 2023-06-09T11:13:17.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eebfff700 1 -- 172.21.15.78:0/2368279349 >> v1:172.21.15.187:6789/0 conn(0x7f6eec06dca0 legacy=0x7f6eec070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eebfff700 1 -- 172.21.15.78:0/2368279349 >> v1:172.21.15.78:6789/0 conn(0x7f6eec15c780 legacy=0x7f6eec06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eebfff700 1 -- 172.21.15.78:0/2368279349 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec06e400 con 0x7f6eec15c3b0 2023-06-09T11:13:17.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.071+0000 7f6eebfff700 1 --2- 172.21.15.78:0/2368279349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec0c8fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009910 tx=0x7f6edc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448bfb8bf230a761 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:17.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6eeaffd700 1 -- 172.21.15.78:0/2368279349 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00ba60 con 0x7f6eec15c3b0 2023-06-09T11:13:17.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6eeaffd700 1 -- 172.21.15.78:0/2368279349 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc00bbc0 con 0x7f6eec15c3b0 2023-06-09T11:13:17.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6eeaffd700 1 -- 172.21.15.78:0/2368279349 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc009e60 con 0x7f6eec15c3b0 2023-06-09T11:13:17.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 -- 172.21.15.78:0/2368279349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 msgr2=0x7f6eec0c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 --2- 172.21.15.78:0/2368279349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec0c8fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6edc009910 tx=0x7f6edc009c20 comp rx=0 tx=0).stop 2023-06-09T11:13:17.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 -- 172.21.15.78:0/2368279349 shutdown_connections 2023-06-09T11:13:17.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 --2- 172.21.15.78:0/2368279349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec0c8fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 -- 172.21.15.78:0/2368279349 >> 172.21.15.78:0/2368279349 conn(0x7f6eec0cf670 msgr2=0x7f6eec0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:17.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 -- 172.21.15.78:0/2368279349 shutdown_connections 2023-06-09T11:13:17.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 -- 172.21.15.78:0/2368279349 wait complete. 2023-06-09T11:13:17.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.075+0000 7f6ef1645700 1 Processor -- start 2023-06-09T11:13:17.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef1645700 1 -- start start 2023-06-09T11:13:17.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef1645700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6eec06dca0 0x7f6eec14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef1645700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec1e1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef1645700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eec0af190 0x7f6eec0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef1645700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec14ea40 con 0x7f6eec15c3b0 2023-06-09T11:13:17.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef1645700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0ae0f0 con 0x7f6eec0af190 2023-06-09T11:13:17.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef1645700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0ae3d0 con 0x7f6eec06dca0 2023-06-09T11:13:17.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec1e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec1e1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58210/0 (socket says 172.21.15.78:58210) 2023-06-09T11:13:17.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 -- 172.21.15.78:0/4231646670 learned_addr learned my addr 172.21.15.78:0/4231646670 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:17.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eebfff700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6eec06dca0 0x7f6eec14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6ef0e44700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eec0af190 0x7f6eec0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 -- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6eec06dca0 msgr2=0x7f6eec14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6eec06dca0 0x7f6eec14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 -- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eec0af190 msgr2=0x7f6eec0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eec0af190 0x7f6eec0c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 -- 172.21.15.78:0/4231646670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc009570 con 0x7f6eec15c3b0 2023-06-09T11:13:17.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.079+0000 7f6eeb7fe700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec1e1870 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c4d0 tx=0x7f6ee000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:17.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.083+0000 7f6ee8ff9700 1 -- 172.21.15.78:0/4231646670 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000cea0 con 0x7f6eec15c3b0 2023-06-09T11:13:17.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.083+0000 7f6ee8ff9700 1 -- 172.21.15.78:0/4231646670 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0005cd0 con 0x7f6eec15c3b0 2023-06-09T11:13:17.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.083+0000 7f6ee8ff9700 1 -- 172.21.15.78:0/4231646670 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00072d0 con 0x7f6eec15c3b0 2023-06-09T11:13:17.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.083+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec0ccf00 con 0x7f6eec15c3b0 2023-06-09T11:13:17.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.083+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec0ce680 con 0x7f6eec15c3b0 2023-06-09T11:13:17.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.083+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec0741c0 con 0x7f6eec15c3b0 2023-06-09T11:13:17.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.087+0000 7f6ee8ff9700 1 -- 172.21.15.78:0/4231646670 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ee0007430 con 0x7f6eec15c3b0 2023-06-09T11:13:17.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.087+0000 7f6ee8ff9700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed80662f0 0x7f6ed80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.087+0000 7f6ee8ff9700 1 -- 172.21.15.78:0/4231646670 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ee0082f20 con 0x7f6eec15c3b0 2023-06-09T11:13:17.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.087+0000 7f6eebfff700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed80662f0 0x7f6ed80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.091+0000 7f6eebfff700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed80662f0 0x7f6ed80687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6edc006f80 tx=0x7f6edc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:17.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.095+0000 7f6ee8ff9700 1 -- 172.21.15.78:0/4231646670 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6ee0050440 con 0x7f6eec15c3b0 2023-06-09T11:13:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.263+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6eec0cb8b0 con 0x7f6ed80662f0 2023-06-09T11:13:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.279+0000 7f6ee8ff9700 1 -- 172.21.15.78:0/4231646670 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296422 (secure 0 0 0) 0x7f6eec0cb8b0 con 0x7f6ed80662f0 2023-06-09T11:13:17.289 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:17.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed80662f0 msgr2=0x7f6ed80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed80662f0 0x7f6ed80687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6edc006f80 tx=0x7f6edc008030 comp rx=0 tx=0).stop 2023-06-09T11:13:17.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 msgr2=0x7f6eec1e1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec1e1870 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c4d0 tx=0x7f6ee000c7e0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 shutdown_connections 2023-06-09T11:13:17.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6ed80662f0 0x7f6ed80687a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6eec0af190 0x7f6eec0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6eec15c3b0 0x7f6eec1e1870 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 --2- 172.21.15.78:0/4231646670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6eec06dca0 0x7f6eec14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 >> 172.21.15.78:0/4231646670 conn(0x7f6eec0cf670 msgr2=0x7f6eec0c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:17.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 shutdown_connections 2023-06-09T11:13:17.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.287+0000 7f6ef1645700 1 -- 172.21.15.78:0/4231646670 wait complete. 2023-06-09T11:13:17.297 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:13:17.315 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-06-09T11:13:15.628355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68464,"kb_used_data":4080,"kb_used_omap":0,"kb_used_meta":64320,"kb_avail":754906256,"statfs":{"total":773094113280,"available":773024006144,"internally_reserved":0,"allocated":4177920,"data_stored":2376359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65863680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.995701"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640817+0000","last_change":"2023-06-09T11:13:10.640817+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640817+0000","last_undegraded":"2023-06-09T11:13:10.640817+0000","last_fullsized":"2023-06-09T11:13:10.640817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639786+0000","last_change":"2023-06-09T11:13:10.639786+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639786+0000","last_undegraded":"2023-06-09T11:13:10.639786+0000","last_fullsized":"2023-06-09T11:13:10.639786+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641023+0000","last_change":"2023-06-09T11:13:10.641023+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641023+0000","last_undegraded":"2023-06-09T11:13:10.641023+0000","last_fullsized":"2023-06-09T11:13:10.641023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641195+0000","last_change":"2023-06-09T11:13:10.641195+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641195+0000","last_undegraded":"2023-06-09T11:13:10.641195+0000","last_fullsized":"2023-06-09T11:13:10.641195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636352+0000","last_change":"2023-06-09T11:13:10.636352+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636352+0000","last_undegraded":"2023-06-09T11:13:10.636352+0000","last_fullsized":"2023-06-09T11:13:10.636352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637505+0000","last_change":"2023-06-09T11:13:10.637505+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637505+0000","last_undegraded":"2023-06-09T11:13:10.637505+0000","last_fullsized":"2023-06-09T11:13:10.637505+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641693+0000","last_change":"2023-06-09T11:13:10.641693+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641693+0000","last_undegraded":"2023-06-09T11:13:10.641693+0000","last_fullsized":"2023-06-09T11:13:10.641693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.641411+0000","last_change":"2023-06-09T11:13:10.641411+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.641411+0000","last_undegraded":"2023-06-09T11:13:10.641411+0000","last_fullsized":"2023-06-09T11:13:10.641411+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635951+0000","last_change":"2023-06-09T11:13:10.635951+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635951+0000","last_undegraded":"2023-06-09T11:13:10.635951+0000","last_fullsized":"2023-06-09T11:13:10.635951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636510+0000","last_change":"2023-06-09T11:13:10.636510+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636510+0000","last_undegraded":"2023-06-09T11:13:10.636510+0000","last_fullsized":"2023-06-09T11:13:10.636510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637428+0000","last_change":"2023-06-09T11:13:10.637428+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637428+0000","last_undegraded":"2023-06-09T11:13:10.637428+0000","last_fullsized":"2023-06-09T11:13:10.637428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635965+0000","last_change":"2023-06-09T11:13:10.635965+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635965+0000","last_undegraded":"2023-06-09T11:13:10.635965+0000","last_fullsized":"2023-06-09T11:13:10.635965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635928+0000","last_change":"2023-06-09T11:13:10.635928+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635928+0000","last_undegraded":"2023-06-09T11:13:10.635928+0000","last_fullsized":"2023-06-09T11:13:10.635928+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640492+0000","last_change":"2023-06-09T11:13:10.640492+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640492+0000","last_undegraded":"2023-06-09T11:13:10.640492+0000","last_fullsized":"2023-06-09T11:13:10.640492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640829+0000","last_change":"2023-06-09T11:13:10.640829+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640829+0000","last_undegraded":"2023-06-09T11:13:10.640829+0000","last_fullsized":"2023-06-09T11:13:10.640829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637259+0000","last_change":"2023-06-09T11:13:10.637259+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637259+0000","last_undegraded":"2023-06-09T11:13:10.637259+0000","last_fullsized":"2023-06-09T11:13:10.637259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637159+0000","last_change":"2023-06-09T11:13:10.637159+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637159+0000","last_undegraded":"2023-06-09T11:13:10.637159+0000","last_fullsized":"2023-06-09T11:13:10.637159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640954+0000","last_change":"2023-06-09T11:13:10.640954+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640954+0000","last_undegraded":"2023-06-09T11:13:10.640954+0000","last_fullsized":"2023-06-09T11:13:10.640954+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644060+0000","last_change":"2023-06-09T11:13:10.644060+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644060+0000","last_undegraded":"2023-06-09T11:13:10.644060+0000","last_fullsized":"2023-06-09T11:13:10.644060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640396+0000","last_change":"2023-06-09T11:13:10.640396+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640396+0000","last_undegraded":"2023-06-09T11:13:10.640396+0000","last_fullsized":"2023-06-09T11:13:10.640396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644021+0000","last_change":"2023-06-09T11:13:10.644021+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644021+0000","last_undegraded":"2023-06-09T11:13:10.644021+0000","last_fullsized":"2023-06-09T11:13:10.644021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.643854+0000","last_change":"2023-06-09T11:13:10.643854+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.643854+0000","last_undegraded":"2023-06-09T11:13:10.643854+0000","last_fullsized":"2023-06-09T11:13:10.643854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.637094+0000","last_change":"2023-06-09T11:13:10.637094+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.637094+0000","last_undegraded":"2023-06-09T11:13:10.637094+0000","last_fullsized":"2023-06-09T11:13:10.637094+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.643986+0000","last_change":"2023-06-09T11:13:10.643986+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.643986+0000","last_undegraded":"2023-06-09T11:13:10.643986+0000","last_fullsized":"2023-06-09T11:13:10.643986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639061+0000","last_change":"2023-06-09T11:13:10.639061+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639061+0000","last_undegraded":"2023-06-09T11:13:10.639061+0000","last_fullsized":"2023-06-09T11:13:10.639061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.639311+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:13:10.639311+0000","last_peered":"2023-06-09T11:13:10.639311+0000","last_clean":"2023-06-09T11:13:10.639311+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:13:10.639311+0000","last_undegraded":"2023-06-09T11:13:10.639311+0000","last_fullsized":"2023-06-09T11:13:10.639311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:40:24.637855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.638587+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:13:10.638587+0000","last_peered":"2023-06-09T11:13:10.638587+0000","last_clean":"2023-06-09T11:13:10.638587+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:13:10.638587+0000","last_undegraded":"2023-06-09T11:13:10.638587+0000","last_fullsized":"2023-06-09T11:13:10.638587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:29.942265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.636472+0000","last_change":"2023-06-09T11:13:10.636472+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.636472+0000","last_undegraded":"2023-06-09T11:13:10.636472+0000","last_fullsized":"2023-06-09T11:13:10.636472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.639100+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:13:10.639100+0000","last_peered":"2023-06-09T11:13:10.639100+0000","last_clean":"2023-06-09T11:13:10.639100+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:13:10.639100+0000","last_undegraded":"2023-06-09T11:13:10.639100+0000","last_fullsized":"2023-06-09T11:13:10.639100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:22:59.667374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.644335+0000","last_change":"2023-06-09T11:13:10.644335+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.644335+0000","last_undegraded":"2023-06-09T11:13:10.644335+0000","last_fullsized":"2023-06-09T11:13:10.644335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.645080+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:13:10.645080+0000","last_peered":"2023-06-09T11:13:10.645080+0000","last_clean":"2023-06-09T11:13:10.645080+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:13:10.645080+0000","last_undegraded":"2023-06-09T11:13:10.645080+0000","last_fullsized":"2023-06-09T11:13:10.645080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:55:46.578471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639929+0000","last_change":"2023-06-09T11:13:10.639929+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639929+0000","last_undegraded":"2023-06-09T11:13:10.639929+0000","last_fullsized":"2023-06-09T11:13:10.639929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.638405+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:13:10.638405+0000","last_peered":"2023-06-09T11:13:10.638405+0000","last_clean":"2023-06-09T11:13:10.638405+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:13:10.638405+0000","last_undegraded":"2023-06-09T11:13:10.638405+0000","last_fullsized":"2023-06-09T11:13:10.638405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:24:16.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.639873+0000","last_change":"2023-06-09T11:13:10.639873+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.639873+0000","last_undegraded":"2023-06-09T11:13:10.639873+0000","last_fullsized":"2023-06-09T11:13:10.639873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.643123+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:13:10.643123+0000","last_peered":"2023-06-09T11:13:10.643123+0000","last_clean":"2023-06-09T11:13:10.643123+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:13:10.643123+0000","last_undegraded":"2023-06-09T11:13:10.643123+0000","last_fullsized":"2023-06-09T11:13:10.643123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:59.027006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640754+0000","last_change":"2023-06-09T11:13:10.640754+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640754+0000","last_undegraded":"2023-06-09T11:13:10.640754+0000","last_fullsized":"2023-06-09T11:13:10.640754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.636519+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:13:10.636519+0000","last_peered":"2023-06-09T11:13:10.636519+0000","last_clean":"2023-06-09T11:13:10.636519+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:13:10.636519+0000","last_undegraded":"2023-06-09T11:13:10.636519+0000","last_fullsized":"2023-06-09T11:13:10.636519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:29.942265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.640960+0000","last_change":"2023-06-09T11:13:10.640960+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.640960+0000","last_undegraded":"2023-06-09T11:13:10.640960+0000","last_fullsized":"2023-06-09T11:13:10.640960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.643160+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:13:10.643160+0000","last_peered":"2023-06-09T11:13:10.643160+0000","last_clean":"2023-06-09T11:13:10.643160+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:13:10.643160+0000","last_undegraded":"2023-06-09T11:13:10.643160+0000","last_fullsized":"2023-06-09T11:13:10.643160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:25:32.467942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T11:13:11.630883+0000","last_change":"2023-06-09T11:13:11.630883+0000","last_active":"2023-06-09T11:13:11.630883+0000","last_peered":"2023-06-09T11:13:11.630883+0000","last_clean":"2023-06-09T11:13:11.630883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:11.630883+0000","last_undegraded":"2023-06-09T11:13:11.630883+0000","last_fullsized":"2023-06-09T11:13:11.630883+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-06-09T11:13:10.635938+0000","last_change":"2023-06-09T11:13:10.635938+0000","last_active":"2023-06-09T11:13:10.618166+0000","last_peered":"2023-06-09T11:13:10.618166+0000","last_clean":"2023-06-09T11:13:10.618166+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T11:13:10.635938+0000","last_undegraded":"2023-06-09T11:13:10.635938+0000","last_fullsized":"2023-06-09T11:13:10.635938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-06-09T11:13:10.642061+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:13:10.642061+0000","last_peered":"2023-06-09T11:13:10.642061+0000","last_clean":"2023-06-09T11:13:10.642061+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:13:10.642061+0000","last_undegraded":"2023-06-09T11:13:10.642061+0000","last_fullsized":"2023-06-09T11:13:10.642061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:38:34.563451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9412,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362428,"statfs":{"total":96636764160,"available":96627126272,"internally_reserved":0,"allocated":978944,"data_stored":745347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.163}]},{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.548},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.349}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.121},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.0660000000000001}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.028},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4730000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.27},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4359999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.52},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.5860000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.306},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.274}]},{"osd":1,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.387}]},{"osd":2,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.2509999999999999}]},{"osd":3,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.181},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":6.0339999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":1.45},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":5.8029999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.079},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.2210000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.357},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.427}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4530000000000001}]},{"osd":1,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.468},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.359}]},{"osd":3,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3280000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.107},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.274}]},{"osd":6,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1519999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.2350000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8372,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363468,"statfs":{"total":96636764160,"available":96628191232,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.083},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.016}]},{"osd":1,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.83699999999999997}]},{"osd":2,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.238}]},{"osd":3,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.266},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.1680000000000001,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.478}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.0209999999999999}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.258},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.3360000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.2909999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.367}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":3.2400000000000002,"5min":3.2400000000000002,"15min":3.2400000000000002},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.1950000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":8.8629999999999995,"5min":8.8629999999999995,"15min":8.8629999999999995},"last":1.165},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.2210000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8308,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363532,"statfs":{"total":96636764160,"available":96628256768,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.093}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.625},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0469999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.83699999999999997}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.339},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.206},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.405}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9396,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362444,"statfs":{"total":96636764160,"available":96627142656,"internally_reserved":0,"allocated":962560,"data_stored":738158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.218}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.175}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3919999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.353},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.454}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.516},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.492}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:13:17.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-06-09T11:13:17.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-06-09T11:13:17.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-06-09T11:13:17.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-06-09T11:13:17.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-06-09T11:13:17.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-06-09T11:13:17.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-06-09T11:13:17.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-06-09T11:13:17.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-06-09T11:13:17.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-06-09T11:13:17.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-06-09T11:13:17.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-06-09T11:13:17.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-06-09T11:13:17.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-06-09T11:13:17.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-06-09T11:13:17.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-06-09T11:13:17.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-06-09T11:13:17.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-06-09T11:13:17.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-06-09T11:13:17.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-06-09T11:13:17.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-06-09T11:13:17.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-06-09T11:13:17.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-06-09T11:13:17.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-06-09T11:13:17.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-06-09T11:13:17.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-06-09T11:13:17.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-06-09T11:13:17.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-06-09T11:13:17.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-06-09T11:13:17.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-06-09T11:13:17.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-06-09T11:13:17.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-06-09T11:13:17.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-06-09T11:13:17.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-06-09T11:13:17.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.640817+0000', 'last_change': '2023-06-09T11:13:10.640817+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.640817+0000', 'last_undegraded': '2023-06-09T11:13:10.640817+0000', 'last_fullsized': '2023-06-09T11:13:10.640817+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-09T11:13:17.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-06-09T11:13:17.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-06-09T11:13:17.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.639786+0000', 'last_change': '2023-06-09T11:13:10.639786+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.639786+0000', 'last_undegraded': '2023-06-09T11:13:10.639786+0000', 'last_fullsized': '2023-06-09T11:13:10.639786+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-09T11:13:17.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-06-09T11:13:17.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-06-09T11:13:17.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.641023+0000', 'last_change': '2023-06-09T11:13:10.641023+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.641023+0000', 'last_undegraded': '2023-06-09T11:13:10.641023+0000', 'last_fullsized': '2023-06-09T11:13:10.641023+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-09T11:13:17.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-06-09T11:13:17.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-06-09T11:13:17.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.641195+0000', 'last_change': '2023-06-09T11:13:10.641195+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.641195+0000', 'last_undegraded': '2023-06-09T11:13:10.641195+0000', 'last_fullsized': '2023-06-09T11:13:10.641195+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-09T11:13:17.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-06-09T11:13:17.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-06-09T11:13:17.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.636352+0000', 'last_change': '2023-06-09T11:13:10.636352+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.636352+0000', 'last_undegraded': '2023-06-09T11:13:10.636352+0000', 'last_fullsized': '2023-06-09T11:13:10.636352+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-09T11:13:17.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-06-09T11:13:17.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-06-09T11:13:17.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.637505+0000', 'last_change': '2023-06-09T11:13:10.637505+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.637505+0000', 'last_undegraded': '2023-06-09T11:13:10.637505+0000', 'last_fullsized': '2023-06-09T11:13:10.637505+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-09T11:13:17.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-06-09T11:13:17.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-06-09T11:13:17.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.641693+0000', 'last_change': '2023-06-09T11:13:10.641693+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.641693+0000', 'last_undegraded': '2023-06-09T11:13:10.641693+0000', 'last_fullsized': '2023-06-09T11:13:10.641693+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-09T11:13:17.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-06-09T11:13:17.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-06-09T11:13:17.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.641411+0000', 'last_change': '2023-06-09T11:13:10.641411+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.641411+0000', 'last_undegraded': '2023-06-09T11:13:10.641411+0000', 'last_fullsized': '2023-06-09T11:13:10.641411+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-09T11:13:17.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-06-09T11:13:17.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-06-09T11:13:17.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.635951+0000', 'last_change': '2023-06-09T11:13:10.635951+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.635951+0000', 'last_undegraded': '2023-06-09T11:13:10.635951+0000', 'last_fullsized': '2023-06-09T11:13:10.635951+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-09T11:13:17.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-06-09T11:13:17.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-06-09T11:13:17.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.636510+0000', 'last_change': '2023-06-09T11:13:10.636510+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.636510+0000', 'last_undegraded': '2023-06-09T11:13:10.636510+0000', 'last_fullsized': '2023-06-09T11:13:10.636510+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-09T11:13:17.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-06-09T11:13:17.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-06-09T11:13:17.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.637428+0000', 'last_change': '2023-06-09T11:13:10.637428+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.637428+0000', 'last_undegraded': '2023-06-09T11:13:10.637428+0000', 'last_fullsized': '2023-06-09T11:13:10.637428+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-09T11:13:17.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-06-09T11:13:17.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-06-09T11:13:17.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.635965+0000', 'last_change': '2023-06-09T11:13:10.635965+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.635965+0000', 'last_undegraded': '2023-06-09T11:13:10.635965+0000', 'last_fullsized': '2023-06-09T11:13:10.635965+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-09T11:13:17.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-06-09T11:13:17.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-06-09T11:13:17.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.635928+0000', 'last_change': '2023-06-09T11:13:10.635928+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.635928+0000', 'last_undegraded': '2023-06-09T11:13:10.635928+0000', 'last_fullsized': '2023-06-09T11:13:10.635928+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-09T11:13:17.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-06-09T11:13:17.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-06-09T11:13:17.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.640492+0000', 'last_change': '2023-06-09T11:13:10.640492+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.640492+0000', 'last_undegraded': '2023-06-09T11:13:10.640492+0000', 'last_fullsized': '2023-06-09T11:13:10.640492+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-09T11:13:17.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-06-09T11:13:17.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-06-09T11:13:17.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.640829+0000', 'last_change': '2023-06-09T11:13:10.640829+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.640829+0000', 'last_undegraded': '2023-06-09T11:13:10.640829+0000', 'last_fullsized': '2023-06-09T11:13:10.640829+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-09T11:13:17.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-06-09T11:13:17.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-06-09T11:13:17.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.637259+0000', 'last_change': '2023-06-09T11:13:10.637259+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.637259+0000', 'last_undegraded': '2023-06-09T11:13:10.637259+0000', 'last_fullsized': '2023-06-09T11:13:10.637259+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-09T11:13:17.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-06-09T11:13:17.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-06-09T11:13:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.637159+0000', 'last_change': '2023-06-09T11:13:10.637159+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.637159+0000', 'last_undegraded': '2023-06-09T11:13:10.637159+0000', 'last_fullsized': '2023-06-09T11:13:10.637159+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-09T11:13:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-06-09T11:13:17.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-06-09T11:13:17.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.640954+0000', 'last_change': '2023-06-09T11:13:10.640954+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.640954+0000', 'last_undegraded': '2023-06-09T11:13:10.640954+0000', 'last_fullsized': '2023-06-09T11:13:10.640954+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-09T11:13:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-06-09T11:13:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-06-09T11:13:17.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.644060+0000', 'last_change': '2023-06-09T11:13:10.644060+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.644060+0000', 'last_undegraded': '2023-06-09T11:13:10.644060+0000', 'last_fullsized': '2023-06-09T11:13:10.644060+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-09T11:13:17.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-06-09T11:13:17.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-06-09T11:13:17.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.640396+0000', 'last_change': '2023-06-09T11:13:10.640396+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.640396+0000', 'last_undegraded': '2023-06-09T11:13:10.640396+0000', 'last_fullsized': '2023-06-09T11:13:10.640396+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-09T11:13:17.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-06-09T11:13:17.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-06-09T11:13:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.644021+0000', 'last_change': '2023-06-09T11:13:10.644021+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.644021+0000', 'last_undegraded': '2023-06-09T11:13:10.644021+0000', 'last_fullsized': '2023-06-09T11:13:10.644021+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-09T11:13:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-06-09T11:13:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-06-09T11:13:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.643854+0000', 'last_change': '2023-06-09T11:13:10.643854+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.643854+0000', 'last_undegraded': '2023-06-09T11:13:10.643854+0000', 'last_fullsized': '2023-06-09T11:13:10.643854+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-09T11:13:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-06-09T11:13:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-06-09T11:13:17.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.637094+0000', 'last_change': '2023-06-09T11:13:10.637094+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.637094+0000', 'last_undegraded': '2023-06-09T11:13:10.637094+0000', 'last_fullsized': '2023-06-09T11:13:10.637094+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-09T11:13:17.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-06-09T11:13:17.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-06-09T11:13:17.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.643986+0000', 'last_change': '2023-06-09T11:13:10.643986+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.643986+0000', 'last_undegraded': '2023-06-09T11:13:10.643986+0000', 'last_fullsized': '2023-06-09T11:13:10.643986+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-09T11:13:17.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-06-09T11:13:17.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-06-09T11:13:17.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.639061+0000', 'last_change': '2023-06-09T11:13:10.639061+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.639061+0000', 'last_undegraded': '2023-06-09T11:13:10.639061+0000', 'last_fullsized': '2023-06-09T11:13:10.639061+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-09T11:13:17.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-06-09T11:13:17.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-06-09T11:13:17.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.636472+0000', 'last_change': '2023-06-09T11:13:10.636472+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.636472+0000', 'last_undegraded': '2023-06-09T11:13:10.636472+0000', 'last_fullsized': '2023-06-09T11:13:10.636472+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-09T11:13:17.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-06-09T11:13:17.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-06-09T11:13:17.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.644335+0000', 'last_change': '2023-06-09T11:13:10.644335+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.644335+0000', 'last_undegraded': '2023-06-09T11:13:10.644335+0000', 'last_fullsized': '2023-06-09T11:13:10.644335+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-09T11:13:17.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-06-09T11:13:17.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-06-09T11:13:17.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.639929+0000', 'last_change': '2023-06-09T11:13:10.639929+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.639929+0000', 'last_undegraded': '2023-06-09T11:13:10.639929+0000', 'last_fullsized': '2023-06-09T11:13:10.639929+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-09T11:13:17.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-06-09T11:13:17.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-06-09T11:13:17.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.639873+0000', 'last_change': '2023-06-09T11:13:10.639873+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.639873+0000', 'last_undegraded': '2023-06-09T11:13:10.639873+0000', 'last_fullsized': '2023-06-09T11:13:10.639873+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-09T11:13:17.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-06-09T11:13:17.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-06-09T11:13:17.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.640754+0000', 'last_change': '2023-06-09T11:13:10.640754+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.640754+0000', 'last_undegraded': '2023-06-09T11:13:10.640754+0000', 'last_fullsized': '2023-06-09T11:13:10.640754+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-09T11:13:17.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-06-09T11:13:17.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-06-09T11:13:17.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.640960+0000', 'last_change': '2023-06-09T11:13:10.640960+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.640960+0000', 'last_undegraded': '2023-06-09T11:13:10.640960+0000', 'last_fullsized': '2023-06-09T11:13:10.640960+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-09T11:13:17.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-06-09T11:13:17.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-09T11:13:11.630883+0000', 'last_change': '2023-06-09T11:13:11.630883+0000', 'last_active': '2023-06-09T11:13:11.630883+0000', 'last_peered': '2023-06-09T11:13:11.630883+0000', 'last_clean': '2023-06-09T11:13:11.630883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:11.630883+0000', 'last_undegraded': '2023-06-09T11:13:11.630883+0000', 'last_fullsized': '2023-06-09T11:13:11.630883+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:11.630883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-09T11:13:17.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-06-09T11:13:17.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2023-06-09T11:13:10.635938+0000', 'last_change': '2023-06-09T11:13:10.635938+0000', 'last_active': '2023-06-09T11:13:10.618166+0000', 'last_peered': '2023-06-09T11:13:10.618166+0000', 'last_clean': '2023-06-09T11:13:10.618166+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-09T11:13:10.635938+0000', 'last_undegraded': '2023-06-09T11:13:10.635938+0000', 'last_fullsized': '2023-06-09T11:13:10.635938+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'last_clean_scrub_stamp': '2023-06-09T11:13:10.618166+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-09T11:13:17.391 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-09T11:13:17.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.555+0000 7f3468e91700 1 Processor -- start 2023-06-09T11:13:17.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.555+0000 7f3468e91700 1 -- start start 2023-06-09T11:13:17.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3468e91700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f346406a5e0 0x7f34640ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3468e91700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640cb520 con 0x7f3464159530 2023-06-09T11:13:17.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3468e91700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640caa40 con 0x7f34640ca5c0 2023-06-09T11:13:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3468e91700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640cca40 con 0x7f346406a5e0 2023-06-09T11:13:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f346259c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3464159530 0x7f3464069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50602/0 (socket says 172.21.15.78:50602) 2023-06-09T11:13:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f346259c700 1 -- 172.21.15.78:0/370999045 learned_addr learned my addr 172.21.15.78:0/370999045 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:17.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3459d9b700 1 --2- 172.21.15.78:0/370999045 >> v2:172.21.15.187:3300/0 conn(0x7f346406a5e0 0x7f34640ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3461d9b700 1 -- 172.21.15.78:0/370999045 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913649609 0 0) 0x7f3454001110 con 0x7f3464159530 2023-06-09T11:13:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3461d9b700 1 -- 172.21.15.78:0/370999045 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34500035d0 con 0x7f3464159530 2023-06-09T11:13:17.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3459d9b700 1 -- 172.21.15.78:0/370999045 >> v1:172.21.15.187:6789/0 conn(0x7f34640ca5c0 legacy=0x7f34640cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3461d9b700 1 -- 172.21.15.78:0/370999045 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208431463 0 0) 0x7f345c001490 con 0x7f34640ca5c0 2023-06-09T11:13:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3459d9b700 1 -- 172.21.15.78:0/370999045 >> v1:172.21.15.78:6789/0 conn(0x7f3464159530 legacy=0x7f3464069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.559+0000 7f3459d9b700 1 -- 172.21.15.78:0/370999045 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640cac80 con 0x7f346406a5e0 2023-06-09T11:13:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3459d9b700 1 --2- 172.21.15.78:0/370999045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f346406a5e0 0x7f34640ca080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f344c009850 tx=0x7f344c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5204630973f3d7f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:17.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3461d9b700 1 -- 172.21.15.78:0/370999045 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c011830 con 0x7f346406a5e0 2023-06-09T11:13:17.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3461d9b700 1 -- 172.21.15.78:0/370999045 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c011990 con 0x7f346406a5e0 2023-06-09T11:13:17.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3461d9b700 1 -- 172.21.15.78:0/370999045 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c011d40 con 0x7f346406a5e0 2023-06-09T11:13:17.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3468e91700 1 -- 172.21.15.78:0/370999045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f346406a5e0 msgr2=0x7f34640ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3468e91700 1 --2- 172.21.15.78:0/370999045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f346406a5e0 0x7f34640ca080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f344c009850 tx=0x7f344c009b60 comp rx=0 tx=0).stop 2023-06-09T11:13:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3468e91700 1 -- 172.21.15.78:0/370999045 shutdown_connections 2023-06-09T11:13:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3468e91700 1 --2- 172.21.15.78:0/370999045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f346406a5e0 0x7f34640ca080 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3468e91700 1 -- 172.21.15.78:0/370999045 >> 172.21.15.78:0/370999045 conn(0x7f34640b1480 msgr2=0x7f34640cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3468e91700 1 -- 172.21.15.78:0/370999045 shutdown_connections 2023-06-09T11:13:17.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.563+0000 7f3468e91700 1 -- 172.21.15.78:0/370999045 wait complete. 2023-06-09T11:13:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 Processor -- start 2023-06-09T11:13:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 -- start start 2023-06-09T11:13:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346406a5e0 0x7f34640c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34640ca5c0 0x7f34640c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3464159530 0x7f3464155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c4950 con 0x7f346406a5e0 2023-06-09T11:13:17.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c5eb0 con 0x7f3464159530 2023-06-09T11:13:17.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f3468e91700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c4670 con 0x7f34640ca5c0 2023-06-09T11:13:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f346259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346406a5e0 0x7f34640c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f346259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346406a5e0 0x7f34640c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58214/0 (socket says 172.21.15.78:58214) 2023-06-09T11:13:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.567+0000 7f346259c700 1 -- 172.21.15.78:0/329097618 learned_addr learned my addr 172.21.15.78:0/329097618 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f3459d9b700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34640ca5c0 0x7f34640c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f3462d9d700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3464159530 0x7f3464155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f346259c700 1 -- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34640ca5c0 msgr2=0x7f34640c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f346259c700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34640ca5c0 0x7f34640c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f346259c700 1 -- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3464159530 msgr2=0x7f3464155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f346259c700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3464159530 0x7f3464155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f346259c700 1 -- 172.21.15.78:0/329097618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0094b0 con 0x7f346406a5e0 2023-06-09T11:13:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f3462d9d700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3464159530 0x7f3464155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f346259c700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346406a5e0 0x7f34640c6950 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f345400c500 tx=0x7f345400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f345b7fe700 1 -- 172.21.15.78:0/329097618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454005d90 con 0x7f346406a5e0 2023-06-09T11:13:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f345b7fe700 1 -- 172.21.15.78:0/329097618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540070d0 con 0x7f346406a5e0 2023-06-09T11:13:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34640cb240 con 0x7f346406a5e0 2023-06-09T11:13:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f345b7fe700 1 -- 172.21.15.78:0/329097618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454007460 con 0x7f346406a5e0 2023-06-09T11:13:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34640caf60 con 0x7f346406a5e0 2023-06-09T11:13:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346415d3b0 con 0x7f346406a5e0 2023-06-09T11:13:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.571+0000 7f345b7fe700 1 -- 172.21.15.78:0/329097618 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34540075c0 con 0x7f346406a5e0 2023-06-09T11:13:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.575+0000 7f345b7fe700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34440662f0 0x7f34440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.575+0000 7f345b7fe700 1 -- 172.21.15.78:0/329097618 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3454082ff0 con 0x7f346406a5e0 2023-06-09T11:13:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.575+0000 7f3459d9b700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34440662f0 0x7f34440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.575+0000 7f3459d9b700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34440662f0 0x7f34440687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f346406a9d0 tx=0x7f344c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.579+0000 7f345b7fe700 1 -- 172.21.15.78:0/329097618 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f34540504c0 con 0x7f346406a5e0 2023-06-09T11:13:17.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.815+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f34640cb520 con 0x7f346406a5e0 2023-06-09T11:13:17.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.815+0000 7f345b7fe700 1 -- 172.21.15.78:0/329097618 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1527 (secure 0 0 0) 0x7f34640cb520 con 0x7f346406a5e0 2023-06-09T11:13:17.826 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:17.826 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1686309114,"num_in_osds":8,"osd_in_since":1686309105,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":70107136,"bytes_avail":773024006144,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5137}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-06-09T11:13:03.625094+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-06-09T11:13:17.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34440662f0 msgr2=0x7f34440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34440662f0 0x7f34440687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f346406a9d0 tx=0x7f344c008030 comp rx=0 tx=0).stop 2023-06-09T11:13:17.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346406a5e0 msgr2=0x7f34640c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:17.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346406a5e0 0x7f34640c6950 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f345400c500 tx=0x7f345400c8c0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 shutdown_connections 2023-06-09T11:13:17.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34440662f0 0x7f34440687a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3464159530 0x7f3464155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34640ca5c0 0x7f34640c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 --2- 172.21.15.78:0/329097618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f346406a5e0 0x7f34640c6950 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:17.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 >> 172.21.15.78:0/329097618 conn(0x7f34640b1480 msgr2=0x7f34640afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:17.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 shutdown_connections 2023-06-09T11:13:17.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:17.819+0000 7f3468e91700 1 -- 172.21.15.78:0/329097618 wait complete. 2023-06-09T11:13:17.850 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-09T11:13:17.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:13:18.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 Processor -- start 2023-06-09T11:13:18.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 -- start start 2023-06-09T11:13:18.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f51040adfd0 0x7f5104160e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51040cc810 0x7f5104070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f510406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510406f880 con 0x7f51040cc810 2023-06-09T11:13:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510406e290 con 0x7f51040adfd0 2023-06-09T11:13:18.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.011+0000 7f510a425700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510406fdd0 con 0x7f510406d8d0 2023-06-09T11:13:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51040cc810 0x7f5104070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51040cc810 0x7f5104070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58218/0 (socket says 172.21.15.78:58218) 2023-06-09T11:13:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 -- 172.21.15.78:0/2123034259 learned_addr learned my addr 172.21.15.78:0/2123034259 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f5103fff700 1 --2- 172.21.15.78:0/2123034259 >> v2:172.21.15.187:3300/0 conn(0x7f51040adfd0 0x7f5104160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:18.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f51089c2700 1 --2- 172.21.15.78:0/2123034259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f510406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 -- 172.21.15.78:0/2123034259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 msgr2=0x7f510406dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 --2- 172.21.15.78:0/2123034259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f510406dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 -- 172.21.15.78:0/2123034259 >> v2:172.21.15.187:3300/0 conn(0x7f51040adfd0 msgr2=0x7f5104160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 --2- 172.21.15.78:0/2123034259 >> v2:172.21.15.187:3300/0 conn(0x7f51040adfd0 0x7f5104160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 -- 172.21.15.78:0/2123034259 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040ae3a0 con 0x7f51040cc810 2023-06-09T11:13:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f5103fff700 1 --2- 172.21.15.78:0/2123034259 >> v2:172.21.15.187:3300/0 conn(0x7f51040adfd0 0x7f5104160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:18.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f50fbfff700 1 --2- 172.21.15.78:0/2123034259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040cc810 0x7f5104070260 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f510406d6d0 tx=0x7f50ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edc392e1cecbad8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f51037fe700 1 -- 172.21.15.78:0/2123034259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00b8a0 con 0x7f51040cc810 2023-06-09T11:13:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f51037fe700 1 -- 172.21.15.78:0/2123034259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec00ba00 con 0x7f51040cc810 2023-06-09T11:13:18.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f51037fe700 1 -- 172.21.15.78:0/2123034259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00bd90 con 0x7f51040cc810 2023-06-09T11:13:18.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 -- 172.21.15.78:0/2123034259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040cc810 msgr2=0x7f5104070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:18.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 --2- 172.21.15.78:0/2123034259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040cc810 0x7f5104070260 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f510406d6d0 tx=0x7f50ec009bf0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 -- 172.21.15.78:0/2123034259 shutdown_connections 2023-06-09T11:13:18.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 --2- 172.21.15.78:0/2123034259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f510406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 --2- 172.21.15.78:0/2123034259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040cc810 0x7f5104070260 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 --2- 172.21.15.78:0/2123034259 >> v2:172.21.15.187:3300/0 conn(0x7f51040adfd0 0x7f5104160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 -- 172.21.15.78:0/2123034259 >> 172.21.15.78:0/2123034259 conn(0x7f51040b1480 msgr2=0x7f51040cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 -- 172.21.15.78:0/2123034259 shutdown_connections 2023-06-09T11:13:18.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.015+0000 7f510a425700 1 -- 172.21.15.78:0/2123034259 wait complete. 2023-06-09T11:13:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 Processor -- start 2023-06-09T11:13:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 -- start start 2023-06-09T11:13:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f5104151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040adfd0 0x7f5104155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:18.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51040cc810 0x7f5104155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040b1af0 con 0x7f51040adfd0 2023-06-09T11:13:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040b1d40 con 0x7f51040cc810 2023-06-09T11:13:18.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f510a425700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51040b2020 con 0x7f510406d8d0 2023-06-09T11:13:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f50fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040adfd0 0x7f5104155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f5103fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f5104151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:18.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f50fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040adfd0 0x7f5104155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58220/0 (socket says 172.21.15.78:58220) 2023-06-09T11:13:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f50fbfff700 1 -- 172.21.15.78:0/2176584986 learned_addr learned my addr 172.21.15.78:0/2176584986 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.019+0000 7f51089c2700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51040cc810 0x7f5104155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f50fbfff700 1 -- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 msgr2=0x7f5104151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f50fbfff700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f5104151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f50fbfff700 1 -- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51040cc810 msgr2=0x7f5104155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:18.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f50fbfff700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51040cc810 0x7f5104155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f50fbfff700 1 -- 172.21.15.78:0/2176584986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009570 con 0x7f51040adfd0 2023-06-09T11:13:18.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f50fbfff700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040adfd0 0x7f5104155230 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5104073aa0 tx=0x7f50ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:18.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f51017fa700 1 -- 172.21.15.78:0/2176584986 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec004440 con 0x7f51040adfd0 2023-06-09T11:13:18.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f51017fa700 1 -- 172.21.15.78:0/2176584986 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec0045a0 con 0x7f51040adfd0 2023-06-09T11:13:18.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51040cd220 con 0x7f51040adfd0 2023-06-09T11:13:18.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f51017fa700 1 -- 172.21.15.78:0/2176584986 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec011ae0 con 0x7f51040adfd0 2023-06-09T11:13:18.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51040ccf40 con 0x7f51040adfd0 2023-06-09T11:13:18.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.023+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510406fa60 con 0x7f51040adfd0 2023-06-09T11:13:18.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.027+0000 7f51017fa700 1 -- 172.21.15.78:0/2176584986 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50ec021070 con 0x7f51040adfd0 2023-06-09T11:13:18.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.027+0000 7f51017fa700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f50e4066320 0x7f50e40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:18.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.027+0000 7f51017fa700 1 -- 172.21.15.78:0/2176584986 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50ec085760 con 0x7f51040adfd0 2023-06-09T11:13:18.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.031+0000 7f5103fff700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f50e4066320 0x7f50e40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:18.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.031+0000 7f5103fff700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f50e4066320 0x7f50e40687d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f50f40099f0 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:18.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.035+0000 7f51017fa700 1 -- 172.21.15.78:0/2176584986 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f50ec052cf0 con 0x7f51040adfd0 2023-06-09T11:13:18.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.199+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51040741c0 con 0x7f50e4066320 2023-06-09T11:13:18.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.215+0000 7f51017fa700 1 -- 172.21.15.78:0/2176584986 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308398 (secure 0 0 0) 0x7f51040741c0 con 0x7f50e4066320 2023-06-09T11:13:18.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:18.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f50e4066320 msgr2=0x7f50e40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:18.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f50e4066320 0x7f50e40687d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f50f40099f0 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2023-06-09T11:13:18.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040adfd0 msgr2=0x7f5104155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:18.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040adfd0 0x7f5104155230 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5104073aa0 tx=0x7f50ec004770 comp rx=0 tx=0).stop 2023-06-09T11:13:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 shutdown_connections 2023-06-09T11:13:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f50e4066320 0x7f50e40687d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51040cc810 0x7f5104155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51040adfd0 0x7f5104155230 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 --2- 172.21.15.78:0/2176584986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f510406d8d0 0x7f5104151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 >> 172.21.15.78:0/2176584986 conn(0x7f51040b1480 msgr2=0x7f51040afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:18.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 shutdown_connections 2023-06-09T11:13:18.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:18.223+0000 7f510a425700 1 -- 172.21.15.78:0/2176584986 wait complete. 2023-06-09T11:13:18.233 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:13:18.252 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-06-09T11:13:17.628917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70244,"kb_used_data":4516,"kb_used_omap":0,"kb_used_meta":65664,"kb_avail":754904476,"statfs":{"total":773094113280,"available":773022183424,"internally_reserved":0,"allocated":4624384,"data_stored":2587545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67239936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001873"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363528+0000","last_change":"2023-06-09T11:13:12.116631+0000","last_active":"2023-06-09T11:13:14.363528+0000","last_peered":"2023-06-09T11:13:14.363528+0000","last_clean":"2023-06-09T11:13:14.363528+0000","last_became_active":"2023-06-09T11:13:12.115774+0000","last_became_peered":"2023-06-09T11:13:12.115774+0000","last_unstale":"2023-06-09T11:13:14.363528+0000","last_undegraded":"2023-06-09T11:13:14.363528+0000","last_fullsized":"2023-06-09T11:13:14.363528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:36:32.140899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363221+0000","last_change":"2023-06-09T11:13:12.118291+0000","last_active":"2023-06-09T11:13:14.363221+0000","last_peered":"2023-06-09T11:13:14.363221+0000","last_clean":"2023-06-09T11:13:14.363221+0000","last_became_active":"2023-06-09T11:13:12.117999+0000","last_became_peered":"2023-06-09T11:13:12.117999+0000","last_unstale":"2023-06-09T11:13:14.363221+0000","last_undegraded":"2023-06-09T11:13:14.363221+0000","last_fullsized":"2023-06-09T11:13:14.363221+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:25:15.747303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361691+0000","last_change":"2023-06-09T11:13:12.138623+0000","last_active":"2023-06-09T11:13:14.361691+0000","last_peered":"2023-06-09T11:13:14.361691+0000","last_clean":"2023-06-09T11:13:14.361691+0000","last_became_active":"2023-06-09T11:13:12.138345+0000","last_became_peered":"2023-06-09T11:13:12.138345+0000","last_unstale":"2023-06-09T11:13:14.361691+0000","last_undegraded":"2023-06-09T11:13:14.361691+0000","last_fullsized":"2023-06-09T11:13:14.361691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:26:11.261672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114214+0000","last_change":"2023-06-09T11:13:12.124606+0000","last_active":"2023-06-09T11:13:13.114214+0000","last_peered":"2023-06-09T11:13:13.114214+0000","last_clean":"2023-06-09T11:13:13.114214+0000","last_became_active":"2023-06-09T11:13:12.124342+0000","last_became_peered":"2023-06-09T11:13:12.124342+0000","last_unstale":"2023-06-09T11:13:13.114214+0000","last_undegraded":"2023-06-09T11:13:13.114214+0000","last_fullsized":"2023-06-09T11:13:13.114214+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:44.167709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113640+0000","last_change":"2023-06-09T11:13:12.123870+0000","last_active":"2023-06-09T11:13:13.113640+0000","last_peered":"2023-06-09T11:13:13.113640+0000","last_clean":"2023-06-09T11:13:13.113640+0000","last_became_active":"2023-06-09T11:13:12.123600+0000","last_became_peered":"2023-06-09T11:13:12.123600+0000","last_unstale":"2023-06-09T11:13:13.113640+0000","last_undegraded":"2023-06-09T11:13:13.113640+0000","last_fullsized":"2023-06-09T11:13:13.113640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:32:14.693239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359804+0000","last_change":"2023-06-09T11:13:12.120406+0000","last_active":"2023-06-09T11:13:14.359804+0000","last_peered":"2023-06-09T11:13:14.359804+0000","last_clean":"2023-06-09T11:13:14.359804+0000","last_became_active":"2023-06-09T11:13:12.120138+0000","last_became_peered":"2023-06-09T11:13:12.120138+0000","last_unstale":"2023-06-09T11:13:14.359804+0000","last_undegraded":"2023-06-09T11:13:14.359804+0000","last_fullsized":"2023-06-09T11:13:14.359804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:46.908265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116537+0000","last_change":"2023-06-09T11:13:12.134351+0000","last_active":"2023-06-09T11:13:13.116537+0000","last_peered":"2023-06-09T11:13:13.116537+0000","last_clean":"2023-06-09T11:13:13.116537+0000","last_became_active":"2023-06-09T11:13:12.134035+0000","last_became_peered":"2023-06-09T11:13:12.134035+0000","last_unstale":"2023-06-09T11:13:13.116537+0000","last_undegraded":"2023-06-09T11:13:13.116537+0000","last_fullsized":"2023-06-09T11:13:13.116537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:01:11.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362635+0000","last_change":"2023-06-09T11:13:12.127626+0000","last_active":"2023-06-09T11:13:14.362635+0000","last_peered":"2023-06-09T11:13:14.362635+0000","last_clean":"2023-06-09T11:13:14.362635+0000","last_became_active":"2023-06-09T11:13:12.127336+0000","last_became_peered":"2023-06-09T11:13:12.127336+0000","last_unstale":"2023-06-09T11:13:14.362635+0000","last_undegraded":"2023-06-09T11:13:14.362635+0000","last_fullsized":"2023-06-09T11:13:14.362635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:35:24.491437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361947+0000","last_change":"2023-06-09T11:13:12.129754+0000","last_active":"2023-06-09T11:13:14.361947+0000","last_peered":"2023-06-09T11:13:14.361947+0000","last_clean":"2023-06-09T11:13:14.361947+0000","last_became_active":"2023-06-09T11:13:12.129496+0000","last_became_peered":"2023-06-09T11:13:12.129496+0000","last_unstale":"2023-06-09T11:13:14.361947+0000","last_undegraded":"2023-06-09T11:13:14.361947+0000","last_fullsized":"2023-06-09T11:13:14.361947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:16.819164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118461+0000","last_change":"2023-06-09T11:13:12.128305+0000","last_active":"2023-06-09T11:13:13.118461+0000","last_peered":"2023-06-09T11:13:13.118461+0000","last_clean":"2023-06-09T11:13:13.118461+0000","last_became_active":"2023-06-09T11:13:12.127368+0000","last_became_peered":"2023-06-09T11:13:12.127368+0000","last_unstale":"2023-06-09T11:13:13.118461+0000","last_undegraded":"2023-06-09T11:13:13.118461+0000","last_fullsized":"2023-06-09T11:13:13.118461+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:08:40.009765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117955+0000","last_change":"2023-06-09T11:13:12.138063+0000","last_active":"2023-06-09T11:13:13.117955+0000","last_peered":"2023-06-09T11:13:13.117955+0000","last_clean":"2023-06-09T11:13:13.117955+0000","last_became_active":"2023-06-09T11:13:12.137716+0000","last_became_peered":"2023-06-09T11:13:12.137716+0000","last_unstale":"2023-06-09T11:13:13.117955+0000","last_undegraded":"2023-06-09T11:13:13.117955+0000","last_fullsized":"2023-06-09T11:13:13.117955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:56:39.219005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360234+0000","last_change":"2023-06-09T11:13:12.120026+0000","last_active":"2023-06-09T11:13:14.360234+0000","last_peered":"2023-06-09T11:13:14.360234+0000","last_clean":"2023-06-09T11:13:14.360234+0000","last_became_active":"2023-06-09T11:13:12.119749+0000","last_became_peered":"2023-06-09T11:13:12.119749+0000","last_unstale":"2023-06-09T11:13:14.360234+0000","last_undegraded":"2023-06-09T11:13:14.360234+0000","last_fullsized":"2023-06-09T11:13:14.360234+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:07:11.572866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118097+0000","last_change":"2023-06-09T11:13:12.122592+0000","last_active":"2023-06-09T11:13:13.118097+0000","last_peered":"2023-06-09T11:13:13.118097+0000","last_clean":"2023-06-09T11:13:13.118097+0000","last_became_active":"2023-06-09T11:13:12.122257+0000","last_became_peered":"2023-06-09T11:13:12.122257+0000","last_unstale":"2023-06-09T11:13:13.118097+0000","last_undegraded":"2023-06-09T11:13:13.118097+0000","last_fullsized":"2023-06-09T11:13:13.118097+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:59:29.599356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360535+0000","last_change":"2023-06-09T11:13:12.136643+0000","last_active":"2023-06-09T11:13:14.360535+0000","last_peered":"2023-06-09T11:13:14.360535+0000","last_clean":"2023-06-09T11:13:14.360535+0000","last_became_active":"2023-06-09T11:13:12.136360+0000","last_became_peered":"2023-06-09T11:13:12.136360+0000","last_unstale":"2023-06-09T11:13:14.360535+0000","last_undegraded":"2023-06-09T11:13:14.360535+0000","last_fullsized":"2023-06-09T11:13:14.360535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:43:35.600361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116757+0000","last_change":"2023-06-09T11:13:12.134263+0000","last_active":"2023-06-09T11:13:13.116757+0000","last_peered":"2023-06-09T11:13:13.116757+0000","last_clean":"2023-06-09T11:13:13.116757+0000","last_became_active":"2023-06-09T11:13:12.133950+0000","last_became_peered":"2023-06-09T11:13:12.133950+0000","last_unstale":"2023-06-09T11:13:13.116757+0000","last_undegraded":"2023-06-09T11:13:13.116757+0000","last_fullsized":"2023-06-09T11:13:13.116757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:17.292415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116705+0000","last_change":"2023-06-09T11:13:12.140277+0000","last_active":"2023-06-09T11:13:13.116705+0000","last_peered":"2023-06-09T11:13:13.116705+0000","last_clean":"2023-06-09T11:13:13.116705+0000","last_became_active":"2023-06-09T11:13:12.139992+0000","last_became_peered":"2023-06-09T11:13:12.139992+0000","last_unstale":"2023-06-09T11:13:13.116705+0000","last_undegraded":"2023-06-09T11:13:13.116705+0000","last_fullsized":"2023-06-09T11:13:13.116705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:09.181055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117458+0000","last_change":"2023-06-09T11:13:12.135061+0000","last_active":"2023-06-09T11:13:13.117458+0000","last_peered":"2023-06-09T11:13:13.117458+0000","last_clean":"2023-06-09T11:13:13.117458+0000","last_became_active":"2023-06-09T11:13:12.134776+0000","last_became_peered":"2023-06-09T11:13:12.134776+0000","last_unstale":"2023-06-09T11:13:13.117458+0000","last_undegraded":"2023-06-09T11:13:13.117458+0000","last_fullsized":"2023-06-09T11:13:13.117458+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:02:10.508533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687850+0000","last_change":"2023-06-09T11:13:12.143817+0000","last_active":"2023-06-09T11:13:13.687850+0000","last_peered":"2023-06-09T11:13:13.687850+0000","last_clean":"2023-06-09T11:13:13.687850+0000","last_became_active":"2023-06-09T11:13:12.143470+0000","last_became_peered":"2023-06-09T11:13:12.143470+0000","last_unstale":"2023-06-09T11:13:13.687850+0000","last_undegraded":"2023-06-09T11:13:13.687850+0000","last_fullsized":"2023-06-09T11:13:13.687850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:22:38.907019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114121+0000","last_change":"2023-06-09T11:13:12.117830+0000","last_active":"2023-06-09T11:13:13.114121+0000","last_peered":"2023-06-09T11:13:13.114121+0000","last_clean":"2023-06-09T11:13:13.114121+0000","last_became_active":"2023-06-09T11:13:12.117407+0000","last_became_peered":"2023-06-09T11:13:12.117407+0000","last_unstale":"2023-06-09T11:13:13.114121+0000","last_undegraded":"2023-06-09T11:13:13.114121+0000","last_fullsized":"2023-06-09T11:13:13.114121+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:25.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687608+0000","last_change":"2023-06-09T11:13:12.136549+0000","last_active":"2023-06-09T11:13:13.687608+0000","last_peered":"2023-06-09T11:13:13.687608+0000","last_clean":"2023-06-09T11:13:13.687608+0000","last_became_active":"2023-06-09T11:13:12.136243+0000","last_became_peered":"2023-06-09T11:13:12.136243+0000","last_unstale":"2023-06-09T11:13:13.687608+0000","last_undegraded":"2023-06-09T11:13:13.687608+0000","last_fullsized":"2023-06-09T11:13:13.687608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:58:01.387776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117775+0000","last_change":"2023-06-09T11:13:12.127634+0000","last_active":"2023-06-09T11:13:13.117775+0000","last_peered":"2023-06-09T11:13:13.117775+0000","last_clean":"2023-06-09T11:13:13.117775+0000","last_became_active":"2023-06-09T11:13:12.127253+0000","last_became_peered":"2023-06-09T11:13:12.127253+0000","last_unstale":"2023-06-09T11:13:13.117775+0000","last_undegraded":"2023-06-09T11:13:13.117775+0000","last_fullsized":"2023-06-09T11:13:13.117775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:09.181055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361171+0000","last_change":"2023-06-09T11:13:12.123174+0000","last_active":"2023-06-09T11:13:14.361171+0000","last_peered":"2023-06-09T11:13:14.361171+0000","last_clean":"2023-06-09T11:13:14.361171+0000","last_became_active":"2023-06-09T11:13:12.122851+0000","last_became_peered":"2023-06-09T11:13:12.122851+0000","last_unstale":"2023-06-09T11:13:14.361171+0000","last_undegraded":"2023-06-09T11:13:14.361171+0000","last_fullsized":"2023-06-09T11:13:14.361171+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:08:40.009765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116815+0000","last_change":"2023-06-09T11:13:12.128509+0000","last_active":"2023-06-09T11:13:13.116815+0000","last_peered":"2023-06-09T11:13:13.116815+0000","last_clean":"2023-06-09T11:13:13.116815+0000","last_became_active":"2023-06-09T11:13:12.127964+0000","last_became_peered":"2023-06-09T11:13:12.127964+0000","last_unstale":"2023-06-09T11:13:13.116815+0000","last_undegraded":"2023-06-09T11:13:13.116815+0000","last_fullsized":"2023-06-09T11:13:13.116815+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:56:39.219005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113443+0000","last_change":"2023-06-09T11:13:12.123847+0000","last_active":"2023-06-09T11:13:13.113443+0000","last_peered":"2023-06-09T11:13:13.113443+0000","last_clean":"2023-06-09T11:13:13.113443+0000","last_became_active":"2023-06-09T11:13:12.122193+0000","last_became_peered":"2023-06-09T11:13:12.122193+0000","last_unstale":"2023-06-09T11:13:13.113443+0000","last_undegraded":"2023-06-09T11:13:13.113443+0000","last_fullsized":"2023-06-09T11:13:13.113443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:37:11.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687830+0000","last_change":"2023-06-09T11:13:12.145549+0000","last_active":"2023-06-09T11:13:13.687830+0000","last_peered":"2023-06-09T11:13:13.687830+0000","last_clean":"2023-06-09T11:13:13.687830+0000","last_became_active":"2023-06-09T11:13:12.145069+0000","last_became_peered":"2023-06-09T11:13:12.145069+0000","last_unstale":"2023-06-09T11:13:13.687830+0000","last_undegraded":"2023-06-09T11:13:13.687830+0000","last_fullsized":"2023-06-09T11:13:13.687830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:14:10.268027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360862+0000","last_change":"2023-06-09T11:13:12.135025+0000","last_active":"2023-06-09T11:13:14.360862+0000","last_peered":"2023-06-09T11:13:14.360862+0000","last_clean":"2023-06-09T11:13:14.360862+0000","last_became_active":"2023-06-09T11:13:12.134742+0000","last_became_peered":"2023-06-09T11:13:12.134742+0000","last_unstale":"2023-06-09T11:13:14.360862+0000","last_undegraded":"2023-06-09T11:13:14.360862+0000","last_fullsized":"2023-06-09T11:13:14.360862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:36:32.140899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687817+0000","last_change":"2023-06-09T11:13:12.140792+0000","last_active":"2023-06-09T11:13:13.687817+0000","last_peered":"2023-06-09T11:13:13.687817+0000","last_clean":"2023-06-09T11:13:13.687817+0000","last_became_active":"2023-06-09T11:13:12.140503+0000","last_became_peered":"2023-06-09T11:13:12.140503+0000","last_unstale":"2023-06-09T11:13:13.687817+0000","last_undegraded":"2023-06-09T11:13:13.687817+0000","last_fullsized":"2023-06-09T11:13:13.687817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:37.974329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118262+0000","last_change":"2023-06-09T11:13:12.127654+0000","last_active":"2023-06-09T11:13:13.118262+0000","last_peered":"2023-06-09T11:13:13.118262+0000","last_clean":"2023-06-09T11:13:13.118262+0000","last_became_active":"2023-06-09T11:13:12.127290+0000","last_became_peered":"2023-06-09T11:13:12.127290+0000","last_unstale":"2023-06-09T11:13:13.118262+0000","last_undegraded":"2023-06-09T11:13:13.118262+0000","last_fullsized":"2023-06-09T11:13:13.118262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:27.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687523+0000","last_change":"2023-06-09T11:13:12.137445+0000","last_active":"2023-06-09T11:13:13.687523+0000","last_peered":"2023-06-09T11:13:13.687523+0000","last_clean":"2023-06-09T11:13:13.687523+0000","last_became_active":"2023-06-09T11:13:12.135504+0000","last_became_peered":"2023-06-09T11:13:12.135504+0000","last_unstale":"2023-06-09T11:13:13.687523+0000","last_undegraded":"2023-06-09T11:13:13.687523+0000","last_fullsized":"2023-06-09T11:13:13.687523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:25.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687427+0000","last_change":"2023-06-09T11:13:12.136260+0000","last_active":"2023-06-09T11:13:13.687427+0000","last_peered":"2023-06-09T11:13:13.687427+0000","last_clean":"2023-06-09T11:13:13.687427+0000","last_became_active":"2023-06-09T11:13:12.135925+0000","last_became_peered":"2023-06-09T11:13:12.135925+0000","last_unstale":"2023-06-09T11:13:13.687427+0000","last_undegraded":"2023-06-09T11:13:13.687427+0000","last_fullsized":"2023-06-09T11:13:13.687427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:28:43.796872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116983+0000","last_change":"2023-06-09T11:13:12.128675+0000","last_active":"2023-06-09T11:13:13.116983+0000","last_peered":"2023-06-09T11:13:13.116983+0000","last_clean":"2023-06-09T11:13:13.116983+0000","last_became_active":"2023-06-09T11:13:12.128268+0000","last_became_peered":"2023-06-09T11:13:12.128268+0000","last_unstale":"2023-06-09T11:13:13.116983+0000","last_undegraded":"2023-06-09T11:13:13.116983+0000","last_fullsized":"2023-06-09T11:13:13.116983+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:59:29.599356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359807+0000","last_change":"2023-06-09T11:13:12.118278+0000","last_active":"2023-06-09T11:13:14.359807+0000","last_peered":"2023-06-09T11:13:14.359807+0000","last_clean":"2023-06-09T11:13:14.359807+0000","last_became_active":"2023-06-09T11:13:12.117978+0000","last_became_peered":"2023-06-09T11:13:12.117978+0000","last_unstale":"2023-06-09T11:13:14.359807+0000","last_undegraded":"2023-06-09T11:13:14.359807+0000","last_fullsized":"2023-06-09T11:13:14.359807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:21:36.929009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116702+0000","last_change":"2023-06-09T11:13:12.140329+0000","last_active":"2023-06-09T11:13:13.116702+0000","last_peered":"2023-06-09T11:13:13.116702+0000","last_clean":"2023-06-09T11:13:13.116702+0000","last_became_active":"2023-06-09T11:13:12.139993+0000","last_became_peered":"2023-06-09T11:13:12.139993+0000","last_unstale":"2023-06-09T11:13:13.116702+0000","last_undegraded":"2023-06-09T11:13:13.116702+0000","last_fullsized":"2023-06-09T11:13:13.116702+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:45.926042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687924+0000","last_change":"2023-06-09T11:13:11.668447+0000","last_active":"2023-06-09T11:13:13.687924+0000","last_peered":"2023-06-09T11:13:13.687924+0000","last_clean":"2023-06-09T11:13:13.687924+0000","last_became_active":"2023-06-09T11:13:11.668155+0000","last_became_peered":"2023-06-09T11:13:11.668155+0000","last_unstale":"2023-06-09T11:13:13.687924+0000","last_undegraded":"2023-06-09T11:13:13.687924+0000","last_fullsized":"2023-06-09T11:13:13.687924+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:39:13.867580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360777+0000","last_change":"2023-06-09T11:13:12.138585+0000","last_active":"2023-06-09T11:13:14.360777+0000","last_peered":"2023-06-09T11:13:14.360777+0000","last_clean":"2023-06-09T11:13:14.360777+0000","last_became_active":"2023-06-09T11:13:12.138311+0000","last_became_peered":"2023-06-09T11:13:12.138311+0000","last_unstale":"2023-06-09T11:13:14.360777+0000","last_undegraded":"2023-06-09T11:13:14.360777+0000","last_fullsized":"2023-06-09T11:13:14.360777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:08:12.608038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361711+0000","last_change":"2023-06-09T11:13:11.659366+0000","last_active":"2023-06-09T11:13:14.361711+0000","last_peered":"2023-06-09T11:13:14.361711+0000","last_clean":"2023-06-09T11:13:14.361711+0000","last_became_active":"2023-06-09T11:13:11.658928+0000","last_became_peered":"2023-06-09T11:13:11.658928+0000","last_unstale":"2023-06-09T11:13:14.361711+0000","last_undegraded":"2023-06-09T11:13:14.361711+0000","last_fullsized":"2023-06-09T11:13:14.361711+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:35:23.478720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361230+0000","last_change":"2023-06-09T11:13:12.141236+0000","last_active":"2023-06-09T11:13:14.361230+0000","last_peered":"2023-06-09T11:13:14.361230+0000","last_clean":"2023-06-09T11:13:14.361230+0000","last_became_active":"2023-06-09T11:13:12.140928+0000","last_became_peered":"2023-06-09T11:13:12.140928+0000","last_unstale":"2023-06-09T11:13:14.361230+0000","last_undegraded":"2023-06-09T11:13:14.361230+0000","last_fullsized":"2023-06-09T11:13:14.361230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:02:10.508533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360996+0000","last_change":"2023-06-09T11:13:11.665234+0000","last_active":"2023-06-09T11:13:14.360996+0000","last_peered":"2023-06-09T11:13:14.360996+0000","last_clean":"2023-06-09T11:13:14.360996+0000","last_became_active":"2023-06-09T11:13:11.664016+0000","last_became_peered":"2023-06-09T11:13:11.664016+0000","last_unstale":"2023-06-09T11:13:14.360996+0000","last_undegraded":"2023-06-09T11:13:14.360996+0000","last_fullsized":"2023-06-09T11:13:14.360996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:58:17.649635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363170+0000","last_change":"2023-06-09T11:13:12.147279+0000","last_active":"2023-06-09T11:13:14.363170+0000","last_peered":"2023-06-09T11:13:14.363170+0000","last_clean":"2023-06-09T11:13:14.363170+0000","last_became_active":"2023-06-09T11:13:12.146954+0000","last_became_peered":"2023-06-09T11:13:12.146954+0000","last_unstale":"2023-06-09T11:13:14.363170+0000","last_undegraded":"2023-06-09T11:13:14.363170+0000","last_fullsized":"2023-06-09T11:13:14.363170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:04.637088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361159+0000","last_change":"2023-06-09T11:13:11.663154+0000","last_active":"2023-06-09T11:13:14.361159+0000","last_peered":"2023-06-09T11:13:14.361159+0000","last_clean":"2023-06-09T11:13:14.361159+0000","last_became_active":"2023-06-09T11:13:11.662695+0000","last_became_peered":"2023-06-09T11:13:11.662695+0000","last_unstale":"2023-06-09T11:13:14.361159+0000","last_undegraded":"2023-06-09T11:13:14.361159+0000","last_fullsized":"2023-06-09T11:13:14.361159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:38:50.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361384+0000","last_change":"2023-06-09T11:13:12.115402+0000","last_active":"2023-06-09T11:13:14.361384+0000","last_peered":"2023-06-09T11:13:14.361384+0000","last_clean":"2023-06-09T11:13:14.361384+0000","last_became_active":"2023-06-09T11:13:12.114956+0000","last_became_peered":"2023-06-09T11:13:12.114956+0000","last_unstale":"2023-06-09T11:13:14.361384+0000","last_undegraded":"2023-06-09T11:13:14.361384+0000","last_fullsized":"2023-06-09T11:13:14.361384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:08.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118656+0000","last_change":"2023-06-09T11:13:11.659850+0000","last_active":"2023-06-09T11:13:13.118656+0000","last_peered":"2023-06-09T11:13:13.118656+0000","last_clean":"2023-06-09T11:13:13.118656+0000","last_became_active":"2023-06-09T11:13:11.659566+0000","last_became_peered":"2023-06-09T11:13:11.659566+0000","last_unstale":"2023-06-09T11:13:13.118656+0000","last_undegraded":"2023-06-09T11:13:13.118656+0000","last_fullsized":"2023-06-09T11:13:13.118656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:04.295154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116885+0000","last_change":"2023-06-09T11:13:12.132581+0000","last_active":"2023-06-09T11:13:13.116885+0000","last_peered":"2023-06-09T11:13:13.116885+0000","last_clean":"2023-06-09T11:13:13.116885+0000","last_became_active":"2023-06-09T11:13:12.129460+0000","last_became_peered":"2023-06-09T11:13:12.129460+0000","last_unstale":"2023-06-09T11:13:13.116885+0000","last_undegraded":"2023-06-09T11:13:13.116885+0000","last_fullsized":"2023-06-09T11:13:13.116885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:39.958536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117290+0000","last_change":"2023-06-09T11:13:11.662459+0000","last_active":"2023-06-09T11:13:13.117290+0000","last_peered":"2023-06-09T11:13:13.117290+0000","last_clean":"2023-06-09T11:13:13.117290+0000","last_became_active":"2023-06-09T11:13:11.661063+0000","last_became_peered":"2023-06-09T11:13:11.661063+0000","last_unstale":"2023-06-09T11:13:13.117290+0000","last_undegraded":"2023-06-09T11:13:13.117290+0000","last_fullsized":"2023-06-09T11:13:13.117290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:08:38.997048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360853+0000","last_change":"2023-06-09T11:13:12.139699+0000","last_active":"2023-06-09T11:13:14.360853+0000","last_peered":"2023-06-09T11:13:14.360853+0000","last_clean":"2023-06-09T11:13:14.360853+0000","last_became_active":"2023-06-09T11:13:12.139089+0000","last_became_peered":"2023-06-09T11:13:12.139089+0000","last_unstale":"2023-06-09T11:13:14.360853+0000","last_undegraded":"2023-06-09T11:13:14.360853+0000","last_fullsized":"2023-06-09T11:13:14.360853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:27.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359825+0000","last_change":"2023-06-09T11:13:11.660734+0000","last_active":"2023-06-09T11:13:14.359825+0000","last_peered":"2023-06-09T11:13:14.359825+0000","last_clean":"2023-06-09T11:13:14.359825+0000","last_became_active":"2023-06-09T11:13:11.660453+0000","last_became_peered":"2023-06-09T11:13:11.660453+0000","last_unstale":"2023-06-09T11:13:14.359825+0000","last_undegraded":"2023-06-09T11:13:14.359825+0000","last_fullsized":"2023-06-09T11:13:14.359825+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:39:04.731067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362804+0000","last_change":"2023-06-09T11:13:12.123005+0000","last_active":"2023-06-09T11:13:14.362804+0000","last_peered":"2023-06-09T11:13:14.362804+0000","last_clean":"2023-06-09T11:13:14.362804+0000","last_became_active":"2023-06-09T11:13:12.122610+0000","last_became_peered":"2023-06-09T11:13:12.122610+0000","last_unstale":"2023-06-09T11:13:14.362804+0000","last_undegraded":"2023-06-09T11:13:14.362804+0000","last_fullsized":"2023-06-09T11:13:14.362804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:46.908265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360352+0000","last_change":"2023-06-09T11:13:11.666490+0000","last_active":"2023-06-09T11:13:14.360352+0000","last_peered":"2023-06-09T11:13:14.360352+0000","last_clean":"2023-06-09T11:13:14.360352+0000","last_became_active":"2023-06-09T11:13:11.666207+0000","last_became_peered":"2023-06-09T11:13:11.666207+0000","last_unstale":"2023-06-09T11:13:14.360352+0000","last_undegraded":"2023-06-09T11:13:14.360352+0000","last_fullsized":"2023-06-09T11:13:14.360352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:56:38.206288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114201+0000","last_change":"2023-06-09T11:13:12.114772+0000","last_active":"2023-06-09T11:13:13.114201+0000","last_peered":"2023-06-09T11:13:13.114201+0000","last_clean":"2023-06-09T11:13:13.114201+0000","last_became_active":"2023-06-09T11:13:12.111498+0000","last_became_peered":"2023-06-09T11:13:12.111498+0000","last_unstale":"2023-06-09T11:13:13.114201+0000","last_undegraded":"2023-06-09T11:13:13.114201+0000","last_fullsized":"2023-06-09T11:13:13.114201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:28:43.796872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363614+0000","last_change":"2023-06-09T11:13:11.663569+0000","last_active":"2023-06-09T11:13:14.363614+0000","last_peered":"2023-06-09T11:13:14.363614+0000","last_clean":"2023-06-09T11:13:14.363614+0000","last_became_active":"2023-06-09T11:13:11.663267+0000","last_became_peered":"2023-06-09T11:13:11.663267+0000","last_unstale":"2023-06-09T11:13:14.363614+0000","last_undegraded":"2023-06-09T11:13:14.363614+0000","last_fullsized":"2023-06-09T11:13:14.363614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:58:17.649635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116901+0000","last_change":"2023-06-09T11:13:12.143027+0000","last_active":"2023-06-09T11:13:13.116901+0000","last_peered":"2023-06-09T11:13:13.116901+0000","last_clean":"2023-06-09T11:13:13.116901+0000","last_became_active":"2023-06-09T11:13:12.142566+0000","last_became_peered":"2023-06-09T11:13:12.142566+0000","last_unstale":"2023-06-09T11:13:13.116901+0000","last_undegraded":"2023-06-09T11:13:13.116901+0000","last_fullsized":"2023-06-09T11:13:13.116901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:07.219044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118595+0000","last_change":"2023-06-09T11:13:11.663036+0000","last_active":"2023-06-09T11:13:13.118595+0000","last_peered":"2023-06-09T11:13:13.118595+0000","last_clean":"2023-06-09T11:13:13.118595+0000","last_became_active":"2023-06-09T11:13:11.662742+0000","last_became_peered":"2023-06-09T11:13:11.662742+0000","last_unstale":"2023-06-09T11:13:13.118595+0000","last_undegraded":"2023-06-09T11:13:13.118595+0000","last_fullsized":"2023-06-09T11:13:13.118595+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:02:09.495816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361636+0000","last_change":"2023-06-09T11:13:12.126002+0000","last_active":"2023-06-09T11:13:14.361636+0000","last_peered":"2023-06-09T11:13:14.361636+0000","last_clean":"2023-06-09T11:13:14.361636+0000","last_became_active":"2023-06-09T11:13:12.125703+0000","last_became_peered":"2023-06-09T11:13:12.125703+0000","last_unstale":"2023-06-09T11:13:14.361636+0000","last_undegraded":"2023-06-09T11:13:14.361636+0000","last_fullsized":"2023-06-09T11:13:14.361636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:01:28.605875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118030+0000","last_change":"2023-06-09T11:13:11.665437+0000","last_active":"2023-06-09T11:13:13.118030+0000","last_peered":"2023-06-09T11:13:13.118030+0000","last_clean":"2023-06-09T11:13:13.118030+0000","last_became_active":"2023-06-09T11:13:11.665125+0000","last_became_peered":"2023-06-09T11:13:11.665125+0000","last_unstale":"2023-06-09T11:13:13.118030+0000","last_undegraded":"2023-06-09T11:13:13.118030+0000","last_fullsized":"2023-06-09T11:13:13.118030+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:06.206327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361101+0000","last_change":"2023-06-09T11:13:12.123576+0000","last_active":"2023-06-09T11:13:14.361101+0000","last_peered":"2023-06-09T11:13:14.361101+0000","last_clean":"2023-06-09T11:13:14.361101+0000","last_became_active":"2023-06-09T11:13:12.123297+0000","last_became_peered":"2023-06-09T11:13:12.123297+0000","last_unstale":"2023-06-09T11:13:14.361101+0000","last_undegraded":"2023-06-09T11:13:14.361101+0000","last_fullsized":"2023-06-09T11:13:14.361101+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:47:46.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363356+0000","last_change":"2023-06-09T11:13:11.658004+0000","last_active":"2023-06-09T11:13:14.363356+0000","last_peered":"2023-06-09T11:13:14.363356+0000","last_clean":"2023-06-09T11:13:14.363356+0000","last_became_active":"2023-06-09T11:13:11.657705+0000","last_became_peered":"2023-06-09T11:13:11.657705+0000","last_unstale":"2023-06-09T11:13:14.363356+0000","last_undegraded":"2023-06-09T11:13:14.363356+0000","last_fullsized":"2023-06-09T11:13:14.363356+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:08.246932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360324+0000","last_change":"2023-06-09T11:13:12.123063+0000","last_active":"2023-06-09T11:13:14.360324+0000","last_peered":"2023-06-09T11:13:14.360324+0000","last_clean":"2023-06-09T11:13:14.360324+0000","last_became_active":"2023-06-09T11:13:12.122776+0000","last_became_peered":"2023-06-09T11:13:12.122776+0000","last_unstale":"2023-06-09T11:13:14.360324+0000","last_undegraded":"2023-06-09T11:13:14.360324+0000","last_fullsized":"2023-06-09T11:13:14.360324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:57:41.668832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363201+0000","last_change":"2023-06-09T11:13:11.659008+0000","last_active":"2023-06-09T11:13:14.363201+0000","last_peered":"2023-06-09T11:13:14.363201+0000","last_clean":"2023-06-09T11:13:14.363201+0000","last_became_active":"2023-06-09T11:13:11.658714+0000","last_became_peered":"2023-06-09T11:13:11.658714+0000","last_unstale":"2023-06-09T11:13:14.363201+0000","last_undegraded":"2023-06-09T11:13:14.363201+0000","last_fullsized":"2023-06-09T11:13:14.363201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:00:37.945261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362712+0000","last_change":"2023-06-09T11:13:12.115763+0000","last_active":"2023-06-09T11:13:14.362712+0000","last_peered":"2023-06-09T11:13:14.362712+0000","last_clean":"2023-06-09T11:13:14.362712+0000","last_became_active":"2023-06-09T11:13:12.115412+0000","last_became_peered":"2023-06-09T11:13:12.115412+0000","last_unstale":"2023-06-09T11:13:14.362712+0000","last_undegraded":"2023-06-09T11:13:14.362712+0000","last_fullsized":"2023-06-09T11:13:14.362712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:16.819164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360103+0000","last_change":"2023-06-09T11:13:11.665770+0000","last_active":"2023-06-09T11:13:14.360103+0000","last_peered":"2023-06-09T11:13:14.360103+0000","last_clean":"2023-06-09T11:13:14.360103+0000","last_became_active":"2023-06-09T11:13:11.665303+0000","last_became_peered":"2023-06-09T11:13:11.665303+0000","last_unstale":"2023-06-09T11:13:14.360103+0000","last_undegraded":"2023-06-09T11:13:14.360103+0000","last_fullsized":"2023-06-09T11:13:14.360103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:03.624371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117374+0000","last_change":"2023-06-09T11:13:12.125777+0000","last_active":"2023-06-09T11:13:13.117374+0000","last_peered":"2023-06-09T11:13:13.117374+0000","last_clean":"2023-06-09T11:13:13.117374+0000","last_became_active":"2023-06-09T11:13:12.125481+0000","last_became_peered":"2023-06-09T11:13:12.125481+0000","last_unstale":"2023-06-09T11:13:13.117374+0000","last_undegraded":"2023-06-09T11:13:13.117374+0000","last_fullsized":"2023-06-09T11:13:13.117374+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:38:51.762609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687350+0000","last_change":"2023-06-09T11:13:11.668442+0000","last_active":"2023-06-09T11:13:13.687350+0000","last_peered":"2023-06-09T11:13:13.687350+0000","last_clean":"2023-06-09T11:13:13.687350+0000","last_became_active":"2023-06-09T11:13:11.668095+0000","last_became_peered":"2023-06-09T11:13:11.668095+0000","last_unstale":"2023-06-09T11:13:13.687350+0000","last_undegraded":"2023-06-09T11:13:13.687350+0000","last_fullsized":"2023-06-09T11:13:13.687350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:43.154992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362970+0000","last_change":"2023-06-09T11:13:12.114274+0000","last_active":"2023-06-09T11:13:14.362970+0000","last_peered":"2023-06-09T11:13:14.362970+0000","last_clean":"2023-06-09T11:13:14.362970+0000","last_became_active":"2023-06-09T11:13:12.114052+0000","last_became_peered":"2023-06-09T11:13:12.114052+0000","last_unstale":"2023-06-09T11:13:14.362970+0000","last_undegraded":"2023-06-09T11:13:14.362970+0000","last_fullsized":"2023-06-09T11:13:14.362970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:39:05.743784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116442+0000","last_change":"2023-06-09T11:13:11.663051+0000","last_active":"2023-06-09T11:13:13.116442+0000","last_peered":"2023-06-09T11:13:13.116442+0000","last_clean":"2023-06-09T11:13:13.116442+0000","last_became_active":"2023-06-09T11:13:11.662649+0000","last_became_peered":"2023-06-09T11:13:11.662649+0000","last_unstale":"2023-06-09T11:13:13.116442+0000","last_undegraded":"2023-06-09T11:13:13.116442+0000","last_fullsized":"2023-06-09T11:13:13.116442+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:38.945819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363270+0000","last_change":"2023-06-09T11:13:12.141688+0000","last_active":"2023-06-09T11:13:14.363270+0000","last_peered":"2023-06-09T11:13:14.363270+0000","last_clean":"2023-06-09T11:13:14.363270+0000","last_became_active":"2023-06-09T11:13:12.141413+0000","last_became_peered":"2023-06-09T11:13:12.141413+0000","last_unstale":"2023-06-09T11:13:14.363270+0000","last_undegraded":"2023-06-09T11:13:14.363270+0000","last_fullsized":"2023-06-09T11:13:14.363270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:48.904833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118545+0000","last_change":"2023-06-09T11:13:11.661793+0000","last_active":"2023-06-09T11:13:13.118545+0000","last_peered":"2023-06-09T11:13:13.118545+0000","last_clean":"2023-06-09T11:13:13.118545+0000","last_became_active":"2023-06-09T11:13:11.661470+0000","last_became_peered":"2023-06-09T11:13:11.661470+0000","last_unstale":"2023-06-09T11:13:13.118545+0000","last_undegraded":"2023-06-09T11:13:13.118545+0000","last_fullsized":"2023-06-09T11:13:13.118545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:38:50.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118096+0000","last_change":"2023-06-09T11:13:12.122880+0000","last_active":"2023-06-09T11:13:13.118096+0000","last_peered":"2023-06-09T11:13:13.118096+0000","last_clean":"2023-06-09T11:13:13.118096+0000","last_became_active":"2023-06-09T11:13:12.122579+0000","last_became_peered":"2023-06-09T11:13:12.122579+0000","last_unstale":"2023-06-09T11:13:13.118096+0000","last_undegraded":"2023-06-09T11:13:13.118096+0000","last_fullsized":"2023-06-09T11:13:13.118096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:43:35.600361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361306+0000","last_change":"2023-06-09T11:13:11.663975+0000","last_active":"2023-06-09T11:13:14.361306+0000","last_peered":"2023-06-09T11:13:14.361306+0000","last_clean":"2023-06-09T11:13:14.361306+0000","last_became_active":"2023-06-09T11:13:11.663677+0000","last_became_peered":"2023-06-09T11:13:11.663677+0000","last_unstale":"2023-06-09T11:13:14.361306+0000","last_undegraded":"2023-06-09T11:13:14.361306+0000","last_fullsized":"2023-06-09T11:13:14.361306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:04.295154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361135+0000","last_change":"2023-06-09T11:13:12.116720+0000","last_active":"2023-06-09T11:13:14.361135+0000","last_peered":"2023-06-09T11:13:14.361135+0000","last_clean":"2023-06-09T11:13:14.361135+0000","last_became_active":"2023-06-09T11:13:12.116407+0000","last_became_peered":"2023-06-09T11:13:12.116407+0000","last_unstale":"2023-06-09T11:13:14.361135+0000","last_undegraded":"2023-06-09T11:13:14.361135+0000","last_fullsized":"2023-06-09T11:13:14.361135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:35.231150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114056+0000","last_change":"2023-06-09T11:13:11.655670+0000","last_active":"2023-06-09T11:13:13.114056+0000","last_peered":"2023-06-09T11:13:13.114056+0000","last_clean":"2023-06-09T11:13:13.114056+0000","last_became_active":"2023-06-09T11:13:11.655398+0000","last_became_peered":"2023-06-09T11:13:11.655398+0000","last_unstale":"2023-06-09T11:13:13.114056+0000","last_undegraded":"2023-06-09T11:13:13.114056+0000","last_fullsized":"2023-06-09T11:13:13.114056+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:05.401534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114284+0000","last_change":"2023-06-09T11:13:12.115293+0000","last_active":"2023-06-09T11:13:13.114284+0000","last_peered":"2023-06-09T11:13:13.114284+0000","last_clean":"2023-06-09T11:13:13.114284+0000","last_became_active":"2023-06-09T11:13:12.115011+0000","last_became_peered":"2023-06-09T11:13:12.115011+0000","last_unstale":"2023-06-09T11:13:13.114284+0000","last_undegraded":"2023-06-09T11:13:13.114284+0000","last_fullsized":"2023-06-09T11:13:13.114284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:58:04.290258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360359+0000","last_change":"2023-06-09T11:13:11.663139+0000","last_active":"2023-06-09T11:13:14.360359+0000","last_peered":"2023-06-09T11:13:14.360359+0000","last_clean":"2023-06-09T11:13:14.360359+0000","last_became_active":"2023-06-09T11:13:11.662838+0000","last_became_peered":"2023-06-09T11:13:11.662838+0000","last_unstale":"2023-06-09T11:13:14.360359+0000","last_undegraded":"2023-06-09T11:13:14.360359+0000","last_fullsized":"2023-06-09T11:13:14.360359+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:00:37.945261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117649+0000","last_change":"2023-06-09T11:13:12.127526+0000","last_active":"2023-06-09T11:13:13.117649+0000","last_peered":"2023-06-09T11:13:13.117649+0000","last_clean":"2023-06-09T11:13:13.117649+0000","last_became_active":"2023-06-09T11:13:12.127267+0000","last_became_peered":"2023-06-09T11:13:12.127267+0000","last_unstale":"2023-06-09T11:13:13.117649+0000","last_undegraded":"2023-06-09T11:13:13.117649+0000","last_fullsized":"2023-06-09T11:13:13.117649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:45.875490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113820+0000","last_change":"2023-06-09T11:13:11.659747+0000","last_active":"2023-06-09T11:13:13.113820+0000","last_peered":"2023-06-09T11:13:13.113820+0000","last_clean":"2023-06-09T11:13:13.113820+0000","last_became_active":"2023-06-09T11:13:11.659482+0000","last_became_peered":"2023-06-09T11:13:11.659482+0000","last_unstale":"2023-06-09T11:13:13.113820+0000","last_undegraded":"2023-06-09T11:13:13.113820+0000","last_fullsized":"2023-06-09T11:13:13.113820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:45:40.555763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360952+0000","last_change":"2023-06-09T11:13:12.120429+0000","last_active":"2023-06-09T11:13:14.360952+0000","last_peered":"2023-06-09T11:13:14.360952+0000","last_clean":"2023-06-09T11:13:14.360952+0000","last_became_active":"2023-06-09T11:13:12.120140+0000","last_became_peered":"2023-06-09T11:13:12.120140+0000","last_unstale":"2023-06-09T11:13:14.360952+0000","last_undegraded":"2023-06-09T11:13:14.360952+0000","last_fullsized":"2023-06-09T11:13:14.360952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:52:01.329739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113728+0000","last_change":"2023-06-09T11:13:11.662342+0000","last_active":"2023-06-09T11:13:13.113728+0000","last_peered":"2023-06-09T11:13:13.113728+0000","last_clean":"2023-06-09T11:13:13.113728+0000","last_became_active":"2023-06-09T11:13:11.662060+0000","last_became_peered":"2023-06-09T11:13:11.662060+0000","last_unstale":"2023-06-09T11:13:13.113728+0000","last_undegraded":"2023-06-09T11:13:13.113728+0000","last_fullsized":"2023-06-09T11:13:13.113728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:02:06.851570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117732+0000","last_change":"2023-06-09T11:13:12.138545+0000","last_active":"2023-06-09T11:13:13.117732+0000","last_peered":"2023-06-09T11:13:13.117732+0000","last_clean":"2023-06-09T11:13:13.117732+0000","last_became_active":"2023-06-09T11:13:12.138221+0000","last_became_peered":"2023-06-09T11:13:12.138221+0000","last_unstale":"2023-06-09T11:13:13.117732+0000","last_undegraded":"2023-06-09T11:13:13.117732+0000","last_fullsized":"2023-06-09T11:13:13.117732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:45.926042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117087+0000","last_change":"2023-06-09T11:13:11.667366+0000","last_active":"2023-06-09T11:13:13.117087+0000","last_peered":"2023-06-09T11:13:13.117087+0000","last_clean":"2023-06-09T11:13:13.117087+0000","last_became_active":"2023-06-09T11:13:11.667056+0000","last_became_peered":"2023-06-09T11:13:11.667056+0000","last_unstale":"2023-06-09T11:13:13.117087+0000","last_undegraded":"2023-06-09T11:13:13.117087+0000","last_fullsized":"2023-06-09T11:13:13.117087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:47:45.561611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363106+0000","last_change":"2023-06-09T11:13:12.122628+0000","last_active":"2023-06-09T11:13:14.363106+0000","last_peered":"2023-06-09T11:13:14.363106+0000","last_clean":"2023-06-09T11:13:14.363106+0000","last_became_active":"2023-06-09T11:13:12.122345+0000","last_became_peered":"2023-06-09T11:13:12.122345+0000","last_unstale":"2023-06-09T11:13:14.363106+0000","last_undegraded":"2023-06-09T11:13:14.363106+0000","last_fullsized":"2023-06-09T11:13:14.363106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:55.327103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113556+0000","last_change":"2023-06-09T11:13:11.660769+0000","last_active":"2023-06-09T11:13:13.113556+0000","last_peered":"2023-06-09T11:13:13.113556+0000","last_clean":"2023-06-09T11:13:13.113556+0000","last_became_active":"2023-06-09T11:13:11.660439+0000","last_became_peered":"2023-06-09T11:13:11.660439+0000","last_unstale":"2023-06-09T11:13:13.113556+0000","last_undegraded":"2023-06-09T11:13:13.113556+0000","last_fullsized":"2023-06-09T11:13:13.113556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:20:19.034965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118324+0000","last_change":"2023-06-09T11:13:12.127989+0000","last_active":"2023-06-09T11:13:13.118324+0000","last_peered":"2023-06-09T11:13:13.118324+0000","last_clean":"2023-06-09T11:13:13.118324+0000","last_became_active":"2023-06-09T11:13:12.127652+0000","last_became_peered":"2023-06-09T11:13:12.127652+0000","last_unstale":"2023-06-09T11:13:13.118324+0000","last_undegraded":"2023-06-09T11:13:13.118324+0000","last_fullsized":"2023-06-09T11:13:13.118324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:35.231150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116655+0000","last_change":"2023-06-09T11:13:11.662064+0000","last_active":"2023-06-09T11:13:13.116655+0000","last_peered":"2023-06-09T11:13:13.116655+0000","last_clean":"2023-06-09T11:13:13.116655+0000","last_became_active":"2023-06-09T11:13:11.661794+0000","last_became_peered":"2023-06-09T11:13:11.661794+0000","last_unstale":"2023-06-09T11:13:13.116655+0000","last_undegraded":"2023-06-09T11:13:13.116655+0000","last_fullsized":"2023-06-09T11:13:13.116655+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:20:38.887782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117726+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:13:13.117726+0000","last_peered":"2023-06-09T11:13:13.117726+0000","last_clean":"2023-06-09T11:13:13.117726+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:13:13.117726+0000","last_undegraded":"2023-06-09T11:13:13.117726+0000","last_fullsized":"2023-06-09T11:13:13.117726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:19:38.578079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118228+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:13:13.118228+0000","last_peered":"2023-06-09T11:13:13.118228+0000","last_clean":"2023-06-09T11:13:13.118228+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:13:13.118228+0000","last_undegraded":"2023-06-09T11:13:13.118228+0000","last_fullsized":"2023-06-09T11:13:13.118228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:37.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360277+0000","last_change":"2023-06-09T11:13:12.139763+0000","last_active":"2023-06-09T11:13:14.360277+0000","last_peered":"2023-06-09T11:13:14.360277+0000","last_clean":"2023-06-09T11:13:14.360277+0000","last_became_active":"2023-06-09T11:13:12.139477+0000","last_became_peered":"2023-06-09T11:13:12.139477+0000","last_unstale":"2023-06-09T11:13:14.360277+0000","last_undegraded":"2023-06-09T11:13:14.360277+0000","last_fullsized":"2023-06-09T11:13:14.360277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:25:15.747303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118714+0000","last_change":"2023-06-09T11:13:11.664182+0000","last_active":"2023-06-09T11:13:13.118714+0000","last_peered":"2023-06-09T11:13:13.118714+0000","last_clean":"2023-06-09T11:13:13.118714+0000","last_became_active":"2023-06-09T11:13:11.663781+0000","last_became_peered":"2023-06-09T11:13:11.663781+0000","last_unstale":"2023-06-09T11:13:13.118714+0000","last_undegraded":"2023-06-09T11:13:13.118714+0000","last_fullsized":"2023-06-09T11:13:13.118714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:44.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117492+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:13:13.117492+0000","last_peered":"2023-06-09T11:13:13.117492+0000","last_clean":"2023-06-09T11:13:13.117492+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:13:13.117492+0000","last_undegraded":"2023-06-09T11:13:13.117492+0000","last_fullsized":"2023-06-09T11:13:13.117492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:15:55.843260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117087+0000","last_change":"2023-06-09T11:13:12.142838+0000","last_active":"2023-06-09T11:13:13.117087+0000","last_peered":"2023-06-09T11:13:13.117087+0000","last_clean":"2023-06-09T11:13:13.117087+0000","last_became_active":"2023-06-09T11:13:12.142225+0000","last_became_peered":"2023-06-09T11:13:12.142225+0000","last_unstale":"2023-06-09T11:13:13.117087+0000","last_undegraded":"2023-06-09T11:13:13.117087+0000","last_fullsized":"2023-06-09T11:13:13.117087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:27.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114094+0000","last_change":"2023-06-09T11:13:11.655918+0000","last_active":"2023-06-09T11:13:13.114094+0000","last_peered":"2023-06-09T11:13:13.114094+0000","last_clean":"2023-06-09T11:13:13.114094+0000","last_became_active":"2023-06-09T11:13:11.655274+0000","last_became_peered":"2023-06-09T11:13:11.655274+0000","last_unstale":"2023-06-09T11:13:13.114094+0000","last_undegraded":"2023-06-09T11:13:13.114094+0000","last_fullsized":"2023-06-09T11:13:13.114094+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:17:20.233039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113569+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:13:13.113569+0000","last_peered":"2023-06-09T11:13:13.113569+0000","last_clean":"2023-06-09T11:13:13.113569+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:13:13.113569+0000","last_undegraded":"2023-06-09T11:13:13.113569+0000","last_fullsized":"2023-06-09T11:13:13.113569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:40.458211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363332+0000","last_change":"2023-06-09T11:13:12.118907+0000","last_active":"2023-06-09T11:13:14.363332+0000","last_peered":"2023-06-09T11:13:14.363332+0000","last_clean":"2023-06-09T11:13:14.363332+0000","last_became_active":"2023-06-09T11:13:12.118622+0000","last_became_peered":"2023-06-09T11:13:12.118622+0000","last_unstale":"2023-06-09T11:13:14.363332+0000","last_undegraded":"2023-06-09T11:13:14.363332+0000","last_fullsized":"2023-06-09T11:13:14.363332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:08:12.608038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360096+0000","last_change":"2023-06-09T11:13:11.665481+0000","last_active":"2023-06-09T11:13:14.360096+0000","last_peered":"2023-06-09T11:13:14.360096+0000","last_clean":"2023-06-09T11:13:14.360096+0000","last_became_active":"2023-06-09T11:13:11.665195+0000","last_became_peered":"2023-06-09T11:13:11.665195+0000","last_unstale":"2023-06-09T11:13:14.360096+0000","last_undegraded":"2023-06-09T11:13:14.360096+0000","last_fullsized":"2023-06-09T11:13:14.360096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:41:39.251792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117821+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:13:13.117821+0000","last_peered":"2023-06-09T11:13:13.117821+0000","last_clean":"2023-06-09T11:13:13.117821+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:13:13.117821+0000","last_undegraded":"2023-06-09T11:13:13.117821+0000","last_fullsized":"2023-06-09T11:13:13.117821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:19:30.435888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360482+0000","last_change":"2023-06-09T11:13:12.117840+0000","last_active":"2023-06-09T11:13:14.360482+0000","last_peered":"2023-06-09T11:13:14.360482+0000","last_clean":"2023-06-09T11:13:14.360482+0000","last_became_active":"2023-06-09T11:13:12.117567+0000","last_became_peered":"2023-06-09T11:13:12.117567+0000","last_unstale":"2023-06-09T11:13:14.360482+0000","last_undegraded":"2023-06-09T11:13:14.360482+0000","last_fullsized":"2023-06-09T11:13:14.360482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:26:32.923905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361534+0000","last_change":"2023-06-09T11:13:11.667666+0000","last_active":"2023-06-09T11:13:14.361534+0000","last_peered":"2023-06-09T11:13:14.361534+0000","last_clean":"2023-06-09T11:13:14.361534+0000","last_became_active":"2023-06-09T11:13:11.667321+0000","last_became_peered":"2023-06-09T11:13:11.667321+0000","last_unstale":"2023-06-09T11:13:14.361534+0000","last_undegraded":"2023-06-09T11:13:14.361534+0000","last_fullsized":"2023-06-09T11:13:14.361534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:27:30.548312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360471+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:13:14.360471+0000","last_peered":"2023-06-09T11:13:14.360471+0000","last_clean":"2023-06-09T11:13:14.360471+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:13:14.360471+0000","last_undegraded":"2023-06-09T11:13:14.360471+0000","last_fullsized":"2023-06-09T11:13:14.360471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.440222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359940+0000","last_change":"2023-06-09T11:13:12.140945+0000","last_active":"2023-06-09T11:13:14.359940+0000","last_peered":"2023-06-09T11:13:14.359940+0000","last_clean":"2023-06-09T11:13:14.359940+0000","last_became_active":"2023-06-09T11:13:12.140707+0000","last_became_peered":"2023-06-09T11:13:12.140707+0000","last_unstale":"2023-06-09T11:13:14.359940+0000","last_undegraded":"2023-06-09T11:13:14.359940+0000","last_fullsized":"2023-06-09T11:13:14.359940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:55.327103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687507+0000","last_change":"2023-06-09T11:13:11.664806+0000","last_active":"2023-06-09T11:13:13.687507+0000","last_peered":"2023-06-09T11:13:13.687507+0000","last_clean":"2023-06-09T11:13:13.687507+0000","last_became_active":"2023-06-09T11:13:11.664537+0000","last_became_peered":"2023-06-09T11:13:11.664537+0000","last_unstale":"2023-06-09T11:13:13.687507+0000","last_undegraded":"2023-06-09T11:13:13.687507+0000","last_fullsized":"2023-06-09T11:13:13.687507+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:58:03.277541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117260+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:13:13.117260+0000","last_peered":"2023-06-09T11:13:13.117260+0000","last_clean":"2023-06-09T11:13:13.117260+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:13:13.117260+0000","last_undegraded":"2023-06-09T11:13:13.117260+0000","last_fullsized":"2023-06-09T11:13:13.117260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:25.766539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360524+0000","last_change":"2023-06-09T11:13:12.118501+0000","last_active":"2023-06-09T11:13:14.360524+0000","last_peered":"2023-06-09T11:13:14.360524+0000","last_clean":"2023-06-09T11:13:14.360524+0000","last_became_active":"2023-06-09T11:13:12.118202+0000","last_became_peered":"2023-06-09T11:13:12.118202+0000","last_unstale":"2023-06-09T11:13:14.360524+0000","last_undegraded":"2023-06-09T11:13:14.360524+0000","last_fullsized":"2023-06-09T11:13:14.360524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:59:29.599356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360358+0000","last_change":"2023-06-09T11:13:11.662748+0000","last_active":"2023-06-09T11:13:14.360358+0000","last_peered":"2023-06-09T11:13:14.360358+0000","last_clean":"2023-06-09T11:13:14.360358+0000","last_became_active":"2023-06-09T11:13:11.661763+0000","last_became_peered":"2023-06-09T11:13:11.661763+0000","last_unstale":"2023-06-09T11:13:14.360358+0000","last_undegraded":"2023-06-09T11:13:14.360358+0000","last_fullsized":"2023-06-09T11:13:14.360358+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:06.206327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360795+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:13:14.360795+0000","last_peered":"2023-06-09T11:13:14.360795+0000","last_clean":"2023-06-09T11:13:14.360795+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:13:14.360795+0000","last_undegraded":"2023-06-09T11:13:14.360795+0000","last_fullsized":"2023-06-09T11:13:14.360795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:12:59.795038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117028+0000","last_change":"2023-06-09T11:13:12.143219+0000","last_active":"2023-06-09T11:13:13.117028+0000","last_peered":"2023-06-09T11:13:13.117028+0000","last_clean":"2023-06-09T11:13:13.117028+0000","last_became_active":"2023-06-09T11:13:12.141954+0000","last_became_peered":"2023-06-09T11:13:12.141954+0000","last_unstale":"2023-06-09T11:13:13.117028+0000","last_undegraded":"2023-06-09T11:13:13.117028+0000","last_fullsized":"2023-06-09T11:13:13.117028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:43:35.600361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362847+0000","last_change":"2023-06-09T11:13:11.663708+0000","last_active":"2023-06-09T11:13:14.362847+0000","last_peered":"2023-06-09T11:13:14.362847+0000","last_clean":"2023-06-09T11:13:14.362847+0000","last_became_active":"2023-06-09T11:13:11.663319+0000","last_became_peered":"2023-06-09T11:13:11.663319+0000","last_unstale":"2023-06-09T11:13:14.362847+0000","last_undegraded":"2023-06-09T11:13:14.362847+0000","last_fullsized":"2023-06-09T11:13:14.362847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:21:35.916292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687972+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:13:13.687972+0000","last_peered":"2023-06-09T11:13:13.687972+0000","last_clean":"2023-06-09T11:13:13.687972+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:13:13.687972+0000","last_undegraded":"2023-06-09T11:13:13.687972+0000","last_fullsized":"2023-06-09T11:13:13.687972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:19:55.096680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9656,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362184,"statfs":{"total":96636764160,"available":96626876416,"internally_reserved":0,"allocated":1032192,"data_stored":767390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.137},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.2589999999999999}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.194},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.234}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.282},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.351}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5109999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3999999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.5649999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":425984,"data_stored":175970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.92900000000000005}]},{"osd":1,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.089},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.91500000000000004}]},{"osd":2,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1379999999999999}]},{"osd":3,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.125}]},{"osd":4,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":6.0339999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":5.8029999999999999},"last":1.0269999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.3640000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.169},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8556,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363284,"statfs":{"total":96636764160,"available":96628002816,"internally_reserved":0,"allocated":430080,"data_stored":175500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.97399999999999998}]},{"osd":1,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.268}]},{"osd":2,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.034}]},{"osd":3,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3360000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3}]},{"osd":6,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.698}]},{"osd":7,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.645}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":430080,"data_stored":175992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.2310000000000001}]},{"osd":1,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.069}]},{"osd":3,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.119}]},{"osd":5,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.1680000000000001,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.198}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8564,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363276,"statfs":{"total":96636764160,"available":96627994624,"internally_reserved":0,"allocated":438272,"data_stored":176986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0389999999999999}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.3640000000000001}]},{"osd":2,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.268},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.448},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.5649999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4259999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4019999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":1.474},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.5149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8424,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363416,"statfs":{"total":96636764160,"available":96628137984,"internally_reserved":0,"allocated":425984,"data_stored":175458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.1519999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":3.2400000000000002,"5min":3.2400000000000002,"15min":3.2400000000000002},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.399}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.377}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":8.8629999999999995,"5min":8.8629999999999995,"15min":8.8629999999999995},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.331}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8488,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363352,"statfs":{"total":96636764160,"available":96628072448,"internally_reserved":0,"allocated":425984,"data_stored":175478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.032}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.748}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.194},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.995}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":1.3500000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.4350000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":764771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.753},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0189999999999999}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.127},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.3069999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.103},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.079},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.157}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:13:21.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T11:13:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.423+0000 7f6e1d8aa700 1 Processor -- start 2023-06-09T11:13:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.423+0000 7f6e1d8aa700 1 -- start start 2023-06-09T11:13:21.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e1d8aa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e1815a3e0 0x7f6e1806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e1d8aa700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e180ce470 0x7f6e1806f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e1d8aa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815df60 0x7f6e1815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e1d8aa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1815e920 con 0x7f6e1815a3e0 2023-06-09T11:13:21.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e1d8aa700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e180cc8e0 con 0x7f6e180ce470 2023-06-09T11:13:21.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e1d8aa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1815a7b0 con 0x7f6e1815df60 2023-06-09T11:13:21.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e1815a3e0 0x7f6e1806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e1815a3e0 0x7f6e1806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58232/0 (socket says 172.21.15.78:58232) 2023-06-09T11:13:21.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 -- 172.21.15.78:0/4055576629 learned_addr learned my addr 172.21.15.78:0/4055576629 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:21.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e167fc700 1 --2- 172.21.15.78:0/4055576629 >> v2:172.21.15.187:3300/0 conn(0x7f6e180ce470 0x7f6e1806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e177fe700 1 --2- 172.21.15.78:0/4055576629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815df60 0x7f6e1815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 -- 172.21.15.78:0/4055576629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815df60 msgr2=0x7f6e1815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:21.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 --2- 172.21.15.78:0/4055576629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815df60 0x7f6e1815e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 -- 172.21.15.78:0/4055576629 >> v2:172.21.15.187:3300/0 conn(0x7f6e180ce470 msgr2=0x7f6e1806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:21.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 --2- 172.21.15.78:0/4055576629 >> v2:172.21.15.187:3300/0 conn(0x7f6e180ce470 0x7f6e1806f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 -- 172.21.15.78:0/4055576629 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180ccb80 con 0x7f6e1815a3e0 2023-06-09T11:13:21.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e16ffd700 1 --2- 172.21.15.78:0/4055576629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1815a3e0 0x7f6e1806e960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6e1806d140 tx=0x7f6e08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b674aa7470f5ab85 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.427+0000 7f6e15ffb700 1 -- 172.21.15.78:0/4055576629 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08011830 con 0x7f6e1815a3e0 2023-06-09T11:13:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e15ffb700 1 -- 172.21.15.78:0/4055576629 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e08011990 con 0x7f6e1815a3e0 2023-06-09T11:13:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e15ffb700 1 -- 172.21.15.78:0/4055576629 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08011d20 con 0x7f6e1815a3e0 2023-06-09T11:13:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/4055576629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1815a3e0 msgr2=0x7f6e1806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/4055576629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1815a3e0 0x7f6e1806e960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6e1806d140 tx=0x7f6e08009bf0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/4055576629 shutdown_connections 2023-06-09T11:13:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/4055576629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815df60 0x7f6e1815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/4055576629 >> v2:172.21.15.187:3300/0 conn(0x7f6e180ce470 0x7f6e1806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/4055576629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1815a3e0 0x7f6e1806e960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/4055576629 >> 172.21.15.78:0/4055576629 conn(0x7f6e180cf670 msgr2=0x7f6e180cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:21.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/4055576629 shutdown_connections 2023-06-09T11:13:21.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/4055576629 wait complete. 2023-06-09T11:13:21.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.431+0000 7f6e1d8aa700 1 Processor -- start 2023-06-09T11:13:21.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 -- start start 2023-06-09T11:13:21.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180ce470 0x7f6e1813f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815a3e0 0x7f6e181402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e1815df60 0x7f6e181407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e18140d30 con 0x7f6e180ce470 2023-06-09T11:13:21.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1813f210 con 0x7f6e1815df60 2023-06-09T11:13:21.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1813e600 con 0x7f6e1815a3e0 2023-06-09T11:13:21.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180ce470 0x7f6e1813f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180ce470 0x7f6e1813f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58246/0 (socket says 172.21.15.78:58246) 2023-06-09T11:13:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 -- 172.21.15.78:0/3000784477 learned_addr learned my addr 172.21.15.78:0/3000784477 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e167fc700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815a3e0 0x7f6e181402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e177fe700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e1815df60 0x7f6e181407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 -- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815a3e0 msgr2=0x7f6e181402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815a3e0 0x7f6e181402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 -- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e1815df60 msgr2=0x7f6e181407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e1815df60 0x7f6e181407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 -- 172.21.15.78:0/3000784477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08009570 con 0x7f6e180ce470 2023-06-09T11:13:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e167fc700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815a3e0 0x7f6e181402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e16ffd700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180ce470 0x7f6e1813f6a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6e180cc1e0 tx=0x7f6e08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6dfffff700 1 -- 172.21.15.78:0/3000784477 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e080044d0 con 0x7f6e180ce470 2023-06-09T11:13:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6dfffff700 1 -- 172.21.15.78:0/3000784477 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0801f070 con 0x7f6e180ce470 2023-06-09T11:13:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1806b750 con 0x7f6e180ce470 2023-06-09T11:13:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6dfffff700 1 -- 172.21.15.78:0/3000784477 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08003900 con 0x7f6e180ce470 2023-06-09T11:13:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.435+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1806b470 con 0x7f6e180ce470 2023-06-09T11:13:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.439+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e18070240 con 0x7f6e180ce470 2023-06-09T11:13:21.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.439+0000 7f6dfffff700 1 -- 172.21.15.78:0/3000784477 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e08003a60 con 0x7f6e180ce470 2023-06-09T11:13:21.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.443+0000 7f6dfffff700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e04066320 0x7f6e040687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.443+0000 7f6dfffff700 1 -- 172.21.15.78:0/3000784477 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e08021070 con 0x7f6e180ce470 2023-06-09T11:13:21.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.443+0000 7f6e167fc700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e04066320 0x7f6e040687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.443+0000 7f6e167fc700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e04066320 0x7f6e040687d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e1813cd00 tx=0x7f6e0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:21.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.447+0000 7f6dfffff700 1 -- 172.21.15.78:0/3000784477 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6e08052570 con 0x7f6e180ce470 2023-06-09T11:13:21.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.619+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e180741c0 con 0x7f6e04066320 2023-06-09T11:13:21.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.635+0000 7f6dfffff700 1 -- 172.21.15.78:0/3000784477 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308398 (secure 0 0 0) 0x7f6e180741c0 con 0x7f6e04066320 2023-06-09T11:13:21.648 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:21.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e04066320 msgr2=0x7f6e040687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e04066320 0x7f6e040687d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e1813cd00 tx=0x7f6e0c008040 comp rx=0 tx=0).stop 2023-06-09T11:13:21.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180ce470 msgr2=0x7f6e1813f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180ce470 0x7f6e1813f6a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6e180cc1e0 tx=0x7f6e08004770 comp rx=0 tx=0).stop 2023-06-09T11:13:21.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 shutdown_connections 2023-06-09T11:13:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6e04066320 0x7f6e040687d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e1815df60 0x7f6e181407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1815a3e0 0x7f6e181402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 --2- 172.21.15.78:0/3000784477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180ce470 0x7f6e1813f6a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 >> 172.21.15.78:0/3000784477 conn(0x7f6e180cf670 msgr2=0x7f6e180b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 shutdown_connections 2023-06-09T11:13:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.643+0000 7f6e1d8aa700 1 -- 172.21.15.78:0/3000784477 wait complete. 2023-06-09T11:13:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T11:13:21.674 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-06-09T11:13:19.629837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70244,"kb_used_data":4516,"kb_used_omap":0,"kb_used_meta":65664,"kb_avail":754904476,"statfs":{"total":773094113280,"available":773022183424,"internally_reserved":0,"allocated":4624384,"data_stored":2587545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67239936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.988802"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363528+0000","last_change":"2023-06-09T11:13:12.116631+0000","last_active":"2023-06-09T11:13:14.363528+0000","last_peered":"2023-06-09T11:13:14.363528+0000","last_clean":"2023-06-09T11:13:14.363528+0000","last_became_active":"2023-06-09T11:13:12.115774+0000","last_became_peered":"2023-06-09T11:13:12.115774+0000","last_unstale":"2023-06-09T11:13:14.363528+0000","last_undegraded":"2023-06-09T11:13:14.363528+0000","last_fullsized":"2023-06-09T11:13:14.363528+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:36:32.140899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363221+0000","last_change":"2023-06-09T11:13:12.118291+0000","last_active":"2023-06-09T11:13:14.363221+0000","last_peered":"2023-06-09T11:13:14.363221+0000","last_clean":"2023-06-09T11:13:14.363221+0000","last_became_active":"2023-06-09T11:13:12.117999+0000","last_became_peered":"2023-06-09T11:13:12.117999+0000","last_unstale":"2023-06-09T11:13:14.363221+0000","last_undegraded":"2023-06-09T11:13:14.363221+0000","last_fullsized":"2023-06-09T11:13:14.363221+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:25:15.747303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361691+0000","last_change":"2023-06-09T11:13:12.138623+0000","last_active":"2023-06-09T11:13:14.361691+0000","last_peered":"2023-06-09T11:13:14.361691+0000","last_clean":"2023-06-09T11:13:14.361691+0000","last_became_active":"2023-06-09T11:13:12.138345+0000","last_became_peered":"2023-06-09T11:13:12.138345+0000","last_unstale":"2023-06-09T11:13:14.361691+0000","last_undegraded":"2023-06-09T11:13:14.361691+0000","last_fullsized":"2023-06-09T11:13:14.361691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:26:11.261672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114214+0000","last_change":"2023-06-09T11:13:12.124606+0000","last_active":"2023-06-09T11:13:13.114214+0000","last_peered":"2023-06-09T11:13:13.114214+0000","last_clean":"2023-06-09T11:13:13.114214+0000","last_became_active":"2023-06-09T11:13:12.124342+0000","last_became_peered":"2023-06-09T11:13:12.124342+0000","last_unstale":"2023-06-09T11:13:13.114214+0000","last_undegraded":"2023-06-09T11:13:13.114214+0000","last_fullsized":"2023-06-09T11:13:13.114214+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:44.167709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113640+0000","last_change":"2023-06-09T11:13:12.123870+0000","last_active":"2023-06-09T11:13:13.113640+0000","last_peered":"2023-06-09T11:13:13.113640+0000","last_clean":"2023-06-09T11:13:13.113640+0000","last_became_active":"2023-06-09T11:13:12.123600+0000","last_became_peered":"2023-06-09T11:13:12.123600+0000","last_unstale":"2023-06-09T11:13:13.113640+0000","last_undegraded":"2023-06-09T11:13:13.113640+0000","last_fullsized":"2023-06-09T11:13:13.113640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:32:14.693239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359804+0000","last_change":"2023-06-09T11:13:12.120406+0000","last_active":"2023-06-09T11:13:14.359804+0000","last_peered":"2023-06-09T11:13:14.359804+0000","last_clean":"2023-06-09T11:13:14.359804+0000","last_became_active":"2023-06-09T11:13:12.120138+0000","last_became_peered":"2023-06-09T11:13:12.120138+0000","last_unstale":"2023-06-09T11:13:14.359804+0000","last_undegraded":"2023-06-09T11:13:14.359804+0000","last_fullsized":"2023-06-09T11:13:14.359804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:46.908265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116537+0000","last_change":"2023-06-09T11:13:12.134351+0000","last_active":"2023-06-09T11:13:13.116537+0000","last_peered":"2023-06-09T11:13:13.116537+0000","last_clean":"2023-06-09T11:13:13.116537+0000","last_became_active":"2023-06-09T11:13:12.134035+0000","last_became_peered":"2023-06-09T11:13:12.134035+0000","last_unstale":"2023-06-09T11:13:13.116537+0000","last_undegraded":"2023-06-09T11:13:13.116537+0000","last_fullsized":"2023-06-09T11:13:13.116537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:01:11.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362635+0000","last_change":"2023-06-09T11:13:12.127626+0000","last_active":"2023-06-09T11:13:14.362635+0000","last_peered":"2023-06-09T11:13:14.362635+0000","last_clean":"2023-06-09T11:13:14.362635+0000","last_became_active":"2023-06-09T11:13:12.127336+0000","last_became_peered":"2023-06-09T11:13:12.127336+0000","last_unstale":"2023-06-09T11:13:14.362635+0000","last_undegraded":"2023-06-09T11:13:14.362635+0000","last_fullsized":"2023-06-09T11:13:14.362635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:35:24.491437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361947+0000","last_change":"2023-06-09T11:13:12.129754+0000","last_active":"2023-06-09T11:13:14.361947+0000","last_peered":"2023-06-09T11:13:14.361947+0000","last_clean":"2023-06-09T11:13:14.361947+0000","last_became_active":"2023-06-09T11:13:12.129496+0000","last_became_peered":"2023-06-09T11:13:12.129496+0000","last_unstale":"2023-06-09T11:13:14.361947+0000","last_undegraded":"2023-06-09T11:13:14.361947+0000","last_fullsized":"2023-06-09T11:13:14.361947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:16.819164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118461+0000","last_change":"2023-06-09T11:13:12.128305+0000","last_active":"2023-06-09T11:13:13.118461+0000","last_peered":"2023-06-09T11:13:13.118461+0000","last_clean":"2023-06-09T11:13:13.118461+0000","last_became_active":"2023-06-09T11:13:12.127368+0000","last_became_peered":"2023-06-09T11:13:12.127368+0000","last_unstale":"2023-06-09T11:13:13.118461+0000","last_undegraded":"2023-06-09T11:13:13.118461+0000","last_fullsized":"2023-06-09T11:13:13.118461+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:08:40.009765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117955+0000","last_change":"2023-06-09T11:13:12.138063+0000","last_active":"2023-06-09T11:13:13.117955+0000","last_peered":"2023-06-09T11:13:13.117955+0000","last_clean":"2023-06-09T11:13:13.117955+0000","last_became_active":"2023-06-09T11:13:12.137716+0000","last_became_peered":"2023-06-09T11:13:12.137716+0000","last_unstale":"2023-06-09T11:13:13.117955+0000","last_undegraded":"2023-06-09T11:13:13.117955+0000","last_fullsized":"2023-06-09T11:13:13.117955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:56:39.219005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360234+0000","last_change":"2023-06-09T11:13:12.120026+0000","last_active":"2023-06-09T11:13:14.360234+0000","last_peered":"2023-06-09T11:13:14.360234+0000","last_clean":"2023-06-09T11:13:14.360234+0000","last_became_active":"2023-06-09T11:13:12.119749+0000","last_became_peered":"2023-06-09T11:13:12.119749+0000","last_unstale":"2023-06-09T11:13:14.360234+0000","last_undegraded":"2023-06-09T11:13:14.360234+0000","last_fullsized":"2023-06-09T11:13:14.360234+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:07:11.572866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118097+0000","last_change":"2023-06-09T11:13:12.122592+0000","last_active":"2023-06-09T11:13:13.118097+0000","last_peered":"2023-06-09T11:13:13.118097+0000","last_clean":"2023-06-09T11:13:13.118097+0000","last_became_active":"2023-06-09T11:13:12.122257+0000","last_became_peered":"2023-06-09T11:13:12.122257+0000","last_unstale":"2023-06-09T11:13:13.118097+0000","last_undegraded":"2023-06-09T11:13:13.118097+0000","last_fullsized":"2023-06-09T11:13:13.118097+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:59:29.599356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360535+0000","last_change":"2023-06-09T11:13:12.136643+0000","last_active":"2023-06-09T11:13:14.360535+0000","last_peered":"2023-06-09T11:13:14.360535+0000","last_clean":"2023-06-09T11:13:14.360535+0000","last_became_active":"2023-06-09T11:13:12.136360+0000","last_became_peered":"2023-06-09T11:13:12.136360+0000","last_unstale":"2023-06-09T11:13:14.360535+0000","last_undegraded":"2023-06-09T11:13:14.360535+0000","last_fullsized":"2023-06-09T11:13:14.360535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:43:35.600361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116757+0000","last_change":"2023-06-09T11:13:12.134263+0000","last_active":"2023-06-09T11:13:13.116757+0000","last_peered":"2023-06-09T11:13:13.116757+0000","last_clean":"2023-06-09T11:13:13.116757+0000","last_became_active":"2023-06-09T11:13:12.133950+0000","last_became_peered":"2023-06-09T11:13:12.133950+0000","last_unstale":"2023-06-09T11:13:13.116757+0000","last_undegraded":"2023-06-09T11:13:13.116757+0000","last_fullsized":"2023-06-09T11:13:13.116757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:50:17.292415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116705+0000","last_change":"2023-06-09T11:13:12.140277+0000","last_active":"2023-06-09T11:13:13.116705+0000","last_peered":"2023-06-09T11:13:13.116705+0000","last_clean":"2023-06-09T11:13:13.116705+0000","last_became_active":"2023-06-09T11:13:12.139992+0000","last_became_peered":"2023-06-09T11:13:12.139992+0000","last_unstale":"2023-06-09T11:13:13.116705+0000","last_undegraded":"2023-06-09T11:13:13.116705+0000","last_fullsized":"2023-06-09T11:13:13.116705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:09.181055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117458+0000","last_change":"2023-06-09T11:13:12.135061+0000","last_active":"2023-06-09T11:13:13.117458+0000","last_peered":"2023-06-09T11:13:13.117458+0000","last_clean":"2023-06-09T11:13:13.117458+0000","last_became_active":"2023-06-09T11:13:12.134776+0000","last_became_peered":"2023-06-09T11:13:12.134776+0000","last_unstale":"2023-06-09T11:13:13.117458+0000","last_undegraded":"2023-06-09T11:13:13.117458+0000","last_fullsized":"2023-06-09T11:13:13.117458+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:02:10.508533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687850+0000","last_change":"2023-06-09T11:13:12.143817+0000","last_active":"2023-06-09T11:13:13.687850+0000","last_peered":"2023-06-09T11:13:13.687850+0000","last_clean":"2023-06-09T11:13:13.687850+0000","last_became_active":"2023-06-09T11:13:12.143470+0000","last_became_peered":"2023-06-09T11:13:12.143470+0000","last_unstale":"2023-06-09T11:13:13.687850+0000","last_undegraded":"2023-06-09T11:13:13.687850+0000","last_fullsized":"2023-06-09T11:13:13.687850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:22:38.907019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114121+0000","last_change":"2023-06-09T11:13:12.117830+0000","last_active":"2023-06-09T11:13:13.114121+0000","last_peered":"2023-06-09T11:13:13.114121+0000","last_clean":"2023-06-09T11:13:13.114121+0000","last_became_active":"2023-06-09T11:13:12.117407+0000","last_became_peered":"2023-06-09T11:13:12.117407+0000","last_unstale":"2023-06-09T11:13:13.114121+0000","last_undegraded":"2023-06-09T11:13:13.114121+0000","last_fullsized":"2023-06-09T11:13:13.114121+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:25.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687608+0000","last_change":"2023-06-09T11:13:12.136549+0000","last_active":"2023-06-09T11:13:13.687608+0000","last_peered":"2023-06-09T11:13:13.687608+0000","last_clean":"2023-06-09T11:13:13.687608+0000","last_became_active":"2023-06-09T11:13:12.136243+0000","last_became_peered":"2023-06-09T11:13:12.136243+0000","last_unstale":"2023-06-09T11:13:13.687608+0000","last_undegraded":"2023-06-09T11:13:13.687608+0000","last_fullsized":"2023-06-09T11:13:13.687608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:58:01.387776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117775+0000","last_change":"2023-06-09T11:13:12.127634+0000","last_active":"2023-06-09T11:13:13.117775+0000","last_peered":"2023-06-09T11:13:13.117775+0000","last_clean":"2023-06-09T11:13:13.117775+0000","last_became_active":"2023-06-09T11:13:12.127253+0000","last_became_peered":"2023-06-09T11:13:12.127253+0000","last_unstale":"2023-06-09T11:13:13.117775+0000","last_undegraded":"2023-06-09T11:13:13.117775+0000","last_fullsized":"2023-06-09T11:13:13.117775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:12:09.181055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361171+0000","last_change":"2023-06-09T11:13:12.123174+0000","last_active":"2023-06-09T11:13:14.361171+0000","last_peered":"2023-06-09T11:13:14.361171+0000","last_clean":"2023-06-09T11:13:14.361171+0000","last_became_active":"2023-06-09T11:13:12.122851+0000","last_became_peered":"2023-06-09T11:13:12.122851+0000","last_unstale":"2023-06-09T11:13:14.361171+0000","last_undegraded":"2023-06-09T11:13:14.361171+0000","last_fullsized":"2023-06-09T11:13:14.361171+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:08:40.009765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116815+0000","last_change":"2023-06-09T11:13:12.128509+0000","last_active":"2023-06-09T11:13:13.116815+0000","last_peered":"2023-06-09T11:13:13.116815+0000","last_clean":"2023-06-09T11:13:13.116815+0000","last_became_active":"2023-06-09T11:13:12.127964+0000","last_became_peered":"2023-06-09T11:13:12.127964+0000","last_unstale":"2023-06-09T11:13:13.116815+0000","last_undegraded":"2023-06-09T11:13:13.116815+0000","last_fullsized":"2023-06-09T11:13:13.116815+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:56:39.219005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113443+0000","last_change":"2023-06-09T11:13:12.123847+0000","last_active":"2023-06-09T11:13:13.113443+0000","last_peered":"2023-06-09T11:13:13.113443+0000","last_clean":"2023-06-09T11:13:13.113443+0000","last_became_active":"2023-06-09T11:13:12.122193+0000","last_became_peered":"2023-06-09T11:13:12.122193+0000","last_unstale":"2023-06-09T11:13:13.113443+0000","last_undegraded":"2023-06-09T11:13:13.113443+0000","last_fullsized":"2023-06-09T11:13:13.113443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:37:11.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687830+0000","last_change":"2023-06-09T11:13:12.145549+0000","last_active":"2023-06-09T11:13:13.687830+0000","last_peered":"2023-06-09T11:13:13.687830+0000","last_clean":"2023-06-09T11:13:13.687830+0000","last_became_active":"2023-06-09T11:13:12.145069+0000","last_became_peered":"2023-06-09T11:13:12.145069+0000","last_unstale":"2023-06-09T11:13:13.687830+0000","last_undegraded":"2023-06-09T11:13:13.687830+0000","last_fullsized":"2023-06-09T11:13:13.687830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:14:10.268027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360862+0000","last_change":"2023-06-09T11:13:12.135025+0000","last_active":"2023-06-09T11:13:14.360862+0000","last_peered":"2023-06-09T11:13:14.360862+0000","last_clean":"2023-06-09T11:13:14.360862+0000","last_became_active":"2023-06-09T11:13:12.134742+0000","last_became_peered":"2023-06-09T11:13:12.134742+0000","last_unstale":"2023-06-09T11:13:14.360862+0000","last_undegraded":"2023-06-09T11:13:14.360862+0000","last_fullsized":"2023-06-09T11:13:14.360862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:36:32.140899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687817+0000","last_change":"2023-06-09T11:13:12.140792+0000","last_active":"2023-06-09T11:13:13.687817+0000","last_peered":"2023-06-09T11:13:13.687817+0000","last_clean":"2023-06-09T11:13:13.687817+0000","last_became_active":"2023-06-09T11:13:12.140503+0000","last_became_peered":"2023-06-09T11:13:12.140503+0000","last_unstale":"2023-06-09T11:13:13.687817+0000","last_undegraded":"2023-06-09T11:13:13.687817+0000","last_fullsized":"2023-06-09T11:13:13.687817+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:15:37.974329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118262+0000","last_change":"2023-06-09T11:13:12.127654+0000","last_active":"2023-06-09T11:13:13.118262+0000","last_peered":"2023-06-09T11:13:13.118262+0000","last_clean":"2023-06-09T11:13:13.118262+0000","last_became_active":"2023-06-09T11:13:12.127290+0000","last_became_peered":"2023-06-09T11:13:12.127290+0000","last_unstale":"2023-06-09T11:13:13.118262+0000","last_undegraded":"2023-06-09T11:13:13.118262+0000","last_fullsized":"2023-06-09T11:13:13.118262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:27.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687523+0000","last_change":"2023-06-09T11:13:12.137445+0000","last_active":"2023-06-09T11:13:13.687523+0000","last_peered":"2023-06-09T11:13:13.687523+0000","last_clean":"2023-06-09T11:13:13.687523+0000","last_became_active":"2023-06-09T11:13:12.135504+0000","last_became_peered":"2023-06-09T11:13:12.135504+0000","last_unstale":"2023-06-09T11:13:13.687523+0000","last_undegraded":"2023-06-09T11:13:13.687523+0000","last_fullsized":"2023-06-09T11:13:13.687523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:25.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687427+0000","last_change":"2023-06-09T11:13:12.136260+0000","last_active":"2023-06-09T11:13:13.687427+0000","last_peered":"2023-06-09T11:13:13.687427+0000","last_clean":"2023-06-09T11:13:13.687427+0000","last_became_active":"2023-06-09T11:13:12.135925+0000","last_became_peered":"2023-06-09T11:13:12.135925+0000","last_unstale":"2023-06-09T11:13:13.687427+0000","last_undegraded":"2023-06-09T11:13:13.687427+0000","last_fullsized":"2023-06-09T11:13:13.687427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:28:43.796872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116983+0000","last_change":"2023-06-09T11:13:12.128675+0000","last_active":"2023-06-09T11:13:13.116983+0000","last_peered":"2023-06-09T11:13:13.116983+0000","last_clean":"2023-06-09T11:13:13.116983+0000","last_became_active":"2023-06-09T11:13:12.128268+0000","last_became_peered":"2023-06-09T11:13:12.128268+0000","last_unstale":"2023-06-09T11:13:13.116983+0000","last_undegraded":"2023-06-09T11:13:13.116983+0000","last_fullsized":"2023-06-09T11:13:13.116983+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:59:29.599356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359807+0000","last_change":"2023-06-09T11:13:12.118278+0000","last_active":"2023-06-09T11:13:14.359807+0000","last_peered":"2023-06-09T11:13:14.359807+0000","last_clean":"2023-06-09T11:13:14.359807+0000","last_became_active":"2023-06-09T11:13:12.117978+0000","last_became_peered":"2023-06-09T11:13:12.117978+0000","last_unstale":"2023-06-09T11:13:14.359807+0000","last_undegraded":"2023-06-09T11:13:14.359807+0000","last_fullsized":"2023-06-09T11:13:14.359807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:21:36.929009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116702+0000","last_change":"2023-06-09T11:13:12.140329+0000","last_active":"2023-06-09T11:13:13.116702+0000","last_peered":"2023-06-09T11:13:13.116702+0000","last_clean":"2023-06-09T11:13:13.116702+0000","last_became_active":"2023-06-09T11:13:12.139993+0000","last_became_peered":"2023-06-09T11:13:12.139993+0000","last_unstale":"2023-06-09T11:13:13.116702+0000","last_undegraded":"2023-06-09T11:13:13.116702+0000","last_fullsized":"2023-06-09T11:13:13.116702+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:45.926042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687924+0000","last_change":"2023-06-09T11:13:11.668447+0000","last_active":"2023-06-09T11:13:13.687924+0000","last_peered":"2023-06-09T11:13:13.687924+0000","last_clean":"2023-06-09T11:13:13.687924+0000","last_became_active":"2023-06-09T11:13:11.668155+0000","last_became_peered":"2023-06-09T11:13:11.668155+0000","last_unstale":"2023-06-09T11:13:13.687924+0000","last_undegraded":"2023-06-09T11:13:13.687924+0000","last_fullsized":"2023-06-09T11:13:13.687924+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:39:13.867580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360777+0000","last_change":"2023-06-09T11:13:12.138585+0000","last_active":"2023-06-09T11:13:14.360777+0000","last_peered":"2023-06-09T11:13:14.360777+0000","last_clean":"2023-06-09T11:13:14.360777+0000","last_became_active":"2023-06-09T11:13:12.138311+0000","last_became_peered":"2023-06-09T11:13:12.138311+0000","last_unstale":"2023-06-09T11:13:14.360777+0000","last_undegraded":"2023-06-09T11:13:14.360777+0000","last_fullsized":"2023-06-09T11:13:14.360777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:08:12.608038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361711+0000","last_change":"2023-06-09T11:13:11.659366+0000","last_active":"2023-06-09T11:13:14.361711+0000","last_peered":"2023-06-09T11:13:14.361711+0000","last_clean":"2023-06-09T11:13:14.361711+0000","last_became_active":"2023-06-09T11:13:11.658928+0000","last_became_peered":"2023-06-09T11:13:11.658928+0000","last_unstale":"2023-06-09T11:13:14.361711+0000","last_undegraded":"2023-06-09T11:13:14.361711+0000","last_fullsized":"2023-06-09T11:13:14.361711+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:35:23.478720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361230+0000","last_change":"2023-06-09T11:13:12.141236+0000","last_active":"2023-06-09T11:13:14.361230+0000","last_peered":"2023-06-09T11:13:14.361230+0000","last_clean":"2023-06-09T11:13:14.361230+0000","last_became_active":"2023-06-09T11:13:12.140928+0000","last_became_peered":"2023-06-09T11:13:12.140928+0000","last_unstale":"2023-06-09T11:13:14.361230+0000","last_undegraded":"2023-06-09T11:13:14.361230+0000","last_fullsized":"2023-06-09T11:13:14.361230+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:02:10.508533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360996+0000","last_change":"2023-06-09T11:13:11.665234+0000","last_active":"2023-06-09T11:13:14.360996+0000","last_peered":"2023-06-09T11:13:14.360996+0000","last_clean":"2023-06-09T11:13:14.360996+0000","last_became_active":"2023-06-09T11:13:11.664016+0000","last_became_peered":"2023-06-09T11:13:11.664016+0000","last_unstale":"2023-06-09T11:13:14.360996+0000","last_undegraded":"2023-06-09T11:13:14.360996+0000","last_fullsized":"2023-06-09T11:13:14.360996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:58:17.649635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363170+0000","last_change":"2023-06-09T11:13:12.147279+0000","last_active":"2023-06-09T11:13:14.363170+0000","last_peered":"2023-06-09T11:13:14.363170+0000","last_clean":"2023-06-09T11:13:14.363170+0000","last_became_active":"2023-06-09T11:13:12.146954+0000","last_became_peered":"2023-06-09T11:13:12.146954+0000","last_unstale":"2023-06-09T11:13:14.363170+0000","last_undegraded":"2023-06-09T11:13:14.363170+0000","last_fullsized":"2023-06-09T11:13:14.363170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:04.637088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361159+0000","last_change":"2023-06-09T11:13:11.663154+0000","last_active":"2023-06-09T11:13:14.361159+0000","last_peered":"2023-06-09T11:13:14.361159+0000","last_clean":"2023-06-09T11:13:14.361159+0000","last_became_active":"2023-06-09T11:13:11.662695+0000","last_became_peered":"2023-06-09T11:13:11.662695+0000","last_unstale":"2023-06-09T11:13:14.361159+0000","last_undegraded":"2023-06-09T11:13:14.361159+0000","last_fullsized":"2023-06-09T11:13:14.361159+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:38:50.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361384+0000","last_change":"2023-06-09T11:13:12.115402+0000","last_active":"2023-06-09T11:13:14.361384+0000","last_peered":"2023-06-09T11:13:14.361384+0000","last_clean":"2023-06-09T11:13:14.361384+0000","last_became_active":"2023-06-09T11:13:12.114956+0000","last_became_peered":"2023-06-09T11:13:12.114956+0000","last_unstale":"2023-06-09T11:13:14.361384+0000","last_undegraded":"2023-06-09T11:13:14.361384+0000","last_fullsized":"2023-06-09T11:13:14.361384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T18:00:08.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118656+0000","last_change":"2023-06-09T11:13:11.659850+0000","last_active":"2023-06-09T11:13:13.118656+0000","last_peered":"2023-06-09T11:13:13.118656+0000","last_clean":"2023-06-09T11:13:13.118656+0000","last_became_active":"2023-06-09T11:13:11.659566+0000","last_became_peered":"2023-06-09T11:13:11.659566+0000","last_unstale":"2023-06-09T11:13:13.118656+0000","last_undegraded":"2023-06-09T11:13:13.118656+0000","last_fullsized":"2023-06-09T11:13:13.118656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:04.295154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116885+0000","last_change":"2023-06-09T11:13:12.132581+0000","last_active":"2023-06-09T11:13:13.116885+0000","last_peered":"2023-06-09T11:13:13.116885+0000","last_clean":"2023-06-09T11:13:13.116885+0000","last_became_active":"2023-06-09T11:13:12.129460+0000","last_became_peered":"2023-06-09T11:13:12.129460+0000","last_unstale":"2023-06-09T11:13:13.116885+0000","last_undegraded":"2023-06-09T11:13:13.116885+0000","last_fullsized":"2023-06-09T11:13:13.116885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:39.958536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117290+0000","last_change":"2023-06-09T11:13:11.662459+0000","last_active":"2023-06-09T11:13:13.117290+0000","last_peered":"2023-06-09T11:13:13.117290+0000","last_clean":"2023-06-09T11:13:13.117290+0000","last_became_active":"2023-06-09T11:13:11.661063+0000","last_became_peered":"2023-06-09T11:13:11.661063+0000","last_unstale":"2023-06-09T11:13:13.117290+0000","last_undegraded":"2023-06-09T11:13:13.117290+0000","last_fullsized":"2023-06-09T11:13:13.117290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:08:38.997048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360853+0000","last_change":"2023-06-09T11:13:12.139699+0000","last_active":"2023-06-09T11:13:14.360853+0000","last_peered":"2023-06-09T11:13:14.360853+0000","last_clean":"2023-06-09T11:13:14.360853+0000","last_became_active":"2023-06-09T11:13:12.139089+0000","last_became_peered":"2023-06-09T11:13:12.139089+0000","last_unstale":"2023-06-09T11:13:14.360853+0000","last_undegraded":"2023-06-09T11:13:14.360853+0000","last_fullsized":"2023-06-09T11:13:14.360853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:27.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359825+0000","last_change":"2023-06-09T11:13:11.660734+0000","last_active":"2023-06-09T11:13:14.359825+0000","last_peered":"2023-06-09T11:13:14.359825+0000","last_clean":"2023-06-09T11:13:14.359825+0000","last_became_active":"2023-06-09T11:13:11.660453+0000","last_became_peered":"2023-06-09T11:13:11.660453+0000","last_unstale":"2023-06-09T11:13:14.359825+0000","last_undegraded":"2023-06-09T11:13:14.359825+0000","last_fullsized":"2023-06-09T11:13:14.359825+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:39:04.731067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362804+0000","last_change":"2023-06-09T11:13:12.123005+0000","last_active":"2023-06-09T11:13:14.362804+0000","last_peered":"2023-06-09T11:13:14.362804+0000","last_clean":"2023-06-09T11:13:14.362804+0000","last_became_active":"2023-06-09T11:13:12.122610+0000","last_became_peered":"2023-06-09T11:13:12.122610+0000","last_unstale":"2023-06-09T11:13:14.362804+0000","last_undegraded":"2023-06-09T11:13:14.362804+0000","last_fullsized":"2023-06-09T11:13:14.362804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:46.908265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360352+0000","last_change":"2023-06-09T11:13:11.666490+0000","last_active":"2023-06-09T11:13:14.360352+0000","last_peered":"2023-06-09T11:13:14.360352+0000","last_clean":"2023-06-09T11:13:14.360352+0000","last_became_active":"2023-06-09T11:13:11.666207+0000","last_became_peered":"2023-06-09T11:13:11.666207+0000","last_unstale":"2023-06-09T11:13:14.360352+0000","last_undegraded":"2023-06-09T11:13:14.360352+0000","last_fullsized":"2023-06-09T11:13:14.360352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:56:38.206288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114201+0000","last_change":"2023-06-09T11:13:12.114772+0000","last_active":"2023-06-09T11:13:13.114201+0000","last_peered":"2023-06-09T11:13:13.114201+0000","last_clean":"2023-06-09T11:13:13.114201+0000","last_became_active":"2023-06-09T11:13:12.111498+0000","last_became_peered":"2023-06-09T11:13:12.111498+0000","last_unstale":"2023-06-09T11:13:13.114201+0000","last_undegraded":"2023-06-09T11:13:13.114201+0000","last_fullsized":"2023-06-09T11:13:13.114201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:28:43.796872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363614+0000","last_change":"2023-06-09T11:13:11.663569+0000","last_active":"2023-06-09T11:13:14.363614+0000","last_peered":"2023-06-09T11:13:14.363614+0000","last_clean":"2023-06-09T11:13:14.363614+0000","last_became_active":"2023-06-09T11:13:11.663267+0000","last_became_peered":"2023-06-09T11:13:11.663267+0000","last_unstale":"2023-06-09T11:13:14.363614+0000","last_undegraded":"2023-06-09T11:13:14.363614+0000","last_fullsized":"2023-06-09T11:13:14.363614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:58:17.649635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116901+0000","last_change":"2023-06-09T11:13:12.143027+0000","last_active":"2023-06-09T11:13:13.116901+0000","last_peered":"2023-06-09T11:13:13.116901+0000","last_clean":"2023-06-09T11:13:13.116901+0000","last_became_active":"2023-06-09T11:13:12.142566+0000","last_became_peered":"2023-06-09T11:13:12.142566+0000","last_unstale":"2023-06-09T11:13:13.116901+0000","last_undegraded":"2023-06-09T11:13:13.116901+0000","last_fullsized":"2023-06-09T11:13:13.116901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:07.219044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118595+0000","last_change":"2023-06-09T11:13:11.663036+0000","last_active":"2023-06-09T11:13:13.118595+0000","last_peered":"2023-06-09T11:13:13.118595+0000","last_clean":"2023-06-09T11:13:13.118595+0000","last_became_active":"2023-06-09T11:13:11.662742+0000","last_became_peered":"2023-06-09T11:13:11.662742+0000","last_unstale":"2023-06-09T11:13:13.118595+0000","last_undegraded":"2023-06-09T11:13:13.118595+0000","last_fullsized":"2023-06-09T11:13:13.118595+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:02:09.495816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361636+0000","last_change":"2023-06-09T11:13:12.126002+0000","last_active":"2023-06-09T11:13:14.361636+0000","last_peered":"2023-06-09T11:13:14.361636+0000","last_clean":"2023-06-09T11:13:14.361636+0000","last_became_active":"2023-06-09T11:13:12.125703+0000","last_became_peered":"2023-06-09T11:13:12.125703+0000","last_unstale":"2023-06-09T11:13:14.361636+0000","last_undegraded":"2023-06-09T11:13:14.361636+0000","last_fullsized":"2023-06-09T11:13:14.361636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:01:28.605875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118030+0000","last_change":"2023-06-09T11:13:11.665437+0000","last_active":"2023-06-09T11:13:13.118030+0000","last_peered":"2023-06-09T11:13:13.118030+0000","last_clean":"2023-06-09T11:13:13.118030+0000","last_became_active":"2023-06-09T11:13:11.665125+0000","last_became_peered":"2023-06-09T11:13:11.665125+0000","last_unstale":"2023-06-09T11:13:13.118030+0000","last_undegraded":"2023-06-09T11:13:13.118030+0000","last_fullsized":"2023-06-09T11:13:13.118030+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:06.206327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361101+0000","last_change":"2023-06-09T11:13:12.123576+0000","last_active":"2023-06-09T11:13:14.361101+0000","last_peered":"2023-06-09T11:13:14.361101+0000","last_clean":"2023-06-09T11:13:14.361101+0000","last_became_active":"2023-06-09T11:13:12.123297+0000","last_became_peered":"2023-06-09T11:13:12.123297+0000","last_unstale":"2023-06-09T11:13:14.361101+0000","last_undegraded":"2023-06-09T11:13:14.361101+0000","last_fullsized":"2023-06-09T11:13:14.361101+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:47:46.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363356+0000","last_change":"2023-06-09T11:13:11.658004+0000","last_active":"2023-06-09T11:13:14.363356+0000","last_peered":"2023-06-09T11:13:14.363356+0000","last_clean":"2023-06-09T11:13:14.363356+0000","last_became_active":"2023-06-09T11:13:11.657705+0000","last_became_peered":"2023-06-09T11:13:11.657705+0000","last_unstale":"2023-06-09T11:13:14.363356+0000","last_undegraded":"2023-06-09T11:13:14.363356+0000","last_fullsized":"2023-06-09T11:13:14.363356+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:14:08.246932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360324+0000","last_change":"2023-06-09T11:13:12.123063+0000","last_active":"2023-06-09T11:13:14.360324+0000","last_peered":"2023-06-09T11:13:14.360324+0000","last_clean":"2023-06-09T11:13:14.360324+0000","last_became_active":"2023-06-09T11:13:12.122776+0000","last_became_peered":"2023-06-09T11:13:12.122776+0000","last_unstale":"2023-06-09T11:13:14.360324+0000","last_undegraded":"2023-06-09T11:13:14.360324+0000","last_fullsized":"2023-06-09T11:13:14.360324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:57:41.668832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363201+0000","last_change":"2023-06-09T11:13:11.659008+0000","last_active":"2023-06-09T11:13:14.363201+0000","last_peered":"2023-06-09T11:13:14.363201+0000","last_clean":"2023-06-09T11:13:14.363201+0000","last_became_active":"2023-06-09T11:13:11.658714+0000","last_became_peered":"2023-06-09T11:13:11.658714+0000","last_unstale":"2023-06-09T11:13:14.363201+0000","last_undegraded":"2023-06-09T11:13:14.363201+0000","last_fullsized":"2023-06-09T11:13:14.363201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:00:37.945261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362712+0000","last_change":"2023-06-09T11:13:12.115763+0000","last_active":"2023-06-09T11:13:14.362712+0000","last_peered":"2023-06-09T11:13:14.362712+0000","last_clean":"2023-06-09T11:13:14.362712+0000","last_became_active":"2023-06-09T11:13:12.115412+0000","last_became_peered":"2023-06-09T11:13:12.115412+0000","last_unstale":"2023-06-09T11:13:14.362712+0000","last_undegraded":"2023-06-09T11:13:14.362712+0000","last_fullsized":"2023-06-09T11:13:14.362712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:16.819164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360103+0000","last_change":"2023-06-09T11:13:11.665770+0000","last_active":"2023-06-09T11:13:14.360103+0000","last_peered":"2023-06-09T11:13:14.360103+0000","last_clean":"2023-06-09T11:13:14.360103+0000","last_became_active":"2023-06-09T11:13:11.665303+0000","last_became_peered":"2023-06-09T11:13:11.665303+0000","last_unstale":"2023-06-09T11:13:14.360103+0000","last_undegraded":"2023-06-09T11:13:14.360103+0000","last_fullsized":"2023-06-09T11:13:14.360103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:03.624371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117374+0000","last_change":"2023-06-09T11:13:12.125777+0000","last_active":"2023-06-09T11:13:13.117374+0000","last_peered":"2023-06-09T11:13:13.117374+0000","last_clean":"2023-06-09T11:13:13.117374+0000","last_became_active":"2023-06-09T11:13:12.125481+0000","last_became_peered":"2023-06-09T11:13:12.125481+0000","last_unstale":"2023-06-09T11:13:13.117374+0000","last_undegraded":"2023-06-09T11:13:13.117374+0000","last_fullsized":"2023-06-09T11:13:13.117374+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:38:51.762609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687350+0000","last_change":"2023-06-09T11:13:11.668442+0000","last_active":"2023-06-09T11:13:13.687350+0000","last_peered":"2023-06-09T11:13:13.687350+0000","last_clean":"2023-06-09T11:13:13.687350+0000","last_became_active":"2023-06-09T11:13:11.668095+0000","last_became_peered":"2023-06-09T11:13:11.668095+0000","last_unstale":"2023-06-09T11:13:13.687350+0000","last_undegraded":"2023-06-09T11:13:13.687350+0000","last_fullsized":"2023-06-09T11:13:13.687350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:46:43.154992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362970+0000","last_change":"2023-06-09T11:13:12.114274+0000","last_active":"2023-06-09T11:13:14.362970+0000","last_peered":"2023-06-09T11:13:14.362970+0000","last_clean":"2023-06-09T11:13:14.362970+0000","last_became_active":"2023-06-09T11:13:12.114052+0000","last_became_peered":"2023-06-09T11:13:12.114052+0000","last_unstale":"2023-06-09T11:13:14.362970+0000","last_undegraded":"2023-06-09T11:13:14.362970+0000","last_fullsized":"2023-06-09T11:13:14.362970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:39:05.743784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116442+0000","last_change":"2023-06-09T11:13:11.663051+0000","last_active":"2023-06-09T11:13:13.116442+0000","last_peered":"2023-06-09T11:13:13.116442+0000","last_clean":"2023-06-09T11:13:13.116442+0000","last_became_active":"2023-06-09T11:13:11.662649+0000","last_became_peered":"2023-06-09T11:13:11.662649+0000","last_unstale":"2023-06-09T11:13:13.116442+0000","last_undegraded":"2023-06-09T11:13:13.116442+0000","last_fullsized":"2023-06-09T11:13:13.116442+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:26:38.945819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363270+0000","last_change":"2023-06-09T11:13:12.141688+0000","last_active":"2023-06-09T11:13:14.363270+0000","last_peered":"2023-06-09T11:13:14.363270+0000","last_clean":"2023-06-09T11:13:14.363270+0000","last_became_active":"2023-06-09T11:13:12.141413+0000","last_became_peered":"2023-06-09T11:13:12.141413+0000","last_unstale":"2023-06-09T11:13:14.363270+0000","last_undegraded":"2023-06-09T11:13:14.363270+0000","last_fullsized":"2023-06-09T11:13:14.363270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:48.904833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118545+0000","last_change":"2023-06-09T11:13:11.661793+0000","last_active":"2023-06-09T11:13:13.118545+0000","last_peered":"2023-06-09T11:13:13.118545+0000","last_clean":"2023-06-09T11:13:13.118545+0000","last_became_active":"2023-06-09T11:13:11.661470+0000","last_became_peered":"2023-06-09T11:13:11.661470+0000","last_unstale":"2023-06-09T11:13:13.118545+0000","last_undegraded":"2023-06-09T11:13:13.118545+0000","last_fullsized":"2023-06-09T11:13:13.118545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:38:50.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118096+0000","last_change":"2023-06-09T11:13:12.122880+0000","last_active":"2023-06-09T11:13:13.118096+0000","last_peered":"2023-06-09T11:13:13.118096+0000","last_clean":"2023-06-09T11:13:13.118096+0000","last_became_active":"2023-06-09T11:13:12.122579+0000","last_became_peered":"2023-06-09T11:13:12.122579+0000","last_unstale":"2023-06-09T11:13:13.118096+0000","last_undegraded":"2023-06-09T11:13:13.118096+0000","last_fullsized":"2023-06-09T11:13:13.118096+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:43:35.600361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361306+0000","last_change":"2023-06-09T11:13:11.663975+0000","last_active":"2023-06-09T11:13:14.361306+0000","last_peered":"2023-06-09T11:13:14.361306+0000","last_clean":"2023-06-09T11:13:14.361306+0000","last_became_active":"2023-06-09T11:13:11.663677+0000","last_became_peered":"2023-06-09T11:13:11.663677+0000","last_unstale":"2023-06-09T11:13:14.361306+0000","last_undegraded":"2023-06-09T11:13:14.361306+0000","last_fullsized":"2023-06-09T11:13:14.361306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:04.295154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361135+0000","last_change":"2023-06-09T11:13:12.116720+0000","last_active":"2023-06-09T11:13:14.361135+0000","last_peered":"2023-06-09T11:13:14.361135+0000","last_clean":"2023-06-09T11:13:14.361135+0000","last_became_active":"2023-06-09T11:13:12.116407+0000","last_became_peered":"2023-06-09T11:13:12.116407+0000","last_unstale":"2023-06-09T11:13:14.361135+0000","last_undegraded":"2023-06-09T11:13:14.361135+0000","last_fullsized":"2023-06-09T11:13:14.361135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:35.231150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114056+0000","last_change":"2023-06-09T11:13:11.655670+0000","last_active":"2023-06-09T11:13:13.114056+0000","last_peered":"2023-06-09T11:13:13.114056+0000","last_clean":"2023-06-09T11:13:13.114056+0000","last_became_active":"2023-06-09T11:13:11.655398+0000","last_became_peered":"2023-06-09T11:13:11.655398+0000","last_unstale":"2023-06-09T11:13:13.114056+0000","last_undegraded":"2023-06-09T11:13:13.114056+0000","last_fullsized":"2023-06-09T11:13:13.114056+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:05.401534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114284+0000","last_change":"2023-06-09T11:13:12.115293+0000","last_active":"2023-06-09T11:13:13.114284+0000","last_peered":"2023-06-09T11:13:13.114284+0000","last_clean":"2023-06-09T11:13:13.114284+0000","last_became_active":"2023-06-09T11:13:12.115011+0000","last_became_peered":"2023-06-09T11:13:12.115011+0000","last_unstale":"2023-06-09T11:13:13.114284+0000","last_undegraded":"2023-06-09T11:13:13.114284+0000","last_fullsized":"2023-06-09T11:13:13.114284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:58:04.290258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360359+0000","last_change":"2023-06-09T11:13:11.663139+0000","last_active":"2023-06-09T11:13:14.360359+0000","last_peered":"2023-06-09T11:13:14.360359+0000","last_clean":"2023-06-09T11:13:14.360359+0000","last_became_active":"2023-06-09T11:13:11.662838+0000","last_became_peered":"2023-06-09T11:13:11.662838+0000","last_unstale":"2023-06-09T11:13:14.360359+0000","last_undegraded":"2023-06-09T11:13:14.360359+0000","last_fullsized":"2023-06-09T11:13:14.360359+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:00:37.945261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117649+0000","last_change":"2023-06-09T11:13:12.127526+0000","last_active":"2023-06-09T11:13:13.117649+0000","last_peered":"2023-06-09T11:13:13.117649+0000","last_clean":"2023-06-09T11:13:13.117649+0000","last_became_active":"2023-06-09T11:13:12.127267+0000","last_became_peered":"2023-06-09T11:13:12.127267+0000","last_unstale":"2023-06-09T11:13:13.117649+0000","last_undegraded":"2023-06-09T11:13:13.117649+0000","last_fullsized":"2023-06-09T11:13:13.117649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:45.875490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113820+0000","last_change":"2023-06-09T11:13:11.659747+0000","last_active":"2023-06-09T11:13:13.113820+0000","last_peered":"2023-06-09T11:13:13.113820+0000","last_clean":"2023-06-09T11:13:13.113820+0000","last_became_active":"2023-06-09T11:13:11.659482+0000","last_became_peered":"2023-06-09T11:13:11.659482+0000","last_unstale":"2023-06-09T11:13:13.113820+0000","last_undegraded":"2023-06-09T11:13:13.113820+0000","last_fullsized":"2023-06-09T11:13:13.113820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:45:40.555763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360952+0000","last_change":"2023-06-09T11:13:12.120429+0000","last_active":"2023-06-09T11:13:14.360952+0000","last_peered":"2023-06-09T11:13:14.360952+0000","last_clean":"2023-06-09T11:13:14.360952+0000","last_became_active":"2023-06-09T11:13:12.120140+0000","last_became_peered":"2023-06-09T11:13:12.120140+0000","last_unstale":"2023-06-09T11:13:14.360952+0000","last_undegraded":"2023-06-09T11:13:14.360952+0000","last_fullsized":"2023-06-09T11:13:14.360952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:52:01.329739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113728+0000","last_change":"2023-06-09T11:13:11.662342+0000","last_active":"2023-06-09T11:13:13.113728+0000","last_peered":"2023-06-09T11:13:13.113728+0000","last_clean":"2023-06-09T11:13:13.113728+0000","last_became_active":"2023-06-09T11:13:11.662060+0000","last_became_peered":"2023-06-09T11:13:11.662060+0000","last_unstale":"2023-06-09T11:13:13.113728+0000","last_undegraded":"2023-06-09T11:13:13.113728+0000","last_fullsized":"2023-06-09T11:13:13.113728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:02:06.851570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117732+0000","last_change":"2023-06-09T11:13:12.138545+0000","last_active":"2023-06-09T11:13:13.117732+0000","last_peered":"2023-06-09T11:13:13.117732+0000","last_clean":"2023-06-09T11:13:13.117732+0000","last_became_active":"2023-06-09T11:13:12.138221+0000","last_became_peered":"2023-06-09T11:13:12.138221+0000","last_unstale":"2023-06-09T11:13:13.117732+0000","last_undegraded":"2023-06-09T11:13:13.117732+0000","last_fullsized":"2023-06-09T11:13:13.117732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:18:45.926042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117087+0000","last_change":"2023-06-09T11:13:11.667366+0000","last_active":"2023-06-09T11:13:13.117087+0000","last_peered":"2023-06-09T11:13:13.117087+0000","last_clean":"2023-06-09T11:13:13.117087+0000","last_became_active":"2023-06-09T11:13:11.667056+0000","last_became_peered":"2023-06-09T11:13:11.667056+0000","last_unstale":"2023-06-09T11:13:13.117087+0000","last_undegraded":"2023-06-09T11:13:13.117087+0000","last_fullsized":"2023-06-09T11:13:13.117087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:47:45.561611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363106+0000","last_change":"2023-06-09T11:13:12.122628+0000","last_active":"2023-06-09T11:13:14.363106+0000","last_peered":"2023-06-09T11:13:14.363106+0000","last_clean":"2023-06-09T11:13:14.363106+0000","last_became_active":"2023-06-09T11:13:12.122345+0000","last_became_peered":"2023-06-09T11:13:12.122345+0000","last_unstale":"2023-06-09T11:13:14.363106+0000","last_undegraded":"2023-06-09T11:13:14.363106+0000","last_fullsized":"2023-06-09T11:13:14.363106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:55.327103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113556+0000","last_change":"2023-06-09T11:13:11.660769+0000","last_active":"2023-06-09T11:13:13.113556+0000","last_peered":"2023-06-09T11:13:13.113556+0000","last_clean":"2023-06-09T11:13:13.113556+0000","last_became_active":"2023-06-09T11:13:11.660439+0000","last_became_peered":"2023-06-09T11:13:11.660439+0000","last_unstale":"2023-06-09T11:13:13.113556+0000","last_undegraded":"2023-06-09T11:13:13.113556+0000","last_fullsized":"2023-06-09T11:13:13.113556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:20:19.034965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118324+0000","last_change":"2023-06-09T11:13:12.127989+0000","last_active":"2023-06-09T11:13:13.118324+0000","last_peered":"2023-06-09T11:13:13.118324+0000","last_clean":"2023-06-09T11:13:13.118324+0000","last_became_active":"2023-06-09T11:13:12.127652+0000","last_became_peered":"2023-06-09T11:13:12.127652+0000","last_unstale":"2023-06-09T11:13:13.118324+0000","last_undegraded":"2023-06-09T11:13:13.118324+0000","last_fullsized":"2023-06-09T11:13:13.118324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:56:35.231150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.116655+0000","last_change":"2023-06-09T11:13:11.662064+0000","last_active":"2023-06-09T11:13:13.116655+0000","last_peered":"2023-06-09T11:13:13.116655+0000","last_clean":"2023-06-09T11:13:13.116655+0000","last_became_active":"2023-06-09T11:13:11.661794+0000","last_became_peered":"2023-06-09T11:13:11.661794+0000","last_unstale":"2023-06-09T11:13:13.116655+0000","last_undegraded":"2023-06-09T11:13:13.116655+0000","last_fullsized":"2023-06-09T11:13:13.116655+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:20:38.887782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117726+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T11:13:13.117726+0000","last_peered":"2023-06-09T11:13:13.117726+0000","last_clean":"2023-06-09T11:13:13.117726+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T11:13:13.117726+0000","last_undegraded":"2023-06-09T11:13:13.117726+0000","last_fullsized":"2023-06-09T11:13:13.117726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:19:38.578079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118228+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T11:13:13.118228+0000","last_peered":"2023-06-09T11:13:13.118228+0000","last_clean":"2023-06-09T11:13:13.118228+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T11:13:13.118228+0000","last_undegraded":"2023-06-09T11:13:13.118228+0000","last_fullsized":"2023-06-09T11:13:13.118228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:37.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360277+0000","last_change":"2023-06-09T11:13:12.139763+0000","last_active":"2023-06-09T11:13:14.360277+0000","last_peered":"2023-06-09T11:13:14.360277+0000","last_clean":"2023-06-09T11:13:14.360277+0000","last_became_active":"2023-06-09T11:13:12.139477+0000","last_became_peered":"2023-06-09T11:13:12.139477+0000","last_unstale":"2023-06-09T11:13:14.360277+0000","last_undegraded":"2023-06-09T11:13:14.360277+0000","last_fullsized":"2023-06-09T11:13:14.360277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:25:15.747303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.118714+0000","last_change":"2023-06-09T11:13:11.664182+0000","last_active":"2023-06-09T11:13:13.118714+0000","last_peered":"2023-06-09T11:13:13.118714+0000","last_clean":"2023-06-09T11:13:13.118714+0000","last_became_active":"2023-06-09T11:13:11.663781+0000","last_became_peered":"2023-06-09T11:13:11.663781+0000","last_unstale":"2023-06-09T11:13:13.118714+0000","last_undegraded":"2023-06-09T11:13:13.118714+0000","last_fullsized":"2023-06-09T11:13:13.118714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:44.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117492+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T11:13:13.117492+0000","last_peered":"2023-06-09T11:13:13.117492+0000","last_clean":"2023-06-09T11:13:13.117492+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T11:13:13.117492+0000","last_undegraded":"2023-06-09T11:13:13.117492+0000","last_fullsized":"2023-06-09T11:13:13.117492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:15:55.843260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117087+0000","last_change":"2023-06-09T11:13:12.142838+0000","last_active":"2023-06-09T11:13:13.117087+0000","last_peered":"2023-06-09T11:13:13.117087+0000","last_clean":"2023-06-09T11:13:13.117087+0000","last_became_active":"2023-06-09T11:13:12.142225+0000","last_became_peered":"2023-06-09T11:13:12.142225+0000","last_unstale":"2023-06-09T11:13:13.117087+0000","last_undegraded":"2023-06-09T11:13:13.117087+0000","last_fullsized":"2023-06-09T11:13:13.117087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:46:27.149190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.114094+0000","last_change":"2023-06-09T11:13:11.655918+0000","last_active":"2023-06-09T11:13:13.114094+0000","last_peered":"2023-06-09T11:13:13.114094+0000","last_clean":"2023-06-09T11:13:13.114094+0000","last_became_active":"2023-06-09T11:13:11.655274+0000","last_became_peered":"2023-06-09T11:13:11.655274+0000","last_unstale":"2023-06-09T11:13:13.114094+0000","last_undegraded":"2023-06-09T11:13:13.114094+0000","last_fullsized":"2023-06-09T11:13:13.114094+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:17:20.233039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.113569+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T11:13:13.113569+0000","last_peered":"2023-06-09T11:13:13.113569+0000","last_clean":"2023-06-09T11:13:13.113569+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T11:13:13.113569+0000","last_undegraded":"2023-06-09T11:13:13.113569+0000","last_fullsized":"2023-06-09T11:13:13.113569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:01:40.458211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.363332+0000","last_change":"2023-06-09T11:13:12.118907+0000","last_active":"2023-06-09T11:13:14.363332+0000","last_peered":"2023-06-09T11:13:14.363332+0000","last_clean":"2023-06-09T11:13:14.363332+0000","last_became_active":"2023-06-09T11:13:12.118622+0000","last_became_peered":"2023-06-09T11:13:12.118622+0000","last_unstale":"2023-06-09T11:13:14.363332+0000","last_undegraded":"2023-06-09T11:13:14.363332+0000","last_fullsized":"2023-06-09T11:13:14.363332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:08:12.608038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360096+0000","last_change":"2023-06-09T11:13:11.665481+0000","last_active":"2023-06-09T11:13:14.360096+0000","last_peered":"2023-06-09T11:13:14.360096+0000","last_clean":"2023-06-09T11:13:14.360096+0000","last_became_active":"2023-06-09T11:13:11.665195+0000","last_became_peered":"2023-06-09T11:13:11.665195+0000","last_unstale":"2023-06-09T11:13:14.360096+0000","last_undegraded":"2023-06-09T11:13:14.360096+0000","last_fullsized":"2023-06-09T11:13:14.360096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:41:39.251792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117821+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T11:13:13.117821+0000","last_peered":"2023-06-09T11:13:13.117821+0000","last_clean":"2023-06-09T11:13:13.117821+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T11:13:13.117821+0000","last_undegraded":"2023-06-09T11:13:13.117821+0000","last_fullsized":"2023-06-09T11:13:13.117821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:19:30.435888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360482+0000","last_change":"2023-06-09T11:13:12.117840+0000","last_active":"2023-06-09T11:13:14.360482+0000","last_peered":"2023-06-09T11:13:14.360482+0000","last_clean":"2023-06-09T11:13:14.360482+0000","last_became_active":"2023-06-09T11:13:12.117567+0000","last_became_peered":"2023-06-09T11:13:12.117567+0000","last_unstale":"2023-06-09T11:13:14.360482+0000","last_undegraded":"2023-06-09T11:13:14.360482+0000","last_fullsized":"2023-06-09T11:13:14.360482+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:26:32.923905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.361534+0000","last_change":"2023-06-09T11:13:11.667666+0000","last_active":"2023-06-09T11:13:14.361534+0000","last_peered":"2023-06-09T11:13:14.361534+0000","last_clean":"2023-06-09T11:13:14.361534+0000","last_became_active":"2023-06-09T11:13:11.667321+0000","last_became_peered":"2023-06-09T11:13:11.667321+0000","last_unstale":"2023-06-09T11:13:14.361534+0000","last_undegraded":"2023-06-09T11:13:14.361534+0000","last_fullsized":"2023-06-09T11:13:14.361534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:27:30.548312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360471+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T11:13:14.360471+0000","last_peered":"2023-06-09T11:13:14.360471+0000","last_clean":"2023-06-09T11:13:14.360471+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T11:13:14.360471+0000","last_undegraded":"2023-06-09T11:13:14.360471+0000","last_fullsized":"2023-06-09T11:13:14.360471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:24:39.440222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.359940+0000","last_change":"2023-06-09T11:13:12.140945+0000","last_active":"2023-06-09T11:13:14.359940+0000","last_peered":"2023-06-09T11:13:14.359940+0000","last_clean":"2023-06-09T11:13:14.359940+0000","last_became_active":"2023-06-09T11:13:12.140707+0000","last_became_peered":"2023-06-09T11:13:12.140707+0000","last_unstale":"2023-06-09T11:13:14.359940+0000","last_undegraded":"2023-06-09T11:13:14.359940+0000","last_fullsized":"2023-06-09T11:13:14.359940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:31:55.327103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687507+0000","last_change":"2023-06-09T11:13:11.664806+0000","last_active":"2023-06-09T11:13:13.687507+0000","last_peered":"2023-06-09T11:13:13.687507+0000","last_clean":"2023-06-09T11:13:13.687507+0000","last_became_active":"2023-06-09T11:13:11.664537+0000","last_became_peered":"2023-06-09T11:13:11.664537+0000","last_unstale":"2023-06-09T11:13:13.687507+0000","last_undegraded":"2023-06-09T11:13:13.687507+0000","last_fullsized":"2023-06-09T11:13:13.687507+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:58:03.277541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117260+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T11:13:13.117260+0000","last_peered":"2023-06-09T11:13:13.117260+0000","last_clean":"2023-06-09T11:13:13.117260+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T11:13:13.117260+0000","last_undegraded":"2023-06-09T11:13:13.117260+0000","last_fullsized":"2023-06-09T11:13:13.117260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:25.766539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360524+0000","last_change":"2023-06-09T11:13:12.118501+0000","last_active":"2023-06-09T11:13:14.360524+0000","last_peered":"2023-06-09T11:13:14.360524+0000","last_clean":"2023-06-09T11:13:14.360524+0000","last_became_active":"2023-06-09T11:13:12.118202+0000","last_became_peered":"2023-06-09T11:13:12.118202+0000","last_unstale":"2023-06-09T11:13:14.360524+0000","last_undegraded":"2023-06-09T11:13:14.360524+0000","last_fullsized":"2023-06-09T11:13:14.360524+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:59:29.599356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360358+0000","last_change":"2023-06-09T11:13:11.662748+0000","last_active":"2023-06-09T11:13:14.360358+0000","last_peered":"2023-06-09T11:13:14.360358+0000","last_clean":"2023-06-09T11:13:14.360358+0000","last_became_active":"2023-06-09T11:13:11.661763+0000","last_became_peered":"2023-06-09T11:13:11.661763+0000","last_unstale":"2023-06-09T11:13:14.360358+0000","last_undegraded":"2023-06-09T11:13:14.360358+0000","last_fullsized":"2023-06-09T11:13:14.360358+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:06.206327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.360795+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T11:13:14.360795+0000","last_peered":"2023-06-09T11:13:14.360795+0000","last_clean":"2023-06-09T11:13:14.360795+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T11:13:14.360795+0000","last_undegraded":"2023-06-09T11:13:14.360795+0000","last_fullsized":"2023-06-09T11:13:14.360795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:12:59.795038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.117028+0000","last_change":"2023-06-09T11:13:12.143219+0000","last_active":"2023-06-09T11:13:13.117028+0000","last_peered":"2023-06-09T11:13:13.117028+0000","last_clean":"2023-06-09T11:13:13.117028+0000","last_became_active":"2023-06-09T11:13:12.141954+0000","last_became_peered":"2023-06-09T11:13:12.141954+0000","last_unstale":"2023-06-09T11:13:13.117028+0000","last_undegraded":"2023-06-09T11:13:13.117028+0000","last_fullsized":"2023-06-09T11:13:13.117028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:11.630883+0000","last_clean_scrub_stamp":"2023-06-09T11:13:11.630883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:43:35.600361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:14.362847+0000","last_change":"2023-06-09T11:13:11.663708+0000","last_active":"2023-06-09T11:13:14.362847+0000","last_peered":"2023-06-09T11:13:14.362847+0000","last_clean":"2023-06-09T11:13:14.362847+0000","last_became_active":"2023-06-09T11:13:11.663319+0000","last_became_peered":"2023-06-09T11:13:11.663319+0000","last_unstale":"2023-06-09T11:13:14.362847+0000","last_undegraded":"2023-06-09T11:13:14.362847+0000","last_fullsized":"2023-06-09T11:13:14.362847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:13:10.618166+0000","last_clean_scrub_stamp":"2023-06-09T11:13:10.618166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:21:35.916292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T11:13:13.687972+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T11:13:13.687972+0000","last_peered":"2023-06-09T11:13:13.687972+0000","last_clean":"2023-06-09T11:13:13.687972+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T11:13:13.687972+0000","last_undegraded":"2023-06-09T11:13:13.687972+0000","last_fullsized":"2023-06-09T11:13:13.687972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:19:55.096680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9656,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362184,"statfs":{"total":96636764160,"available":96626876416,"internally_reserved":0,"allocated":1032192,"data_stored":767390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.137},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.2589999999999999}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.194},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.234}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.282},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.351}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5109999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3999999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.5649999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":425984,"data_stored":175970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.92900000000000005}]},{"osd":1,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.089},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.91500000000000004}]},{"osd":2,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.1379999999999999}]},{"osd":3,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.125}]},{"osd":4,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":6.0339999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":5.8029999999999999},"last":1.0269999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.3640000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.169},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8556,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363284,"statfs":{"total":96636764160,"available":96628002816,"internally_reserved":0,"allocated":430080,"data_stored":175500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.97399999999999998}]},{"osd":1,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.268}]},{"osd":2,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.034}]},{"osd":3,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.3360000000000001}]},{"osd":4,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3}]},{"osd":6,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.698}]},{"osd":7,"last update":"Fri Jun 9 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.645}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":430080,"data_stored":175992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.2310000000000001}]},{"osd":1,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.069}]},{"osd":3,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.119}]},{"osd":5,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.1680000000000001,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":1.198}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8564,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363276,"statfs":{"total":96636764160,"available":96627994624,"internally_reserved":0,"allocated":438272,"data_stored":176986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0389999999999999}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.3640000000000001}]},{"osd":2,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.268},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.448},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.5649999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.4259999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.4019999999999999}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.9380000000000002,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":1.474},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.5149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8424,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363416,"statfs":{"total":96636764160,"available":96628137984,"internally_reserved":0,"allocated":425984,"data_stored":175458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":0.999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.1519999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":3.2400000000000002,"5min":3.2400000000000002,"15min":3.2400000000000002},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.399}]},{"osd":6,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.377}]},{"osd":7,"last update":"Fri Jun 9 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":8.8629999999999995,"5min":8.8629999999999995,"15min":8.8629999999999995},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.331}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8488,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363352,"statfs":{"total":96636764160,"available":96628072448,"internally_reserved":0,"allocated":425984,"data_stored":175478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":1.032}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.748}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.194},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.995}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":1.2929999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":1.3500000000000001}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.4350000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9576,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362264,"statfs":{"total":96636764160,"available":96626958336,"internally_reserved":0,"allocated":1015808,"data_stored":764771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.753},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.0189999999999999}]},{"osd":2,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.127},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.3069999999999999}]},{"osd":6,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.103},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":1.012,"5min":1.012,"15min":1.012},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Jun 9 11:12:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.079},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.157}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T11:13:21.685 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T11:13:21.686 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-09T11:13:21.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 Processor -- start 2023-06-09T11:13:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 -- start start 2023-06-09T11:13:21.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f800c142bc0 0x7f800c069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f800c0707a0 0x7f800c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c0d0c00 0x7f800c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c071260 con 0x7f800c0707a0 2023-06-09T11:13:21.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c0d15a0 con 0x7f800c142bc0 2023-06-09T11:13:21.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80119ef700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c142f90 con 0x7f800c0d0c00 2023-06-09T11:13:21.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f800bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f800c0707a0 0x7f800c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80109ed700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f800c142bc0 0x7f800c069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f800bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f800c0707a0 0x7f800c070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58254/0 (socket says 172.21.15.78:58254) 2023-06-09T11:13:21.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f800bfff700 1 -- 172.21.15.78:0/1226481166 learned_addr learned my addr 172.21.15.78:0/1226481166 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f80111ee700 1 --2- 172.21.15.78:0/1226481166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c0d0c00 0x7f800c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f800bfff700 1 -- 172.21.15.78:0/1226481166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c0d0c00 msgr2=0x7f800c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f800bfff700 1 --2- 172.21.15.78:0/1226481166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c0d0c00 0x7f800c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.891+0000 7f800bfff700 1 -- 172.21.15.78:0/1226481166 >> v2:172.21.15.187:3300/0 conn(0x7f800c142bc0 msgr2=0x7f800c069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f800bfff700 1 --2- 172.21.15.78:0/1226481166 >> v2:172.21.15.187:3300/0 conn(0x7f800c142bc0 0x7f800c069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f800bfff700 1 -- 172.21.15.78:0/1226481166 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0c8120 con 0x7f800c0707a0 2023-06-09T11:13:21.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f800bfff700 1 --2- 172.21.15.78:0/1226481166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0707a0 0x7f800c070bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f800c06d1b0 tx=0x7f7ff8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbabba041fd6e07f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:21.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f800b7fe700 1 -- 172.21.15.78:0/1226481166 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8011830 con 0x7f800c0707a0 2023-06-09T11:13:21.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f800b7fe700 1 -- 172.21.15.78:0/1226481166 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8011990 con 0x7f800c0707a0 2023-06-09T11:13:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f800b7fe700 1 -- 172.21.15.78:0/1226481166 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8011d20 con 0x7f800c0707a0 2023-06-09T11:13:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 -- 172.21.15.78:0/1226481166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0707a0 msgr2=0x7f800c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 --2- 172.21.15.78:0/1226481166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0707a0 0x7f800c070bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f800c06d1b0 tx=0x7f7ff8009bf0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 -- 172.21.15.78:0/1226481166 shutdown_connections 2023-06-09T11:13:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 --2- 172.21.15.78:0/1226481166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c0d0c00 0x7f800c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 --2- 172.21.15.78:0/1226481166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0707a0 0x7f800c070bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 --2- 172.21.15.78:0/1226481166 >> v2:172.21.15.187:3300/0 conn(0x7f800c142bc0 0x7f800c069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 -- 172.21.15.78:0/1226481166 >> 172.21.15.78:0/1226481166 conn(0x7f800c0d3ba0 msgr2=0x7f800c0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:21.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 -- 172.21.15.78:0/1226481166 shutdown_connections 2023-06-09T11:13:21.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.895+0000 7f80119ef700 1 -- 172.21.15.78:0/1226481166 wait complete. 2023-06-09T11:13:21.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 Processor -- start 2023-06-09T11:13:21.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 -- start start 2023-06-09T11:13:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f800c0707a0 0x7f800c1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0d0c00 0x7f800c06dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c142bc0 0x7f800c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1f2f50 con 0x7f800c0d0c00 2023-06-09T11:13:21.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c143130 con 0x7f800c0707a0 2023-06-09T11:13:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1433d0 con 0x7f800c142bc0 2023-06-09T11:13:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0d0c00 0x7f800c06dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0d0c00 0x7f800c06dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58264/0 (socket says 172.21.15.78:58264) 2023-06-09T11:13:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 -- 172.21.15.78:0/1405906474 learned_addr learned my addr 172.21.15.78:0/1405906474 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80109ed700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f800c0707a0 0x7f800c1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80111ee700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c142bc0 0x7f800c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 -- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c142bc0 msgr2=0x7f800c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c142bc0 0x7f800c06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 -- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f800c0707a0 msgr2=0x7f800c1f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f800c0707a0 0x7f800c1f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 -- 172.21.15.78:0/1405906474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8009570 con 0x7f800c0d0c00 2023-06-09T11:13:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f800bfff700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0d0c00 0x7f800c06dfa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000c00 tx=0x7f7ff8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:21.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80097fa700 1 -- 172.21.15.78:0/1405906474 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8004610 con 0x7f800c0d0c00 2023-06-09T11:13:21.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80097fa700 1 -- 172.21.15.78:0/1405906474 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff801e070 con 0x7f800c0d0c00 2023-06-09T11:13:21.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80097fa700 1 -- 172.21.15.78:0/1405906474 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80038e0 con 0x7f800c0d0c00 2023-06-09T11:13:21.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.899+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c0c86e0 con 0x7f800c0d0c00 2023-06-09T11:13:21.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.903+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c0c8400 con 0x7f800c0d0c00 2023-06-09T11:13:21.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.903+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c0c89c0 con 0x7f800c0d0c00 2023-06-09T11:13:21.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.903+0000 7f80097fa700 1 -- 172.21.15.78:0/1405906474 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7ff8003a40 con 0x7f800c0d0c00 2023-06-09T11:13:21.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.903+0000 7f80097fa700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7ff00662f0 0x7f7ff00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.907+0000 7f80097fa700 1 -- 172.21.15.78:0/1405906474 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ff80848a0 con 0x7f800c0d0c00 2023-06-09T11:13:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.907+0000 7f80109ed700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7ff00662f0 0x7f7ff00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.907+0000 7f80109ed700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7ff00662f0 0x7f7ff00687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f80000073f0 tx=0x7f800000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:21.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:21.911+0000 7f80097fa700 1 -- 172.21.15.78:0/1405906474 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7ff8051e30 con 0x7f800c0d0c00 2023-06-09T11:13:22.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.143+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f800c1438f0 con 0x7f800c0d0c00 2023-06-09T11:13:22.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.151+0000 7f80097fa700 1 -- 172.21.15.78:0/1405906474 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7ff80200e0 con 0x7f800c0d0c00 2023-06-09T11:13:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7ff00662f0 msgr2=0x7f7ff00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7ff00662f0 0x7f7ff00687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f80000073f0 tx=0x7f800000b040 comp rx=0 tx=0).stop 2023-06-09T11:13:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0d0c00 msgr2=0x7f800c06dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0d0c00 0x7f800c06dfa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000c00 tx=0x7f7ff8004770 comp rx=0 tx=0).stop 2023-06-09T11:13:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 shutdown_connections 2023-06-09T11:13:22.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7ff00662f0 0x7f7ff00687a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f800c142bc0 0x7f800c06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f800c0d0c00 0x7f800c06dfa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 --2- 172.21.15.78:0/1405906474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f800c0707a0 0x7f800c1f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 >> 172.21.15.78:0/1405906474 conn(0x7f800c0d3ba0 msgr2=0x7f800c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 shutdown_connections 2023-06-09T11:13:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.155+0000 7f80119ef700 1 -- 172.21.15.78:0/1405906474 wait complete. 2023-06-09T11:13:22.167 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-06-09T11:13:22.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T11:13:22.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.351+0000 7fca46cdc700 1 Processor -- start 2023-06-09T11:13:22.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.351+0000 7fca46cdc700 1 -- start start 2023-06-09T11:13:22.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca46cdc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 0x7fca400c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca46cdc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca4006dca0 0x7fca40070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca46cdc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4006e160 con 0x7fca4015c780 2023-06-09T11:13:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca46cdc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400cc980 con 0x7fca4006dca0 2023-06-09T11:13:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca46cdc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400ccc20 con 0x7fca4015c3b0 2023-06-09T11:13:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca454d9700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fca4015c780 0x7fca4006d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50614/0 (socket says 172.21.15.78:50614) 2023-06-09T11:13:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca454d9700 1 -- 172.21.15.78:0/2168817523 learned_addr learned my addr 172.21.15.78:0/2168817523 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca464db700 1 --2- 172.21.15.78:0/2168817523 >> v2:172.21.15.78:3300/0 conn(0x7fca4006dca0 0x7fca40070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca45cda700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 0x7fca400c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258685415 0 0) 0x7fca4006e160 con 0x7fca4015c780 2023-06-09T11:13:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2c0035d0 con 0x7fca4015c780 2023-06-09T11:13:22.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132791525 0 0) 0x7fca2c0035d0 con 0x7fca4015c780 2023-06-09T11:13:22.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 msgr2=0x7fca400c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:22.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 0x7fca400c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 >> v2:172.21.15.78:3300/0 conn(0x7fca4006dca0 msgr2=0x7fca40070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 --2- 172.21.15.78:0/2168817523 >> v2:172.21.15.78:3300/0 conn(0x7fca4006dca0 0x7fca40070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4006e400 con 0x7fca4015c780 2023-06-09T11:13:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7fca30001670 con 0x7fca4015c780 2023-06-09T11:13:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 >> v1:172.21.15.78:6789/0 conn(0x7fca4015c780 legacy=0x7fca4006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c003a20 0x7fca2c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c004870 0x7fca2c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 0x7fca2c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400cc980 con 0x7fca2c003a20 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400ccc20 con 0x7fca2c004870 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.355+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00bab0 con 0x7fca4015c3b0 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca45cda700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c003a20 0x7fca2c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca454d9700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c004870 0x7fca2c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca464db700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 0x7fca2c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca45cda700 1 -- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 msgr2=0x7fca2c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca45cda700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4015c3b0 0x7fca2c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca45cda700 1 -- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c004870 msgr2=0x7fca2c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca45cda700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c004870 0x7fca2c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca45cda700 1 -- 172.21.15.78:0/2168817523 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0035d0 con 0x7fca2c003a20 2023-06-09T11:13:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca45cda700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c003a20 0x7fca2c003e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009b70 tx=0x7fca2c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e79ef7934cdda6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00e6c0 con 0x7fca2c003a20 2023-06-09T11:13:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c00e820 con 0x7fca2c003a20 2023-06-09T11:13:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca44cd8700 1 -- 172.21.15.78:0/2168817523 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00eb90 con 0x7fca2c003a20 2023-06-09T11:13:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca46cdc700 1 -- 172.21.15.78:0/2168817523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c003a20 msgr2=0x7fca2c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca46cdc700 1 --2- 172.21.15.78:0/2168817523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c003a20 0x7fca2c003e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009b70 tx=0x7fca2c0058a0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca464db700 1 -- 172.21.15.78:0/2168817523 reap_dead start 2023-06-09T11:13:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca46cdc700 1 -- 172.21.15.78:0/2168817523 shutdown_connections 2023-06-09T11:13:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca46cdc700 1 -- 172.21.15.78:0/2168817523 >> 172.21.15.78:0/2168817523 conn(0x7fca400cf670 msgr2=0x7fca400cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca46cdc700 1 -- 172.21.15.78:0/2168817523 shutdown_connections 2023-06-09T11:13:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.359+0000 7fca46cdc700 1 -- 172.21.15.78:0/2168817523 wait complete. 2023-06-09T11:13:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.363+0000 7fca46cdc700 1 Processor -- start 2023-06-09T11:13:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.363+0000 7fca46cdc700 1 -- start start 2023-06-09T11:13:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c003a20 0x7fca400c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca400c40f0 0x7fca40146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca400c4520 0x7fca40146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40146c90 con 0x7fca400c40f0 2023-06-09T11:13:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400c7e00 con 0x7fca2c003a20 2023-06-09T11:13:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400c8080 con 0x7fca400c4520 2023-06-09T11:13:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca400c40f0 0x7fca40146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca400c40f0 0x7fca40146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58296/0 (socket says 172.21.15.78:58296) 2023-06-09T11:13:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 -- 172.21.15.78:0/404382382 learned_addr learned my addr 172.21.15.78:0/404382382 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca45cda700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c003a20 0x7fca400c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca464db700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca400c4520 0x7fca40146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 -- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca400c4520 msgr2=0x7fca40146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca400c4520 0x7fca40146750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 -- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c003a20 msgr2=0x7fca400c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c003a20 0x7fca400c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 -- 172.21.15.78:0/404382382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400ccf00 con 0x7fca400c40f0 2023-06-09T11:13:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca464db700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca400c4520 0x7fca40146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca454d9700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca400c40f0 0x7fca40146210 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fca30007310 tx=0x7fca300076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:22.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca367fc700 1 -- 172.21.15.78:0/404382382 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300077f0 con 0x7fca400c40f0 2023-06-09T11:13:22.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca367fc700 1 -- 172.21.15.78:0/404382382 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000f870 con 0x7fca400c40f0 2023-06-09T11:13:22.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca367fc700 1 -- 172.21.15.78:0/404382382 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000fc20 con 0x7fca400c40f0 2023-06-09T11:13:22.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca400ce680 con 0x7fca400c40f0 2023-06-09T11:13:22.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.367+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca400cd090 con 0x7fca400c40f0 2023-06-09T11:13:22.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.371+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca400b3f60 con 0x7fca400c40f0 2023-06-09T11:13:22.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.371+0000 7fca367fc700 1 -- 172.21.15.78:0/404382382 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca3000fd80 con 0x7fca400c40f0 2023-06-09T11:13:22.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.371+0000 7fca367fc700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fca24066320 0x7fca240687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:22.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.371+0000 7fca367fc700 1 -- 172.21.15.78:0/404382382 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca30083df0 con 0x7fca400c40f0 2023-06-09T11:13:22.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.371+0000 7fca45cda700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fca24066320 0x7fca240687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:22.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.375+0000 7fca45cda700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fca24066320 0x7fca240687d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0090b0 tx=0x7fca3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:22.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.379+0000 7fca367fc700 1 -- 172.21.15.78:0/404382382 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fca30051290 con 0x7fca400c40f0 2023-06-09T11:13:22.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.587+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca400741c0 con 0x7fca400c40f0 2023-06-09T11:13:22.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.587+0000 7fca367fc700 1 -- 172.21.15.78:0/404382382 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fca3005a030 con 0x7fca400c40f0 2023-06-09T11:13:22.597 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:22.597 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3399791462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3399791462},{"type":"v1","addr":"172.21.15.187:6837","nonce":3399791462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/658938311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":658938311},{"type":"v1","addr":"172.21.15.78:6834","nonce":658938311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/952789446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":952789446},{"type":"v1","addr":"172.21.15.78:6835","nonce":952789446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:13:12.092475+0000","modified":"2023-06-09T11:13:15.123169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5137":{"gid":5137,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.187:6835/1349991607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1349991607},{"type":"v1","addr":"172.21.15.187:6835","nonce":1349991607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T11:13:22.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fca24066320 msgr2=0x7fca240687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fca24066320 0x7fca240687d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0090b0 tx=0x7fca3c008030 comp rx=0 tx=0).stop 2023-06-09T11:13:22.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca400c40f0 msgr2=0x7fca40146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:22.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca400c40f0 0x7fca40146210 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fca30007310 tx=0x7fca300076d0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 shutdown_connections 2023-06-09T11:13:22.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fca24066320 0x7fca240687d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca400c4520 0x7fca40146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca400c40f0 0x7fca40146210 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 --2- 172.21.15.78:0/404382382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2c003a20 0x7fca400c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:22.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 >> 172.21.15.78:0/404382382 conn(0x7fca400cf670 msgr2=0x7fca400b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:22.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 shutdown_connections 2023-06-09T11:13:22.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:22.591+0000 7fca46cdc700 1 -- 172.21.15.78:0/404382382 wait complete. 2023-06-09T11:13:22.602 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2023-06-09T11:13:23.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T11:13:12.092475+0000', 'modified': '2023-06-09T11:13:15.123169+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5137}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5137': {'gid': 5137, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.187:6835/1349991607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 1349991607}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 1349991607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T11:13:23.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T11:13:23.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-09T11:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.191+0000 7ffaee861700 1 Processor -- start 2023-06-09T11:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.191+0000 7ffaee861700 1 -- start start 2023-06-09T11:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee861700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffae80c7cb0 0x7ffae806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee861700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae80c87a0 con 0x7ffae815c880 2023-06-09T11:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee861700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae80c81e0 con 0x7ffae806fc80 2023-06-09T11:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee861700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae806e660 con 0x7ffae80c7cb0 2023-06-09T11:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaed05e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ffae815c880 0x7ffae806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50630/0 (socket says 172.21.15.78:50630) 2023-06-09T11:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaed05e700 1 -- 172.21.15.78:0/1222850171 learned_addr learned my addr 172.21.15.78:0/1222850171 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee060700 1 --2- 172.21.15.78:0/1222850171 >> v2:172.21.15.187:3300/0 conn(0x7ffae80c7cb0 0x7ffae806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664572237 0 0) 0x7ffae80c87a0 con 0x7ffae815c880 2023-06-09T11:13:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad40035d0 con 0x7ffae815c880 2023-06-09T11:13:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612254331 0 0) 0x7ffae80c81e0 con 0x7ffae806fc80 2023-06-09T11:13:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae80c87a0 con 0x7ffae806fc80 2023-06-09T11:13:23.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee060700 1 -- 172.21.15.78:0/1222850171 >> v1:172.21.15.187:6789/0 conn(0x7ffae806fc80 legacy=0x7ffae8070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 189655290 0 0) 0x7ffad40035d0 con 0x7ffae815c880 2023-06-09T11:13:23.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee060700 1 -- 172.21.15.78:0/1222850171 >> v1:172.21.15.78:6789/0 conn(0x7ffae815c880 legacy=0x7ffae806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.195+0000 7ffaee060700 1 -- 172.21.15.78:0/1222850171 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae80c84c0 con 0x7ffae80c7cb0 2023-06-09T11:13:23.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee060700 1 --2- 172.21.15.78:0/1222850171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80c7cb0 0x7ffae806a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009dc0 tx=0x7ffae000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcf47971b8d33ff7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000e070 con 0x7ffae80c7cb0 2023-06-09T11:13:23.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0003a40 con 0x7ffae80c7cb0 2023-06-09T11:13:23.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaec85d700 1 -- 172.21.15.78:0/1222850171 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8001670 con 0x7ffae80c7cb0 2023-06-09T11:13:23.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee861700 1 -- 172.21.15.78:0/1222850171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80c7cb0 msgr2=0x7ffae806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee861700 1 --2- 172.21.15.78:0/1222850171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80c7cb0 0x7ffae806a870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009dc0 tx=0x7ffae000b330 comp rx=0 tx=0).stop 2023-06-09T11:13:23.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee861700 1 -- 172.21.15.78:0/1222850171 shutdown_connections 2023-06-09T11:13:23.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee861700 1 --2- 172.21.15.78:0/1222850171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80c7cb0 0x7ffae806a870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee861700 1 -- 172.21.15.78:0/1222850171 >> 172.21.15.78:0/1222850171 conn(0x7ffae80cf870 msgr2=0x7ffae80cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee861700 1 -- 172.21.15.78:0/1222850171 shutdown_connections 2023-06-09T11:13:23.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.199+0000 7ffaee861700 1 -- 172.21.15.78:0/1222850171 wait complete. 2023-06-09T11:13:23.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 Processor -- start 2023-06-09T11:13:23.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 -- start start 2023-06-09T11:13:23.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae806fc80 0x7ffae80d2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffae80c7cb0 0x7ffae80d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae815c880 0x7ffae80b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8146120 con 0x7ffae806fc80 2023-06-09T11:13:23.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81455a0 con 0x7ffae815c880 2023-06-09T11:13:23.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee861700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8145880 con 0x7ffae80c7cb0 2023-06-09T11:13:23.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae806fc80 0x7ffae80d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae806fc80 0x7ffae80d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58298/0 (socket says 172.21.15.78:58298) 2023-06-09T11:13:23.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 -- 172.21.15.78:0/1977992535 learned_addr learned my addr 172.21.15.78:0/1977992535 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:23.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed05e700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffae80c7cb0 0x7ffae80d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee060700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae815c880 0x7ffae80b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 -- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffae80c7cb0 msgr2=0x7ffae80d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffae80c7cb0 0x7ffae80d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 -- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae815c880 msgr2=0x7ffae80b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae815c880 0x7ffae80b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 -- 172.21.15.78:0/1977992535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0009a70 con 0x7ffae806fc80 2023-06-09T11:13:23.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaee060700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae815c880 0x7ffae80b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:23.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.203+0000 7ffaed85f700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae806fc80 0x7ffae80d2110 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c520 tx=0x7ffae400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.207+0000 7ffade7fc700 1 -- 172.21.15.78:0/1977992535 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40052d0 con 0x7ffae806fc80 2023-06-09T11:13:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.207+0000 7ffade7fc700 1 -- 172.21.15.78:0/1977992535 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4005450 con 0x7ffae806fc80 2023-06-09T11:13:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.207+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae806a350 con 0x7ffae806fc80 2023-06-09T11:13:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.207+0000 7ffade7fc700 1 -- 172.21.15.78:0/1977992535 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40038e0 con 0x7ffae806fc80 2023-06-09T11:13:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.207+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae806a070 con 0x7ffae806fc80 2023-06-09T11:13:23.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.207+0000 7ffade7fc700 1 -- 172.21.15.78:0/1977992535 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffae4003a40 con 0x7ffae806fc80 2023-06-09T11:13:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.211+0000 7ffade7fc700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffacc066320 0x7ffacc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.211+0000 7ffade7fc700 1 -- 172.21.15.78:0/1977992535 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffae40831a0 con 0x7ffae806fc80 2023-06-09T11:13:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.211+0000 7ffaed05e700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffacc066320 0x7ffacc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.211+0000 7ffaf2d4a740 1 Processor -- start 2023-06-09T11:13:23.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.211+0000 7ffaf2d4a740 1 -- start start 2023-06-09T11:13:23.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.211+0000 7ffaed05e700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffacc066320 0x7ffacc0687d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffad8001a40 tx=0x7ffad80019d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x23d34f0 0x24bb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202ae0 0x24849c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x238fb30 con 0x2202eb0 2023-06-09T11:13:23.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x23e2710 con 0x2202ae0 2023-06-09T11:13:23.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x23db970 con 0x23d34f0 2023-06-09T11:13:23.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58306/0 (socket says 172.21.15.78:58306) 2023-06-09T11:13:23.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 -- 172.21.15.78:0/64779402 learned_addr learned my addr 172.21.15.78:0/64779402 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:23.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed85f700 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x23d34f0 0x24bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaee060700 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202ae0 0x24849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 -- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x23d34f0 msgr2=0x24bb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x23d34f0 0x24bb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 -- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202ae0 msgr2=0x24849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202ae0 0x24849c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 -- 172.21.15.78:0/64779402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23a1a10 con 0x2202eb0 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed85f700 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x23d34f0 0x24bb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaee060700 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202ae0 0x24849c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaed05e700 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bb8d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffad8001380 tx=0x7ffad8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bf419f5be29ec server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffacb7fe700 1 -- 172.21.15.78:0/64779402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8013600 con 0x2202eb0 2023-06-09T11:13:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffacb7fe700 1 -- 172.21.15.78:0/64779402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad8013760 con 0x2202eb0 2023-06-09T11:13:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffacb7fe700 1 -- 172.21.15.78:0/64779402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8013af0 con 0x2202eb0 2023-06-09T11:13:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/64779402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 msgr2=0x24bb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bb8d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffad8001380 tx=0x7ffad8012000 comp rx=0 tx=0).stop 2023-06-09T11:13:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/64779402 shutdown_connections 2023-06-09T11:13:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202ae0 0x24849c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bb8d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/64779402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x23d34f0 0x24bb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.215+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/64779402 >> 172.21.15.78:0/64779402 conn(0x246c310 msgr2=0x249d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/64779402 shutdown_connections 2023-06-09T11:13:23.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/64779402 wait complete. 2023-06-09T11:13:23.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 -- start start 2023-06-09T11:13:23.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 Processor -- start 2023-06-09T11:13:23.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202ae0 0x249af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202eb0 0x24754f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x2473530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x2379b00 con 0x2202ae0 2023-06-09T11:13:23.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x239ed60 con 0x23d34f0 2023-06-09T11:13:23.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x2287b20 con 0x2202eb0 2023-06-09T11:13:23.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaf2d4a740 10 client.0 _ll_register_callbacks cb 0x23d5210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T11:13:23.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaed85f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202ae0 0x249af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaed85f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202ae0 0x249af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58314/0 (socket says 172.21.15.78:58314) 2023-06-09T11:13:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaed85f700 1 -- 172.21.15.78:0/2403815205 learned_addr learned my addr 172.21.15.78:0/2403815205 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.219+0000 7ffaed05e700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202eb0 0x24754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaee060700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x2473530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed85f700 1 -- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202eb0 msgr2=0x24754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed85f700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202eb0 0x24754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed85f700 1 -- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 msgr2=0x2473530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed85f700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x2473530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed85f700 1 -- 172.21.15.78:0/2403815205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad800f6c0 con 0x2202ae0 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed05e700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202eb0 0x24754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaee060700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x2473530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed85f700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202ae0 0x249af20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffae4050740 tx=0x7ffae40582b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2648852a2d1ba6b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffac8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffac8ff9700 1 -- 172.21.15.78:0/2403815205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae405c300 con 0x2202ae0 2023-06-09T11:13:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffac8ff9700 1 -- 172.21.15.78:0/2403815205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffae4067e40 con 0x2202ae0 2023-06-09T11:13:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23d4950 con 0x2202ae0 2023-06-09T11:13:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffac8ff9700 1 -- 172.21.15.78:0/2403815205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffae40811a0 con 0x2202ae0 2023-06-09T11:13:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 10 client.5313 fetch_fsmap learned FSMap version 16 2023-06-09T11:13:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x224e9e0 con 0x2202ae0 2023-06-09T11:13:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffac8ff9700 1 -- 172.21.15.78:0/2403815205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23d4950 con 0x2202ae0 2023-06-09T11:13:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffac8ff9700 1 -- 172.21.15.78:0/2403815205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffae4050030 con 0x2202ae0 2023-06-09T11:13:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 10 client.5313 fetch_fsmap finished waiting for FSMap version 16 2023-06-09T11:13:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 10 client.5313 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T11:13:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 20 client.5313 populate_metadata read hostname 'smithi078' 2023-06-09T11:13:23.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x2202710 0x2471e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 4 client.5313 mds_command: new command op to 5137 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T11:13:23.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 --> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2396830 con 0x2202710 2023-06-09T11:13:23.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed05e700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x2202710 0x2471e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffac8ff9700 10 client.5313 ms_handle_connect on v2:172.21.15.187:6834/1349991607 2023-06-09T11:13:23.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.223+0000 7ffaed05e700 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x2202710 0x2471e00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f13ae2c0e0a6de server_cookie=ecd488e837821020 in_seq=0 out_seq=0 2023-06-09T11:13:23.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffac8ff9700 1 -- 172.21.15.78:0/2403815205 <== mds.0 v2:172.21.15.187:6834/1349991607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x2396830 con 0x2202710 2023-06-09T11:13:23.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffac8ff9700 10 client.5313 handle_command_reply: tid=0 2023-06-09T11:13:23.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 client.5313 shutdown 2023-06-09T11:13:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202ae0 msgr2=0x249af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202ae0 0x249af20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffae4050740 tx=0x7ffae40582b0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 shutdown_connections 2023-06-09T11:13:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x2202710 0x2471e00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x2473530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202eb0 0x24754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/2403815205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202ae0 0x249af20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffac8ff9700 0 client.5313 ms_handle_reset on v2:172.21.15.187:6834/1349991607 2023-06-09T11:13:23.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 >> 172.21.15.78:0/2403815205 conn(0x246c310 msgr2=0x2475eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 shutdown_connections 2023-06-09T11:13:23.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/2403815205 wait complete. 2023-06-09T11:13:23.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.227+0000 7ffaf2d4a740 20 client.5313 trim_cache size 0 max 16384 2023-06-09T11:13:23.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 Processor -- start 2023-06-09T11:13:23.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 -- start start 2023-06-09T11:13:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x246fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202eb0 0x2470180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x23d34f0 0x24706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x237c850 con 0x23d34f0 2023-06-09T11:13:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x239c9b0 con 0x2202eb0 2023-06-09T11:13:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x23e39a0 con 0x2202ae0 2023-06-09T11:13:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x23d34f0 0x24706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x23d34f0 0x24706c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58320/0 (socket says 172.21.15.78:58320) 2023-06-09T11:13:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 -- 172.21.15.78:0/618145789 learned_addr learned my addr 172.21.15.78:0/618145789 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaed85f700 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x246fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaed05e700 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202eb0 0x2470180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 -- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 msgr2=0x246fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x246fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 -- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202eb0 msgr2=0x2470180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202eb0 0x2470180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 -- 172.21.15.78:0/618145789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae81f1d40 con 0x23d34f0 2023-06-09T11:13:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaed05e700 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202eb0 0x2470180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffaee060700 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x23d34f0 0x24706c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffae80b5b00 tx=0x7ffae000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3c8ffc9331bb0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.251+0000 7ffacbfff700 1 -- 172.21.15.78:0/618145789 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000ba20 con 0x23d34f0 2023-06-09T11:13:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffacbfff700 1 -- 172.21.15.78:0/618145789 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0023070 con 0x23d34f0 2023-06-09T11:13:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffacbfff700 1 -- 172.21.15.78:0/618145789 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000bd80 con 0x23d34f0 2023-06-09T11:13:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/618145789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x23d34f0 msgr2=0x24706c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x23d34f0 0x24706c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffae80b5b00 tx=0x7ffae000f000 comp rx=0 tx=0).stop 2023-06-09T11:13:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/618145789 shutdown_connections 2023-06-09T11:13:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x23d34f0 0x24706c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x2202eb0 0x2470180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/618145789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x246fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/618145789 >> 172.21.15.78:0/618145789 conn(0x246c310 msgr2=0x249d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/618145789 shutdown_connections 2023-06-09T11:13:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/618145789 wait complete. 2023-06-09T11:13:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- start start 2023-06-09T11:13:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 Processor -- start 2023-06-09T11:13:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x24bea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x24bc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x23b15f0 con 0x2202eb0 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x23df970 con 0x23d34f0 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x23abc30 con 0x2202ae0 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.255+0000 7ffaf2d4a740 10 client.0 _ll_register_callbacks cb 0x7ffad800f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed85f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x24bea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed85f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x24bea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:49110/0 (socket says 172.21.15.78:49110) 2023-06-09T11:13:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed85f700 1 -- 172.21.15.78:0/1705170870 learned_addr learned my addr 172.21.15.78:0/1705170870 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58324/0 (socket says 172.21.15.78:58324) 2023-06-09T11:13:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaee060700 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x24bc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 -- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 msgr2=0x24bea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x24bea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 -- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 msgr2=0x24bc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x24bc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 -- 172.21.15.78:0/1705170870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae80c84c0 con 0x2202eb0 2023-06-09T11:13:23.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaee060700 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x24bc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:13:23.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed05e700 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bef40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffad8022000 tx=0x7ffad8001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24a2133586d6566 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffac8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-09T11:13:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffac8ff9700 1 -- 172.21.15.78:0/1705170870 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8031b60 con 0x2202eb0 2023-06-09T11:13:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffac8ff9700 1 -- 172.21.15.78:0/1705170870 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffad801b050 con 0x2202eb0 2023-06-09T11:13:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffad8013760 con 0x2202eb0 2023-06-09T11:13:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffac8ff9700 1 -- 172.21.15.78:0/1705170870 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffad8031cc0 con 0x2202eb0 2023-06-09T11:13:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 10 client.5319 fetch_fsmap learned FSMap version 16 2023-06-09T11:13:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x2387e40 con 0x2202eb0 2023-06-09T11:13:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffac8ff9700 1 -- 172.21.15.78:0/1705170870 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad8013760 con 0x2202eb0 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffac8ff9700 1 -- 172.21.15.78:0/1705170870 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ffad80310b0 con 0x2202eb0 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 10 client.5319 fetch_fsmap finished waiting for FSMap version 16 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 10 client.5319 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 20 client.5319 populate_metadata read hostname 'smithi078' 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x224d790 0x24bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 4 client.5319 mds_command: new command op to 5137 tid=0[{"prefix": "status"}] 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 --> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] -- command(tid 0: {"prefix": "status"}) v1 -- 0x225a4e0 con 0x224d790 2023-06-09T11:13:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.259+0000 7ffaed85f700 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x224d790 0x24bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffac8ff9700 10 client.5319 ms_handle_connect on v2:172.21.15.187:6834/1349991607 2023-06-09T11:13:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaed85f700 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x224d790 0x24bcce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b416ddd8c224f1a5 server_cookie=30e161ae76233d61 in_seq=0 out_seq=0 2023-06-09T11:13:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffac8ff9700 1 -- 172.21.15.78:0/1705170870 <== mds.0 v2:172.21.15.187:6834/1349991607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x225a4e0 con 0x224d790 2023-06-09T11:13:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffac8ff9700 10 client.5319 handle_command_reply: tid=0 2023-06-09T11:13:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 client.5319 shutdown 2023-06-09T11:13:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 msgr2=0x24bef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bef40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffad8022000 tx=0x7ffad8001770 comp rx=0 tx=0).stop 2023-06-09T11:13:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 shutdown_connections 2023-06-09T11:13:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:6834/1349991607,v1:172.21.15.187:6835/1349991607] conn(0x224d790 0x24bcce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x23d34f0 0x24bc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x2202eb0 0x24bef40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 --2- 172.21.15.78:0/1705170870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x2202ae0 0x24bea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffac8ff9700 0 client.5319 ms_handle_reset on v2:172.21.15.187:6834/1349991607 2023-06-09T11:13:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 >> 172.21.15.78:0/1705170870 conn(0x246c310 msgr2=0x2499e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 shutdown_connections 2023-06-09T11:13:23.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 1 -- 172.21.15.78:0/1705170870 wait complete. 2023-06-09T11:13:23.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaf2d4a740 20 client.5319 trim_cache size 0 max 16384 2023-06-09T11:13:23.276 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T11:13:23.276 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "a733ef11-cd5d-4be5-8773-23eabcf05e48", 2023-06-09T11:13:23.276 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-06-09T11:13:23.276 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5137, 2023-06-09T11:13:23.277 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-06-09T11:13:23.277 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-06-09T11:13:23.277 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-06-09T11:13:23.277 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 11.165006063, 2023-06-09T11:13:23.277 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 16, 2023-06-09T11:13:23.277 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 37, 2023-06-09T11:13:23.277 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 37, 2023-06-09T11:13:23.278 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 19.472340686999999 2023-06-09T11:13:23.278 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T11:13:23.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffacc066320 msgr2=0x7ffacc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffacc066320 0x7ffacc0687d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffad8001a40 tx=0x7ffad80019d0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae806fc80 msgr2=0x7ffae80d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae806fc80 0x7ffae80d2110 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c520 tx=0x7ffae400c830 comp rx=0 tx=0).stop 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 shutdown_connections 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffacc066320 0x7ffacc0687d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae815c880 0x7ffae80b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffae80c7cb0 0x7ffae80d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 --2- 172.21.15.78:0/1977992535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffae806fc80 0x7ffae80d2110 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 >> 172.21.15.78:0/1977992535 conn(0x7ffae80cf870 msgr2=0x7ffae815bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 shutdown_connections 2023-06-09T11:13:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.263+0000 7ffaee861700 1 -- 172.21.15.78:0/1977992535 wait complete. 2023-06-09T11:13:23.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T11:13:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.463+0000 7f6a8e8e4700 1 Processor -- start 2023-06-09T11:13:23.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.463+0000 7f6a8e8e4700 1 -- start start 2023-06-09T11:13:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e8e4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6a8815c780 0x7f6a880c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e8e4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8806dca0 0x7f6a88070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e8e4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8806e160 con 0x7f6a8815c3b0 2023-06-09T11:13:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e8e4700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a880cc980 con 0x7f6a8815c780 2023-06-09T11:13:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e8e4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880ccc20 con 0x7f6a8806dca0 2023-06-09T11:13:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8d8e2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6a8815c3b0 0x7f6a8806d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50644/0 (socket says 172.21.15.78:50644) 2023-06-09T11:13:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8d8e2700 1 -- 172.21.15.78:0/276520291 learned_addr learned my addr 172.21.15.78:0/276520291 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T11:13:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e0e3700 1 --2- 172.21.15.78:0/276520291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8806dca0 0x7f6a88070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8d0e1700 1 --2- 172.21.15.78:0/276520291 >> v2:172.21.15.187:3300/0 conn(0x7f6a8815c780 0x7f6a880c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8c8e0700 1 -- 172.21.15.78:0/276520291 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309267039 0 0) 0x7f6a8806e160 con 0x7f6a8815c3b0 2023-06-09T11:13:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8c8e0700 1 -- 172.21.15.78:0/276520291 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a740035d0 con 0x7f6a8815c3b0 2023-06-09T11:13:23.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e0e3700 1 -- 172.21.15.78:0/276520291 >> v2:172.21.15.187:3300/0 conn(0x7f6a8815c780 msgr2=0x7f6a880c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:23.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e0e3700 1 --2- 172.21.15.78:0/276520291 >> v2:172.21.15.187:3300/0 conn(0x7f6a8815c780 0x7f6a880c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e0e3700 1 -- 172.21.15.78:0/276520291 >> v1:172.21.15.78:6789/0 conn(0x7f6a8815c3b0 legacy=0x7f6a8806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e0e3700 1 -- 172.21.15.78:0/276520291 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8806e400 con 0x7f6a8806dca0 2023-06-09T11:13:23.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8e0e3700 1 --2- 172.21.15.78:0/276520291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8806dca0 0x7f6a88070530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009d90 tx=0x7f6a8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b1c67c1df4ea18a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.467+0000 7f6a8c8e0700 1 -- 172.21.15.78:0/276520291 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000e070 con 0x7f6a8806dca0 2023-06-09T11:13:23.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8c8e0700 1 -- 172.21.15.78:0/276520291 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000bb20 con 0x7f6a8806dca0 2023-06-09T11:13:23.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8c8e0700 1 -- 172.21.15.78:0/276520291 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80012430 con 0x7f6a8806dca0 2023-06-09T11:13:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/276520291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8806dca0 msgr2=0x7f6a88070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/276520291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8806dca0 0x7f6a88070530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009d90 tx=0x7f6a8000b330 comp rx=0 tx=0).stop 2023-06-09T11:13:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/276520291 shutdown_connections 2023-06-09T11:13:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/276520291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8806dca0 0x7f6a88070530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/276520291 >> v2:172.21.15.187:3300/0 conn(0x7f6a8815c780 0x7f6a880c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/276520291 >> 172.21.15.78:0/276520291 conn(0x7f6a880cf670 msgr2=0x7f6a880cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/276520291 shutdown_connections 2023-06-09T11:13:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.471+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/276520291 wait complete. 2023-06-09T11:13:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 Processor -- start 2023-06-09T11:13:23.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 -- start start 2023-06-09T11:13:23.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8806dca0 0x7f6a88159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a8815c3b0 0x7f6a880c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a880c84a0 0x7f6a880b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881f5e60 con 0x7f6a8815c3b0 2023-06-09T11:13:23.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881f5500 con 0x7f6a8806dca0 2023-06-09T11:13:23.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e8e4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881f6280 con 0x7f6a880c84a0 2023-06-09T11:13:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a8815c3b0 0x7f6a880c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a8815c3b0 0x7f6a880c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58334/0 (socket says 172.21.15.78:58334) 2023-06-09T11:13:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 -- 172.21.15.78:0/1566748204 learned_addr learned my addr 172.21.15.78:0/1566748204 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d8e2700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8806dca0 0x7f6a88159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8e0e3700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a880c84a0 0x7f6a880b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 -- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a880c84a0 msgr2=0x7f6a880b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a880c84a0 0x7f6a880b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 -- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8806dca0 msgr2=0x7f6a88159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8806dca0 0x7f6a88159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.475+0000 7f6a8d0e1700 1 -- 172.21.15.78:0/1566748204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009a70 con 0x7f6a8815c3b0 2023-06-09T11:13:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.479+0000 7f6a8d0e1700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a8815c3b0 0x7f6a880c7f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800e9d0 tx=0x7f6a7800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.479+0000 7f6a7e7fc700 1 -- 172.21.15.78:0/1566748204 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78009720 con 0x7f6a8815c3b0 2023-06-09T11:13:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.479+0000 7f6a7e7fc700 1 -- 172.21.15.78:0/1566748204 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7800ee70 con 0x7f6a8815c3b0 2023-06-09T11:13:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.479+0000 7f6a7e7fc700 1 -- 172.21.15.78:0/1566748204 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7800ca50 con 0x7f6a8815c3b0 2023-06-09T11:13:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.479+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a880ccf00 con 0x7f6a8815c3b0 2023-06-09T11:13:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.479+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a880ce680 con 0x7f6a8815c3b0 2023-06-09T11:13:23.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.479+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a880cd090 con 0x7f6a8815c3b0 2023-06-09T11:13:23.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.483+0000 7f6a7e7fc700 1 -- 172.21.15.78:0/1566748204 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a7800cbb0 con 0x7f6a8815c3b0 2023-06-09T11:13:23.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.483+0000 7f6a7e7fc700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6a6c0662f0 0x7f6a6c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:23.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.483+0000 7f6a7e7fc700 1 -- 172.21.15.78:0/1566748204 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a78083d40 con 0x7f6a8815c3b0 2023-06-09T11:13:23.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.483+0000 7f6a8d8e2700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6a6c0662f0 0x7f6a6c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:23.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.487+0000 7f6a8d8e2700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6a6c0662f0 0x7f6a6c0687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a84007fd0 tx=0x7f6a84007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:23.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.491+0000 7f6a7e7fc700 1 -- 172.21.15.78:0/1566748204 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6a78054c40 con 0x7f6a8815c3b0 2023-06-09T11:13:23.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.691+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a880c88a0 con 0x7f6a8815c3b0 2023-06-09T11:13:23.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.695+0000 7f6a7e7fc700 1 -- 172.21.15.78:0/1566748204 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a78017070 con 0x7f6a8815c3b0 2023-06-09T11:13:23.704 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T11:13:23.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6a6c0662f0 msgr2=0x7f6a6c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6a6c0662f0 0x7f6a6c0687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a84007fd0 tx=0x7f6a84007de0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a8815c3b0 msgr2=0x7f6a880c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:23.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a8815c3b0 0x7f6a880c7f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800e9d0 tx=0x7f6a7800ece0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 shutdown_connections 2023-06-09T11:13:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f6a6c0662f0 0x7f6a6c0687a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a880c84a0 0x7f6a880b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a8815c3b0 0x7f6a880c7f60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 --2- 172.21.15.78:0/1566748204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8806dca0 0x7f6a88159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 >> 172.21.15.78:0/1566748204 conn(0x7f6a880cf670 msgr2=0x7f6a880b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 shutdown_connections 2023-06-09T11:13:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:23.699+0000 7f6a8e8e4700 1 -- 172.21.15.78:0/1566748204 wait complete. 2023-06-09T11:13:23.730 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-09T11:13:23.731 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T11:13:23.731 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-06-09T11:13:23.731 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T11:13:23.732 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T11:13:23.732 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-09T11:13:23.732 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-09T11:13:23.732 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T11:13:23.733 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T11:13:23.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:23.733 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-06-09T11:13:23.749 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T11:13:23.750 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T11:13:23.750 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T11:13:23.750 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.750 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-06-09T11:13:23.750 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.750 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:13:23.750 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:13:23.751 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-06-09T11:13:23.751 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:13:23.751 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:13:23.751 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-06-09T11:13:23.751 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T11:13:23.752 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-06-09T11:13:23.752 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T11:13:23.753 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-06-09T11:13:23.753 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T11:13:23.753 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-06-09T11:13:23.753 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-06-09T11:13:23.754 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.754 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T11:13:23.754 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:88:f1:7a:29 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:13:23.755 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T11:13:23.755 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.755 INFO:teuthology.orchestra.run.smithi078.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T11:13:23.756 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 2e:9b:44:13:81:46 brd ff:ff:ff:ff:ff:ff 2023-06-09T11:13:23.756 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T11:13:23.756 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.757 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::1cbe:4ff:fe40:4dc5/64 scope link 2023-06-09T11:13:23.757 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.757 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T11:13:23.757 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 2e:9b:44:13:81:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T11:13:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::2c9b:44ff:fe13:8146/64 scope link 2023-06-09T11:13:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.758 INFO:teuthology.orchestra.run.smithi078.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T11:13:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether b2:b9:e3:da:d6:50 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T11:13:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::b0b9:e3ff:feda:d650/64 scope link 2023-06-09T11:13:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-06-09T11:13:23.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:23.761 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T11:13:23.840 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-06-09T11:13:23.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:23.843 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-06-09T11:13:23.906 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-06-09T11:13:23.906 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T11:13:23.906 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T11:13:23.907 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T11:13:23.907 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T11:13:23.907 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T11:13:23.907 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T11:13:23.907 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T11:13:23.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:23.908 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-06-09T11:13:23.908 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-06-09T11:13:23.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T11:13:23.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T11:13:23.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T11:13:23.909 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-06-09T11:13:24.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:24.045 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-06-09T11:13:24.063 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-09T11:13:24.064 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T11:13:24.065 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T11:13:24.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:24.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-06-09T11:13:24.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:13:24.145 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T11:13:24.204 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T11:13:24.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T11:13:24.205 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T11:13:24.263 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-09T11:13:24.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:24.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:13:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:13:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:13:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-09T11:13:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-09T11:13:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-06-09T11:13:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with new device syntax: 0@a733ef11-cd5d-4be5-8773-23eabcf05e48.cephfs=/ 2023-06-09T11:13:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.78:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-06-09T11:13:24.438 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T11:13:24.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:24.440 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T11:13:24.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:24.472 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T11:13:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:client5329 2023-06-09T11:13:24.555 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:13:24.556 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:13:24.615 DEBUG:teuthology.orchestra.run.smithi078:> mktemp -d --suffix=xfstests-dev 2023-06-09T11:13:24.676 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.bWnQzKjaCzxfstests-dev 2023-06-09T11:13:24.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:24.677 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.bWnQzKjaCzxfstests-dev) 2023-06-09T11:13:24.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:24.766 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.bWnQzKjaCzxfstests-dev) 2023-06-09T11:13:24.846 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/tmp/tmp.bWnQzKjaCzxfstests-dev'... 2023-06-09T11:13:25.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:25.751 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-09T11:13:25.820 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:25.830 DEBUG:teuthology.orchestra.run.smithi078:> mktemp -d --suffix=test 2023-06-09T11:13:25.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:25.899 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.efS4nxN3aQtest 2023-06-09T11:13:25.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:13:25.901 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-09T11:13:25.964 DEBUG:teuthology.orchestra.run.smithi078:> mktemp -d --suffix=scratch 2023-06-09T11:13:26.022 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:13:26.022 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-06-09T11:13:26.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-06-09T11:13:26.187 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-09T11:13:26.389 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-06-09T11:13:26.390 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-06-09T11:13:26.573 INFO:teuthology.orchestra.run.smithi078.stdout:attr is already the newest version (1:2.4.48-5). 2023-06-09T11:13:26.574 INFO:teuthology.orchestra.run.smithi078.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-06-09T11:13:26.574 INFO:teuthology.orchestra.run.smithi078.stdout:gawk is already the newest version (1:5.0.1+dfsg-1). 2023-06-09T11:13:26.574 INFO:teuthology.orchestra.run.smithi078.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-06-09T11:13:26.574 INFO:teuthology.orchestra.run.smithi078.stdout:gcc set to manually installed. 2023-06-09T11:13:26.574 INFO:teuthology.orchestra.run.smithi078.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-06-09T11:13:26.574 INFO:teuthology.orchestra.run.smithi078.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-06-09T11:13:26.574 INFO:teuthology.orchestra.run.smithi078.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:make is already the newest version (4.2.1-1.2). 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:make set to manually installed. 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:quota is already the newest version (4.05-1). 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:dbench is already the newest version (4.0-2build1). 2023-06-09T11:13:26.575 INFO:teuthology.orchestra.run.smithi078.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-06-09T11:13:26.576 INFO:teuthology.orchestra.run.smithi078.stdout:python2 set to manually installed. 2023-06-09T11:13:26.576 INFO:teuthology.orchestra.run.smithi078.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-06-09T11:13:26.576 INFO:teuthology.orchestra.run.smithi078.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T11:13:26.576 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T11:13:26.576 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-runtime is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T11:13:26.576 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T11:13:26.577 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T11:13:26.577 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T11:13:26.577 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-06-09T11:13:26.577 INFO:teuthology.orchestra.run.smithi078.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-06-09T11:13:26.578 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-06-09T11:13:26.578 INFO:teuthology.orchestra.run.smithi078.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-06-09T11:13:26.642 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-06-09T11:13:26.643 INFO:teuthology.orchestra.run.smithi078.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-06-09T11:13:26.645 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-06-09T11:13:26.645 INFO:teuthology.orchestra.run.smithi078.stdout: libsqlite3-0 2023-06-09T11:13:26.730 INFO:teuthology.orchestra.run.smithi078.stdout:1 upgraded, 7 newly installed, 0 to remove and 184 not upgraded. 2023-06-09T11:13:26.730 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 2,428 kB of archives. 2023-06-09T11:13:26.730 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 7,043 kB of additional disk space will be used. 2023-06-09T11:13:26.731 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-06-09T11:13:26.845 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-06-09T11:13:26.852 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-06-09T11:13:26.853 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-06-09T11:13:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-06-09T11:13:26.855 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-06-09T11:13:26.870 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-06-09T11:13:26.872 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-06-09T11:13:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: unable to initialize frontend: Dialog 2023-06-09T11:13:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-06-09T11:13:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: falling back to frontend: Readline 2023-06-09T11:13:27.233 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: unable to initialize frontend: Readline 2023-06-09T11:13:27.233 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: (This frontend requires a controlling tty.) 2023-06-09T11:13:27.233 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: falling back to frontend: Teletype 2023-06-09T11:13:27.250 INFO:teuthology.orchestra.run.smithi078.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-06-09T11:13:27.335 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 2,428 kB in 0s (10.5 MB/s) 2023-06-09T11:13:27.594 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 121308 files and directories currently installed.) 2023-06-09T11:13:27.597 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-06-09T11:13:27.778 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-06-09T11:13:28.233 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-06-09T11:13:28.253 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-libglusterfs0_7.2-2build1_amd64.deb ... 2023-06-09T11:13:28.291 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-06-09T11:13:28.661 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-06-09T11:13:28.681 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-libgfxdr0_7.2-2build1_amd64.deb ... 2023-06-09T11:13:28.719 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-06-09T11:13:29.048 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-06-09T11:13:29.068 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-libgfrpc0_7.2-2build1_amd64.deb ... 2023-06-09T11:13:29.105 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-06-09T11:13:29.450 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-06-09T11:13:29.470 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-libgfapi0_7.2-2build1_amd64.deb ... 2023-06-09T11:13:29.508 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-06-09T11:13:29.869 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package fio. 2023-06-09T11:13:29.884 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-fio_3.16-1_amd64.deb ... 2023-06-09T11:13:29.927 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking fio (3.16-1) ... 2023-06-09T11:13:30.374 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-06-09T11:13:30.395 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-06-09T11:13:30.432 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-06-09T11:13:30.770 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package sqlite3. 2023-06-09T11:13:30.790 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-06-09T11:13:30.827 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-06-09T11:13:31.230 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-06-09T11:13:31.357 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-06-09T11:13:31.483 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-06-09T11:13:31.609 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-06-09T11:13:31.735 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-06-09T11:13:31.853 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-06-09T11:13:31.979 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-06-09T11:13:32.105 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up fio (3.16-1) ... 2023-06-09T11:13:32.391 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T11:13:32.543 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T11:13:33.027 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T11:13:36.029 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T11:13:36.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo useradd -m fsgqa 2023-06-09T11:13:36.972 INFO:teuthology.orchestra.run.smithi078.stderr:useradd: user 'fsgqa' already exists 2023-06-09T11:13:36.975 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T11:13:36.976 DEBUG:teuthology.orchestra.run.smithi078:> sudo groupadd fsgqa 2023-06-09T11:13:37.050 INFO:teuthology.orchestra.run.smithi078.stderr:groupadd: group 'fsgqa' already exists 2023-06-09T11:13:37.052 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T11:13:37.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo useradd fsgqa2 2023-06-09T11:13:37.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo useradd 123456-fsgqa 2023-06-09T11:13:37.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-09T11:13:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 Processor -- start 2023-06-09T11:13:38.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 -- start start 2023-06-09T11:13:38.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff934158b60 0x7ff9340ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 0x7ff93406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff93406aca0 0x7ff9340c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff934158f30 con 0x7ff93406aca0 2023-06-09T11:13:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93406b120 con 0x7ff934158b60 2023-06-09T11:13:38.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939d51700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340cd830 con 0x7ff934070290 2023-06-09T11:13:38.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.114+0000 7ff939550700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff93406aca0 0x7ff9340c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff93406aca0 0x7ff9340c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46316/0 (socket says 172.21.15.78:46316) 2023-06-09T11:13:38.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 -- 172.21.15.78:0/840341182 learned_addr learned my addr 172.21.15.78:0/840341182 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:38.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff938d4f700 1 --2- 172.21.15.78:0/840341182 >> v2:172.21.15.187:3300/0 conn(0x7ff934158b60 0x7ff9340ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff933fff700 1 --2- 172.21.15.78:0/840341182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 0x7ff93406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 -- 172.21.15.78:0/840341182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 msgr2=0x7ff93406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:38.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 --2- 172.21.15.78:0/840341182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 0x7ff93406a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 -- 172.21.15.78:0/840341182 >> v2:172.21.15.187:3300/0 conn(0x7ff934158b60 msgr2=0x7ff9340ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:38.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 --2- 172.21.15.78:0/840341182 >> v2:172.21.15.187:3300/0 conn(0x7ff934158b60 0x7ff9340ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 -- 172.21.15.78:0/840341182 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340cd270 con 0x7ff93406aca0 2023-06-09T11:13:38.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff938d4f700 1 --2- 172.21.15.78:0/840341182 >> v2:172.21.15.187:3300/0 conn(0x7ff934158b60 0x7ff9340ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T11:13:38.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939550700 1 --2- 172.21.15.78:0/840341182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff93406aca0 0x7ff9340c4700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cc210 tx=0x7ff92c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24c8d4f367309ea server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:38.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff9337fe700 1 -- 172.21.15.78:0/840341182 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00e070 con 0x7ff93406aca0 2023-06-09T11:13:38.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff9337fe700 1 -- 172.21.15.78:0/840341182 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c00b910 con 0x7ff93406aca0 2023-06-09T11:13:38.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff9337fe700 1 -- 172.21.15.78:0/840341182 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00bcc0 con 0x7ff93406aca0 2023-06-09T11:13:38.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 -- 172.21.15.78:0/840341182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff93406aca0 msgr2=0x7ff9340c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 --2- 172.21.15.78:0/840341182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff93406aca0 0x7ff9340c4700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cc210 tx=0x7ff92c00b330 comp rx=0 tx=0).stop 2023-06-09T11:13:38.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 -- 172.21.15.78:0/840341182 shutdown_connections 2023-06-09T11:13:38.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 --2- 172.21.15.78:0/840341182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff93406aca0 0x7ff9340c4700 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 --2- 172.21.15.78:0/840341182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 0x7ff93406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 --2- 172.21.15.78:0/840341182 >> v2:172.21.15.187:3300/0 conn(0x7ff934158b60 0x7ff9340ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 -- 172.21.15.78:0/840341182 >> 172.21.15.78:0/840341182 conn(0x7ff9340cf670 msgr2=0x7ff9340cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:38.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 -- 172.21.15.78:0/840341182 shutdown_connections 2023-06-09T11:13:38.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.118+0000 7ff939d51700 1 -- 172.21.15.78:0/840341182 wait complete. 2023-06-09T11:13:38.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 Processor -- start 2023-06-09T11:13:38.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 -- start start 2023-06-09T11:13:38.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93406aca0 0x7ff9340c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 0x7ff9340af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff934158b60 0x7ff934147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340c7450 con 0x7ff934158b60 2023-06-09T11:13:38.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340c6b20 con 0x7ff93406aca0 2023-06-09T11:13:38.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939d51700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340c6e00 con 0x7ff934070290 2023-06-09T11:13:38.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939550700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff934158b60 0x7ff934147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939550700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff934158b60 0x7ff934147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46320/0 (socket says 172.21.15.78:46320) 2023-06-09T11:13:38.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.122+0000 7ff939550700 1 -- 172.21.15.78:0/3867271127 learned_addr learned my addr 172.21.15.78:0/3867271127 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:38.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939550700 1 -- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 msgr2=0x7ff9340af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939550700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 0x7ff9340af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939550700 1 -- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93406aca0 msgr2=0x7ff9340c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939550700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93406aca0 0x7ff9340c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939550700 1 -- 172.21.15.78:0/3867271127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280094b0 con 0x7ff934158b60 2023-06-09T11:13:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939550700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff934158b60 0x7ff934147420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cc470 tx=0x7ff92c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff9317fa700 1 -- 172.21.15.78:0/3867271127 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0099b0 con 0x7ff934158b60 2023-06-09T11:13:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff9317fa700 1 -- 172.21.15.78:0/3867271127 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c0092e0 con 0x7ff934158b60 2023-06-09T11:13:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c009b30 con 0x7ff934158b60 2023-06-09T11:13:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff9317fa700 1 -- 172.21.15.78:0/3867271127 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c01b650 con 0x7ff934158b60 2023-06-09T11:13:38.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9340c3f00 con 0x7ff934158b60 2023-06-09T11:13:38.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9340cd550 con 0x7ff934158b60 2023-06-09T11:13:38.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.126+0000 7ff9317fa700 1 -- 172.21.15.78:0/3867271127 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff92c01b7b0 con 0x7ff934158b60 2023-06-09T11:13:38.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.130+0000 7ff9317fa700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9180662f0 0x7ff9180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.130+0000 7ff9317fa700 1 -- 172.21.15.78:0/3867271127 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff92c085320 con 0x7ff934158b60 2023-06-09T11:13:38.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.130+0000 7ff938d4f700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9180662f0 0x7ff9180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.130+0000 7ff938d4f700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9180662f0 0x7ff9180687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff928009ca0 tx=0x7ff928009740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:38.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.138+0000 7ff9317fa700 1 -- 172.21.15.78:0/3867271127 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff92c052710 con 0x7ff934158b60 2023-06-09T11:13:38.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.370+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff9340c41e0 con 0x7ff934158b60 2023-06-09T11:13:38.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff9317fa700 1 -- 172.21.15.78:0/3867271127 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7ff92c055d30 con 0x7ff934158b60 2023-06-09T11:13:38.382 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:13:38.383 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":1,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","modified":"2023-06-09T11:10:57.703672Z","created":"2023-06-09T11:10:57.703672Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3301","nonce":0},{"type":"v1","addr":"172.21.15.187:6790","nonce":0}]},"addr":"172.21.15.187:6790/0","public_addr":"172.21.15.187:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-09T11:13:38.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9180662f0 msgr2=0x7ff9180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9180662f0 0x7ff9180687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff928009ca0 tx=0x7ff928009740 comp rx=0 tx=0).stop 2023-06-09T11:13:38.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff934158b60 msgr2=0x7ff934147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff934158b60 0x7ff934147420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cc470 tx=0x7ff92c004af0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 shutdown_connections 2023-06-09T11:13:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff9180662f0 0x7ff9180687a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff934158b60 0x7ff934147420 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff934070290 0x7ff9340af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 --2- 172.21.15.78:0/3867271127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93406aca0 0x7ff9340c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 >> 172.21.15.78:0/3867271127 conn(0x7ff9340cf670 msgr2=0x7ff934151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:38.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 shutdown_connections 2023-06-09T11:13:38.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.374+0000 7ff939d51700 1 -- 172.21.15.78:0/3867271127 wait complete. 2023-06-09T11:13:38.387 INFO:teuthology.orchestra.run.smithi078.stderr:dumped monmap epoch 1 2023-06-09T11:13:38.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-09T11:13:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.574+0000 7f5fc144a700 1 Processor -- start 2023-06-09T11:13:38.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fc144a700 1 -- start start 2023-06-09T11:13:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fc144a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0b28e0 0x7f5fbc0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fc144a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fbc0ce9a0 0x7f5fbc070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fc144a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5fbc0cee70 0x7f5fbc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fc144a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fbc0d0c10 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fc144a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fbc0cd740 con 0x7f5fbc0cee70 2023-06-09T11:13:38.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fc144a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0cd1c0 con 0x7f5fbc0b28e0 2023-06-09T11:13:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fba7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fbc0ce9a0 0x7f5fbc070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fba7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fbc0ce9a0 0x7f5fbc070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46326/0 (socket says 172.21.15.78:46326) 2023-06-09T11:13:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fba7fc700 1 -- 172.21.15.78:0/876218789 learned_addr learned my addr 172.21.15.78:0/876218789 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.578+0000 7f5fbaffd700 1 --2- 172.21.15.78:0/876218789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0b28e0 0x7f5fbc0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fbb7fe700 1 --2- 172.21.15.78:0/876218789 >> v2:172.21.15.187:3300/0 conn(0x7f5fbc0cee70 0x7f5fbc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fba7fc700 1 -- 172.21.15.78:0/876218789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0b28e0 msgr2=0x7f5fbc0b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:38.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fba7fc700 1 --2- 172.21.15.78:0/876218789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0b28e0 0x7f5fbc0b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fba7fc700 1 -- 172.21.15.78:0/876218789 >> v2:172.21.15.187:3300/0 conn(0x7f5fbc0cee70 msgr2=0x7f5fbc0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:13:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fba7fc700 1 --2- 172.21.15.78:0/876218789 >> v2:172.21.15.187:3300/0 conn(0x7f5fbc0cee70 0x7f5fbc0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fba7fc700 1 -- 172.21.15.78:0/876218789 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0b31f0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fba7fc700 1 --2- 172.21.15.78:0/876218789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc070260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0d0880 tx=0x7f5fb0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb85bbd043d90ed server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fb9ffb700 1 -- 172.21.15.78:0/876218789 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000b8a0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fb9ffb700 1 -- 172.21.15.78:0/876218789 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb000ba00 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fb9ffb700 1 -- 172.21.15.78:0/876218789 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000bd90 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 -- 172.21.15.78:0/876218789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 msgr2=0x7f5fbc070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 --2- 172.21.15.78:0/876218789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc070260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc0d0880 tx=0x7f5fb0009bf0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 -- 172.21.15.78:0/876218789 shutdown_connections 2023-06-09T11:13:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 --2- 172.21.15.78:0/876218789 >> v2:172.21.15.187:3300/0 conn(0x7f5fbc0cee70 0x7f5fbc0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 --2- 172.21.15.78:0/876218789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc070260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 --2- 172.21.15.78:0/876218789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0b28e0 0x7f5fbc0b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 -- 172.21.15.78:0/876218789 >> 172.21.15.78:0/876218789 conn(0x7f5fbc0d0e60 msgr2=0x7f5fbc0d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 -- 172.21.15.78:0/876218789 shutdown_connections 2023-06-09T11:13:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.582+0000 7f5fc144a700 1 -- 172.21.15.78:0/876218789 wait complete. 2023-06-09T11:13:38.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 Processor -- start 2023-06-09T11:13:38.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 -- start start 2023-06-09T11:13:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc0b28e0 0x7f5fbc15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0cee70 0x7f5fbc0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc0c8250 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc152d60 con 0x7f5fbc0b28e0 2023-06-09T11:13:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc152430 con 0x7f5fbc0cee70 2023-06-09T11:13:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc1531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46330/0 (socket says 172.21.15.78:46330) 2023-06-09T11:13:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 -- 172.21.15.78:0/1856448500 learned_addr learned my addr 172.21.15.78:0/1856448500 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T11:13:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fbb7fe700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0cee70 0x7f5fbc0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 -- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0cee70 msgr2=0x7f5fbc0c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fbaffd700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc0b28e0 0x7f5fbc15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0cee70 0x7f5fbc0c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 -- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc0b28e0 msgr2=0x7f5fbc15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc0b28e0 0x7f5fbc15d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 -- 172.21.15.78:0/1856448500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0009570 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fbb7fe700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0cee70 0x7f5fbc0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fbaffd700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc0b28e0 0x7f5fbc15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:13:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fba7fc700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc1531f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000b0e0 tx=0x7f5fb0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fa37fe700 1 -- 172.21.15.78:0/1856448500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00036c0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fa37fe700 1 -- 172.21.15.78:0/1856448500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb001f070 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fa37fe700 1 -- 172.21.15.78:0/1856448500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0003a80 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.586+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc0cb5c0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.590+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc0cd460 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.590+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fbc0cb8a0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.590+0000 7f5fa37fe700 1 -- 172.21.15.78:0/1856448500 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fb0021030 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.594+0000 7f5fa37fe700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5fa80662f0 0x7f5fa80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:13:38.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.594+0000 7f5fa37fe700 1 -- 172.21.15.78:0/1856448500 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fb00853f0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.594+0000 7f5fbaffd700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5fa80662f0 0x7f5fa80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:13:38.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.594+0000 7f5fbaffd700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5fa80662f0 0x7f5fa80687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc06c0b0 tx=0x7f5fac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:13:38.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.598+0000 7f5fa37fe700 1 -- 172.21.15.78:0/1856448500 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5fb0052980 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.826+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f5fbc152ef0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.826+0000 7f5fa37fe700 1 -- 172.21.15.78:0/1856448500 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f5fb0055fa0 con 0x7f5fbc0ce9a0 2023-06-09T11:13:38.836 INFO:teuthology.orchestra.run.smithi078.stdout:[client.admin] 2023-06-09T11:13:38.836 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 2023-06-09T11:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5fa80662f0 msgr2=0x7f5fa80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5fa80662f0 0x7f5fa80687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc06c0b0 tx=0x7f5fac008040 comp rx=0 tx=0).stop 2023-06-09T11:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 msgr2=0x7f5fbc1531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc1531f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000b0e0 tx=0x7f5fb0004770 comp rx=0 tx=0).stop 2023-06-09T11:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 shutdown_connections 2023-06-09T11:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5fa80662f0 0x7f5fa80687a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fbc0cee70 0x7f5fbc0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fbc0ce9a0 0x7f5fbc1531f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 --2- 172.21.15.78:0/1856448500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc0b28e0 0x7f5fbc15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 >> 172.21.15.78:0/1856448500 conn(0x7f5fbc0d0e60 msgr2=0x7f5fbc0700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 shutdown_connections 2023-06-09T11:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T11:13:38.830+0000 7f5fc144a700 1 -- 172.21.15.78:0/1856448500 wait complete. 2023-06-09T11:13:38.860 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:13:38.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/tmp/tmp.bWnQzKjaCzxfstests-dev/local.config 2023-06-09T11:13:38.892 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.78:6789:/test export TEST_DIR=/tmp/tmp.efS4nxN3aQtest export SCRATCH_DEV=172.21.15.78:6789:/scratch export SCRATCH_MNT=/tmp/tmp.cKkqOgfa4gscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g==" 2023-06-09T11:13:38.893 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T11:13:38.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/tmp/tmp.bWnQzKjaCzxfstests-dev/ceph.exclude 2023-06-09T11:13:38.965 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo make) 2023-06-09T11:13:39.072 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize -cfi 2023-06-09T11:13:39.692 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-09T11:13:39.692 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './config.guess' 2023-06-09T11:13:39.717 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './config.sub' 2023-06-09T11:13:39.744 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './install-sh' 2023-06-09T11:13:39.771 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './ltmain.sh' 2023-06-09T11:13:39.888 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-09T11:13:39.888 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-09T11:13:39.918 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-09T11:13:39.944 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-09T11:13:39.970 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-09T11:13:39.997 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-09T11:13:40.018 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-09T11:13:40.022 INFO:teuthology.orchestra.run.smithi078.stdout:cp include/install-sh . 2023-06-09T11:13:40.027 INFO:teuthology.orchestra.run.smithi078.stdout:aclocal -I m4 2023-06-09T11:13:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:autoheader 2023-06-09T11:13:41.999 INFO:teuthology.orchestra.run.smithi078.stdout:autoconf 2023-06-09T11:13:42.319 INFO:teuthology.orchestra.run.smithi078.stdout:./configure \ 2023-06-09T11:13:42.320 INFO:teuthology.orchestra.run.smithi078.stdout: --libexecdir=/usr/lib \ 2023-06-09T11:13:42.320 INFO:teuthology.orchestra.run.smithi078.stdout: --exec_prefix=/var/lib 2023-06-09T11:13:43.413 INFO:teuthology.orchestra.run.smithi078.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-09T11:13:43.413 INFO:teuthology.orchestra.run.smithi078.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-09T11:13:43.479 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to print strings... printf 2023-06-09T11:13:43.481 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc... gcc 2023-06-09T11:13:43.827 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether the C compiler works... yes 2023-06-09T11:13:43.828 INFO:teuthology.orchestra.run.smithi078.stdout:checking for C compiler default output file name... a.out 2023-06-09T11:13:43.908 INFO:teuthology.orchestra.run.smithi078.stdout:checking for suffix of executables... 2023-06-09T11:13:44.048 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether we are cross compiling... no 2023-06-09T11:13:44.111 INFO:teuthology.orchestra.run.smithi078.stdout:checking for suffix of object files... o 2023-06-09T11:13:44.160 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether we are using the GNU C compiler... yes 2023-06-09T11:13:44.219 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether gcc accepts -g... yes 2023-06-09T11:13:44.320 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-09T11:13:44.334 INFO:teuthology.orchestra.run.smithi078.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-06-09T11:13:44.347 INFO:teuthology.orchestra.run.smithi078.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-06-09T11:13:44.353 INFO:teuthology.orchestra.run.smithi078.stdout:checking for egrep... /usr/bin/grep -E 2023-06-09T11:13:44.360 INFO:teuthology.orchestra.run.smithi078.stdout:checking for fgrep... /usr/bin/grep -F 2023-06-09T11:13:44.378 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ld used by gcc... /usr/bin/ld 2023-06-09T11:13:44.386 INFO:teuthology.orchestra.run.smithi078.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-06-09T11:13:44.406 INFO:teuthology.orchestra.run.smithi078.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-06-09T11:13:44.483 INFO:teuthology.orchestra.run.smithi078.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-06-09T11:13:44.483 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether ln -s works... yes 2023-06-09T11:13:44.513 INFO:teuthology.orchestra.run.smithi078.stdout:checking the maximum length of command line arguments... 1572864 2023-06-09T11:13:44.524 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-09T11:13:44.525 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-09T11:13:44.525 INFO:teuthology.orchestra.run.smithi078.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-06-09T11:13:44.527 INFO:teuthology.orchestra.run.smithi078.stdout:checking for objdump... objdump 2023-06-09T11:13:44.528 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to recognize dependent libraries... pass_all 2023-06-09T11:13:44.529 INFO:teuthology.orchestra.run.smithi078.stdout:checking for dlltool... no 2023-06-09T11:13:44.530 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-09T11:13:44.532 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ar... ar 2023-06-09T11:13:44.691 INFO:teuthology.orchestra.run.smithi078.stdout:checking for archiver @FILE support... @ 2023-06-09T11:13:44.691 INFO:teuthology.orchestra.run.smithi078.stdout:checking for strip... strip 2023-06-09T11:13:44.693 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ranlib... ranlib 2023-06-09T11:13:44.693 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gawk... gawk 2023-06-09T11:13:44.904 INFO:teuthology.orchestra.run.smithi078.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-06-09T11:13:44.911 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sysroot... no 2023-06-09T11:13:44.927 INFO:teuthology.orchestra.run.smithi078.stdout:checking for a working dd... /usr/bin/dd 2023-06-09T11:13:44.943 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-06-09T11:13:44.996 INFO:teuthology.orchestra.run.smithi078.stdout:checking for mt... mt 2023-06-09T11:13:45.021 INFO:teuthology.orchestra.run.smithi078.stdout:checking if mt is a manifest tool... no 2023-06-09T11:13:45.123 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to run the C preprocessor... gcc -E 2023-06-09T11:13:45.484 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ANSI C header files... yes 2023-06-09T11:13:45.560 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/types.h... yes 2023-06-09T11:13:45.659 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/stat.h... yes 2023-06-09T11:13:45.753 INFO:teuthology.orchestra.run.smithi078.stdout:checking for stdlib.h... yes 2023-06-09T11:13:45.849 INFO:teuthology.orchestra.run.smithi078.stdout:checking for string.h... yes 2023-06-09T11:13:45.937 INFO:teuthology.orchestra.run.smithi078.stdout:checking for memory.h... yes 2023-06-09T11:13:46.039 INFO:teuthology.orchestra.run.smithi078.stdout:checking for strings.h... yes 2023-06-09T11:13:46.143 INFO:teuthology.orchestra.run.smithi078.stdout:checking for inttypes.h... yes 2023-06-09T11:13:46.241 INFO:teuthology.orchestra.run.smithi078.stdout:checking for stdint.h... yes 2023-06-09T11:13:46.351 INFO:teuthology.orchestra.run.smithi078.stdout:checking for unistd.h... yes 2023-06-09T11:13:46.437 INFO:teuthology.orchestra.run.smithi078.stdout:checking for dlfcn.h... yes 2023-06-09T11:13:46.456 INFO:teuthology.orchestra.run.smithi078.stdout:checking for objdir... .libs 2023-06-09T11:13:46.684 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-09T11:13:46.685 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-09T11:13:46.757 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-09T11:13:46.982 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc static flag -static works... yes 2023-06-09T11:13:47.083 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc supports -c -o file.o... yes 2023-06-09T11:13:47.084 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-09T11:13:47.117 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-09T11:13:47.196 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether -lc should be explicitly linked in... no 2023-06-09T11:13:47.355 INFO:teuthology.orchestra.run.smithi078.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-09T11:13:47.356 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to hardcode library paths into programs... immediate 2023-06-09T11:13:47.377 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether stripping libraries is possible... yes 2023-06-09T11:13:47.377 INFO:teuthology.orchestra.run.smithi078.stdout:checking if libtool supports shared libraries... yes 2023-06-09T11:13:47.378 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether to build shared libraries... yes 2023-06-09T11:13:47.378 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether to build static libraries... yes 2023-06-09T11:13:47.417 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc... (cached) gcc 2023-06-09T11:13:47.498 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-09T11:13:47.499 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-09T11:13:47.500 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-09T11:13:47.501 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gmake... no 2023-06-09T11:13:47.502 INFO:teuthology.orchestra.run.smithi078.stdout:checking for make... /usr/bin/make 2023-06-09T11:13:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-06-09T11:13:47.503 INFO:teuthology.orchestra.run.smithi078.stdout:checking for tar... /bin/tar 2023-06-09T11:13:47.504 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gzip... /bin/gzip 2023-06-09T11:13:47.533 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether gcc -MM is supported... yes 2023-06-09T11:13:47.535 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sort... /bin/sort 2023-06-09T11:13:47.536 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether ln -s works... yes 2023-06-09T11:13:47.538 INFO:teuthology.orchestra.run.smithi078.stdout:checking for rpm... no 2023-06-09T11:13:47.627 INFO:teuthology.orchestra.run.smithi078.stdout:checking assert.h usability... yes 2023-06-09T11:13:47.656 INFO:teuthology.orchestra.run.smithi078.stdout:checking assert.h presence... yes 2023-06-09T11:13:47.656 INFO:teuthology.orchestra.run.smithi078.stdout:checking for assert.h... yes 2023-06-09T11:13:47.770 INFO:teuthology.orchestra.run.smithi078.stdout:checking bstring.h usability... no 2023-06-09T11:13:47.819 INFO:teuthology.orchestra.run.smithi078.stdout:checking bstring.h presence... no 2023-06-09T11:13:47.820 INFO:teuthology.orchestra.run.smithi078.stdout:checking for bstring.h... no 2023-06-09T11:13:47.907 INFO:teuthology.orchestra.run.smithi078.stdout:checking libgen.h usability... yes 2023-06-09T11:13:47.934 INFO:teuthology.orchestra.run.smithi078.stdout:checking libgen.h presence... yes 2023-06-09T11:13:47.935 INFO:teuthology.orchestra.run.smithi078.stdout:checking for libgen.h... yes 2023-06-09T11:13:48.037 INFO:teuthology.orchestra.run.smithi078.stdout:checking dirent.h usability... yes 2023-06-09T11:13:48.069 INFO:teuthology.orchestra.run.smithi078.stdout:checking dirent.h presence... yes 2023-06-09T11:13:48.069 INFO:teuthology.orchestra.run.smithi078.stdout:checking for dirent.h... yes 2023-06-09T11:13:48.215 INFO:teuthology.orchestra.run.smithi078.stdout:checking errno.h usability... yes 2023-06-09T11:13:48.247 INFO:teuthology.orchestra.run.smithi078.stdout:checking errno.h presence... yes 2023-06-09T11:13:48.247 INFO:teuthology.orchestra.run.smithi078.stdout:checking for errno.h... yes 2023-06-09T11:13:48.351 INFO:teuthology.orchestra.run.smithi078.stdout:checking malloc.h usability... yes 2023-06-09T11:13:48.382 INFO:teuthology.orchestra.run.smithi078.stdout:checking malloc.h presence... yes 2023-06-09T11:13:48.383 INFO:teuthology.orchestra.run.smithi078.stdout:checking for malloc.h... yes 2023-06-09T11:13:48.487 INFO:teuthology.orchestra.run.smithi078.stdout:checking uuid.h usability... no 2023-06-09T11:13:48.534 INFO:teuthology.orchestra.run.smithi078.stdout:checking uuid.h presence... no 2023-06-09T11:13:48.535 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid.h... no 2023-06-09T11:13:48.643 INFO:teuthology.orchestra.run.smithi078.stdout:checking uuid/uuid.h usability... yes 2023-06-09T11:13:48.678 INFO:teuthology.orchestra.run.smithi078.stdout:checking uuid/uuid.h presence... yes 2023-06-09T11:13:48.678 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid/uuid.h... yes 2023-06-09T11:13:48.787 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/uuid.h usability... no 2023-06-09T11:13:48.832 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/uuid.h presence... no 2023-06-09T11:13:48.832 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/uuid.h... no 2023-06-09T11:13:48.922 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/file.h usability... yes 2023-06-09T11:13:48.951 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/file.h presence... yes 2023-06-09T11:13:48.951 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/file.h... yes 2023-06-09T11:13:49.057 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/fcntl.h usability... yes 2023-06-09T11:13:49.090 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/fcntl.h presence... yes 2023-06-09T11:13:49.090 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/fcntl.h... yes 2023-06-09T11:13:49.191 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/syssgi.h usability... no 2023-06-09T11:13:49.240 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/syssgi.h presence... no 2023-06-09T11:13:49.241 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/syssgi.h... no 2023-06-09T11:13:49.351 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/param.h usability... yes 2023-06-09T11:13:49.382 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/param.h presence... yes 2023-06-09T11:13:49.383 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/param.h... yes 2023-06-09T11:13:49.413 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/stat.h... (cached) yes 2023-06-09T11:13:49.516 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/statvfs.h usability... yes 2023-06-09T11:13:49.547 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/statvfs.h presence... yes 2023-06-09T11:13:49.547 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/statvfs.h... yes 2023-06-09T11:13:49.655 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/time.h usability... yes 2023-06-09T11:13:49.688 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/time.h presence... yes 2023-06-09T11:13:49.688 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/time.h... yes 2023-06-09T11:13:49.803 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/ioctl.h usability... yes 2023-06-09T11:13:49.838 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/ioctl.h presence... yes 2023-06-09T11:13:49.838 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/ioctl.h... yes 2023-06-09T11:13:49.947 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/wait.h usability... yes 2023-06-09T11:13:49.982 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/wait.h presence... yes 2023-06-09T11:13:49.983 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/wait.h... yes 2023-06-09T11:13:50.013 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/types.h... (cached) yes 2023-06-09T11:13:50.040 INFO:teuthology.orchestra.run.smithi078.stdout:checking for strings.h... (cached) yes 2023-06-09T11:13:50.139 INFO:teuthology.orchestra.run.smithi078.stdout:checking err.h usability... yes 2023-06-09T11:13:50.164 INFO:teuthology.orchestra.run.smithi078.stdout:checking err.h presence... yes 2023-06-09T11:13:50.164 INFO:teuthology.orchestra.run.smithi078.stdout:checking for err.h... yes 2023-06-09T11:13:50.275 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/falloc.h usability... yes 2023-06-09T11:13:50.303 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/falloc.h presence... yes 2023-06-09T11:13:50.303 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/falloc.h... yes 2023-06-09T11:13:50.405 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-09T11:13:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-09T11:13:50.444 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-09T11:13:50.532 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-09T11:13:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-09T11:13:50.577 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-09T11:13:50.677 INFO:teuthology.orchestra.run.smithi078.stdout:checking xfs/platform_defs.h usability... no 2023-06-09T11:13:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:checking xfs/platform_defs.h presence... no 2023-06-09T11:13:50.723 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/platform_defs.h... no 2023-06-09T11:13:50.813 INFO:teuthology.orchestra.run.smithi078.stdout:checking btrfs/ioctl.h usability... no 2023-06-09T11:13:50.857 INFO:teuthology.orchestra.run.smithi078.stdout:checking btrfs/ioctl.h presence... no 2023-06-09T11:13:50.858 INFO:teuthology.orchestra.run.smithi078.stdout:checking for btrfs/ioctl.h... no 2023-06-09T11:13:50.950 INFO:teuthology.orchestra.run.smithi078.stdout:checking cifs/ioctl.h usability... no 2023-06-09T11:13:51.000 INFO:teuthology.orchestra.run.smithi078.stdout:checking cifs/ioctl.h presence... no 2023-06-09T11:13:51.001 INFO:teuthology.orchestra.run.smithi078.stdout:checking for cifs/ioctl.h... no 2023-06-09T11:13:51.089 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/mman.h usability... yes 2023-06-09T11:13:51.119 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/mman.h presence... yes 2023-06-09T11:13:51.119 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/mman.h... yes 2023-06-09T11:13:51.196 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/xfs_log_format.h... no 2023-06-09T11:13:51.314 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid_compare... no 2023-06-09T11:13:51.409 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid_compare in -luuid... yes 2023-06-09T11:13:51.559 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/xfs.h... yes 2023-06-09T11:13:51.624 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/libxfs.h... no 2023-06-09T11:13:51.696 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-09T11:13:51.778 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/xqm.h... yes 2023-06-09T11:13:51.901 INFO:teuthology.orchestra.run.smithi078.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-09T11:13:51.980 INFO:teuthology.orchestra.run.smithi078.stdout:checking xfs/handle.h usability... yes 2023-06-09T11:13:52.011 INFO:teuthology.orchestra.run.smithi078.stdout:checking xfs/handle.h presence... yes 2023-06-09T11:13:52.011 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/handle.h... yes 2023-06-09T11:13:52.113 INFO:teuthology.orchestra.run.smithi078.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-09T11:13:52.197 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/acl.h usability... yes 2023-06-09T11:13:52.230 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/acl.h presence... yes 2023-06-09T11:13:52.231 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/acl.h... yes 2023-06-09T11:13:52.314 INFO:teuthology.orchestra.run.smithi078.stdout:checking acl/libacl.h usability... yes 2023-06-09T11:13:52.345 INFO:teuthology.orchestra.run.smithi078.stdout:checking acl/libacl.h presence... yes 2023-06-09T11:13:52.346 INFO:teuthology.orchestra.run.smithi078.stdout:checking for acl/libacl.h... yes 2023-06-09T11:13:52.448 INFO:teuthology.orchestra.run.smithi078.stdout:checking for acl_init in -lacl... yes 2023-06-09T11:13:52.571 INFO:teuthology.orchestra.run.smithi078.stdout:checking gdbm-ndbm.h usability... no 2023-06-09T11:13:52.621 INFO:teuthology.orchestra.run.smithi078.stdout:checking gdbm-ndbm.h presence... no 2023-06-09T11:13:52.622 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gdbm-ndbm.h... no 2023-06-09T11:13:52.700 INFO:teuthology.orchestra.run.smithi078.stdout:checking gdbm/ndbm.h usability... no 2023-06-09T11:13:52.746 INFO:teuthology.orchestra.run.smithi078.stdout:checking gdbm/ndbm.h presence... no 2023-06-09T11:13:52.746 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gdbm/ndbm.h... no 2023-06-09T11:13:52.824 INFO:teuthology.orchestra.run.smithi078.stdout:checking ndbm.h usability... no 2023-06-09T11:13:52.870 INFO:teuthology.orchestra.run.smithi078.stdout:checking ndbm.h presence... no 2023-06-09T11:13:52.871 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ndbm.h... no 2023-06-09T11:13:52.956 INFO:teuthology.orchestra.run.smithi078.stdout:checking libaio.h usability... yes 2023-06-09T11:13:52.992 INFO:teuthology.orchestra.run.smithi078.stdout:checking libaio.h presence... yes 2023-06-09T11:13:52.992 INFO:teuthology.orchestra.run.smithi078.stdout:checking for libaio.h... yes 2023-06-09T11:13:53.075 INFO:teuthology.orchestra.run.smithi078.stdout:checking liburing.h usability... no 2023-06-09T11:13:53.121 INFO:teuthology.orchestra.run.smithi078.stdout:checking liburing.h presence... no 2023-06-09T11:13:53.122 INFO:teuthology.orchestra.run.smithi078.stdout:checking for liburing.h... no 2023-06-09T11:13:53.200 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/capability.h usability... no 2023-06-09T11:13:53.240 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/capability.h presence... no 2023-06-09T11:13:53.241 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/capability.h... no 2023-06-09T11:13:53.317 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/fiemap.h usability... yes 2023-06-09T11:13:53.346 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/fiemap.h presence... yes 2023-06-09T11:13:53.346 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/fiemap.h... yes 2023-06-09T11:13:53.443 INFO:teuthology.orchestra.run.smithi078.stdout:checking for fallocate... yes 2023-06-09T11:13:53.538 INFO:teuthology.orchestra.run.smithi078.stdout:checking for open_by_handle_at... yes 2023-06-09T11:13:53.619 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/prctl.h usability... yes 2023-06-09T11:13:53.652 INFO:teuthology.orchestra.run.smithi078.stdout:checking sys/prctl.h presence... yes 2023-06-09T11:13:53.653 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/prctl.h... yes 2023-06-09T11:13:53.738 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/fs.h usability... yes 2023-06-09T11:13:53.772 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/fs.h presence... yes 2023-06-09T11:13:53.773 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/fs.h... yes 2023-06-09T11:13:53.850 INFO:teuthology.orchestra.run.smithi078.stdout:checking btrfsutil.h usability... no 2023-06-09T11:13:53.892 INFO:teuthology.orchestra.run.smithi078.stdout:checking btrfsutil.h presence... no 2023-06-09T11:13:53.893 INFO:teuthology.orchestra.run.smithi078.stdout:checking for btrfsutil.h... no 2023-06-09T11:13:54.001 INFO:teuthology.orchestra.run.smithi078.stdout:checking for copy_file_range... yes 2023-06-09T11:13:54.111 INFO:teuthology.orchestra.run.smithi078.stdout:checking for SEEK_DATA... yes 2023-06-09T11:13:54.230 INFO:teuthology.orchestra.run.smithi078.stdout:checking for BMV_OF_SHARED... yes 2023-06-09T11:13:54.332 INFO:teuthology.orchestra.run.smithi078.stdout:checking for nftw... yes 2023-06-09T11:13:54.430 INFO:teuthology.orchestra.run.smithi078.stdout:checking for RLIMIT_NOFILE... yes 2023-06-09T11:13:54.499 INFO:teuthology.orchestra.run.smithi078.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-09T11:13:54.599 INFO:teuthology.orchestra.run.smithi078.stdout:checking for renameat2... yes 2023-06-09T11:13:54.700 INFO:teuthology.orchestra.run.smithi078.stdout:checking for reallocarray... yes 2023-06-09T11:13:54.759 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct mount_attr... no 2023-06-09T11:13:54.887 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-09T11:13:55.018 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-09T11:13:55.149 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-09T11:13:55.280 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-09T11:13:55.412 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-09T11:13:55.540 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-09T11:13:55.670 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-09T11:13:55.762 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/btrfs.h usability... yes 2023-06-09T11:13:55.794 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/btrfs.h presence... yes 2023-06-09T11:13:55.795 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/btrfs.h... yes 2023-06-09T11:13:55.902 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-09T11:13:55.930 INFO:teuthology.orchestra.run.smithi078.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-09T11:13:55.930 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/btrfs_tree.h... yes 2023-06-09T11:13:56.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:56.057 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:56.063 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-09T11:13:56.111 INFO:teuthology.orchestra.run.smithi078.stdout:configure: creating ./config.status 2023-06-09T11:13:57.979 INFO:teuthology.orchestra.run.smithi078.stdout:config.status: creating include/builddefs 2023-06-09T11:13:58.048 INFO:teuthology.orchestra.run.smithi078.stdout:config.status: creating include/config.h 2023-06-09T11:13:58.100 INFO:teuthology.orchestra.run.smithi078.stdout:config.status: executing libtool commands 2023-06-09T11:13:58.260 INFO:teuthology.orchestra.run.smithi078.stdout:Building include 2023-06-09T11:13:58.273 INFO:teuthology.orchestra.run.smithi078.stdout:Building lib 2023-06-09T11:13:58.287 INFO:teuthology.orchestra.run.smithi078.stdout: [LTDEP] 2023-06-09T11:13:58.605 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dataascii.lo 2023-06-09T11:13:58.882 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] databin.lo 2023-06-09T11:13:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] datapid.lo 2023-06-09T11:13:59.458 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] file_lock.lo 2023-06-09T11:13:59.780 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] forker.lo 2023-06-09T11:14:00.093 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] pattern.lo 2023-06-09T11:14:00.381 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] open_flags.lo 2023-06-09T11:14:00.698 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] random_range.lo 2023-06-09T11:14:01.119 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] string_to_tokens.lo 2023-06-09T11:14:01.388 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] str_to_bytes.lo 2023-06-09T11:14:01.691 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] tlibio.lo 2023-06-09T11:14:02.130 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] write_log.lo 2023-06-09T11:14:02.300 INFO:teuthology.orchestra.run.smithi078.stderr:write_log.c: In function 'wlog_record_write': 2023-06-09T11:14:02.300 INFO:teuthology.orchestra.run.smithi078.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:02.300 INFO:teuthology.orchestra.run.smithi078.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-06-09T11:14:02.300 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:02.301 INFO:teuthology.orchestra.run.smithi078.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:02.301 INFO:teuthology.orchestra.run.smithi078.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-06-09T11:14:02.301 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:02.543 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] random.lo 2023-06-09T11:14:02.809 INFO:teuthology.orchestra.run.smithi078.stdout: [LD] 2023-06-09T11:14:03.043 INFO:teuthology.orchestra.run.smithi078.stdout:Building ltp 2023-06-09T11:14:03.057 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-06-09T11:14:03.359 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] doio 2023-06-09T11:14:04.357 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsstress 2023-06-09T11:14:06.044 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsx 2023-06-09T11:14:07.243 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] growfiles 2023-06-09T11:14:08.071 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] iogen 2023-06-09T11:14:08.403 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c: In function 'main': 2023-06-09T11:14:08.403 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:08.403 INFO:teuthology.orchestra.run.smithi078.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-06-09T11:14:08.403 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:08.407 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c: In function 'parse_cmdline': 2023-06-09T11:14:08.407 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:08.407 INFO:teuthology.orchestra.run.smithi078.stderr: 1535 | getcwd(fptr->f_path, 2023-06-09T11:14:08.407 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:08.407 INFO:teuthology.orchestra.run.smithi078.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-06-09T11:14:08.408 INFO:teuthology.orchestra.run.smithi078.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-stress 2023-06-09T11:14:09.055 INFO:teuthology.orchestra.run.smithi078.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-06-09T11:14:09.055 INFO:teuthology.orchestra.run.smithi078.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:09.055 INFO:teuthology.orchestra.run.smithi078.stderr: 1013 | ftruncate(fd, total_ram); 2023-06-09T11:14:09.055 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:09.443 INFO:teuthology.orchestra.run.smithi078.stdout:Building src 2023-06-09T11:14:09.461 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-06-09T11:14:12.798 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-06-09T11:14:12.887 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-06-09T11:14:12.919 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-06-09T11:14:13.401 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-06-09T11:14:13.482 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dirstress 2023-06-09T11:14:13.987 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fill 2023-06-09T11:14:14.371 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fill2 2023-06-09T11:14:14.856 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] getpagesize 2023-06-09T11:14:15.202 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] holes 2023-06-09T11:14:15.637 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] lstat64 2023-06-09T11:14:16.056 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] nametest 2023-06-09T11:14:16.392 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c: In function 'main': 2023-06-09T11:14:16.393 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:16.393 INFO:teuthology.orchestra.run.smithi078.stderr: 236 | write(1, "\n", 1); 2023-06-09T11:14:16.393 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:16.393 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:16.393 INFO:teuthology.orchestra.run.smithi078.stderr: 238 | write(1, ".", 1); 2023-06-09T11:14:16.394 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:16.394 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:16.394 INFO:teuthology.orchestra.run.smithi078.stderr: 288 | write(1, ".", 1); 2023-06-09T11:14:16.394 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:16.558 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] permname 2023-06-09T11:14:17.007 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] randholes 2023-06-09T11:14:17.517 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] runas 2023-06-09T11:14:17.929 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] truncfile 2023-06-09T11:14:18.356 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] usemem 2023-06-09T11:14:18.742 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mmapcat 2023-06-09T11:14:19.044 INFO:teuthology.orchestra.run.smithi078.stderr:mmapcat.c: In function 'main': 2023-06-09T11:14:19.044 INFO:teuthology.orchestra.run.smithi078.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:19.045 INFO:teuthology.orchestra.run.smithi078.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-06-09T11:14:19.045 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:19.118 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] append_reader 2023-06-09T11:14:19.513 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] append_writer 2023-06-09T11:14:19.906 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dirperf 2023-06-09T11:14:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] metaperf 2023-06-09T11:14:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 'crfiles': 2023-06-09T11:14:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:20.692 INFO:teuthology.orchestra.run.smithi078.stderr: 166 | write(fd, buf, fsize); 2023-06-09T11:14:20.692 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 't_linkun': 2023-06-09T11:14:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:20.693 INFO:teuthology.orchestra.run.smithi078.stderr: 454 | link("a", *fnp); 2023-06-09T11:14:20.693 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~ 2023-06-09T11:14:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 't_chown': 2023-06-09T11:14:20.694 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:20.694 INFO:teuthology.orchestra.run.smithi078.stderr: 404 | chown(*fnp, 2, -1); 2023-06-09T11:14:20.694 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:20.694 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:20.694 INFO:teuthology.orchestra.run.smithi078.stderr: 406 | chown(*fnp, 1, -1); 2023-06-09T11:14:20.694 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:20.694 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 'i_chown': 2023-06-09T11:14:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:20.695 INFO:teuthology.orchestra.run.smithi078.stderr: 291 | chown(*fnp, 1, -1); 2023-06-09T11:14:20.695 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 'main': 2023-06-09T11:14:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:20.695 INFO:teuthology.orchestra.run.smithi078.stderr: 152 | chdir(".."); 2023-06-09T11:14:20.695 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~ 2023-06-09T11:14:20.885 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] devzero 2023-06-09T11:14:21.306 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] feature 2023-06-09T11:14:21.776 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] alloc 2023-06-09T11:14:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:alloc.c: In function 'main': 2023-06-09T11:14:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:22.107 INFO:teuthology.orchestra.run.smithi078.stderr: 247 | mkstemp(tmpfile); 2023-06-09T11:14:22.107 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:22.239 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fault 2023-06-09T11:14:22.639 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fstest 2023-06-09T11:14:23.132 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_access_root 2023-06-09T11:14:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:t_access_root.c: In function 'main': 2023-06-09T11:14:23.443 INFO:teuthology.orchestra.run.smithi078.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:23.444 INFO:teuthology.orchestra.run.smithi078.stderr: 55 | system(cmd); 2023-06-09T11:14:23.444 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~ 2023-06-09T11:14:23.524 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] godown 2023-06-09T11:14:23.939 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] resvtest 2023-06-09T11:14:24.370 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] writemod 2023-06-09T11:14:24.751 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] writev_on_pagefault 2023-06-09T11:14:25.154 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] makeextents 2023-06-09T11:14:25.582 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] itrash 2023-06-09T11:14:25.974 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] rename 2023-06-09T11:14:26.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:26.139 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:26.320 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] multi_open_unlink 2023-06-09T11:14:26.731 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] unwritten_sync 2023-06-09T11:14:27.159 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] genhashnames 2023-06-09T11:14:27.592 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_holes 2023-06-09T11:14:27.979 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_writev 2023-06-09T11:14:28.371 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_truncate_cmtime 2023-06-09T11:14:28.763 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dirhash_collide 2023-06-09T11:14:29.179 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_rename_overwrite 2023-06-09T11:14:29.540 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] holetest 2023-06-09T11:14:29.853 INFO:teuthology.orchestra.run.smithi078.stderr:holetest.c: In function 'pt_write_marker': 2023-06-09T11:14:29.853 INFO:teuthology.orchestra.run.smithi078.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:29.853 INFO:teuthology.orchestra.run.smithi078.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-06-09T11:14:29.853 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:30.006 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_truncate_self 2023-06-09T11:14:30.357 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] af_unix 2023-06-09T11:14:30.753 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_stale_pmd 2023-06-09T11:14:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-06-09T11:14:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:31.078 INFO:teuthology.orchestra.run.smithi078.stderr: 42 | ftruncate(fd, 0); 2023-06-09T11:14:31.078 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:31.078 INFO:teuthology.orchestra.run.smithi078.stderr: 43 | ftruncate(fd, MiB(4)); 2023-06-09T11:14:31.079 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:31.079 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:31.079 INFO:teuthology.orchestra.run.smithi078.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-06-09T11:14:31.079 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:31.155 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_cow_race 2023-06-09T11:14:31.455 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_cow_race.c: In function 'main': 2023-06-09T11:14:31.455 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:31.456 INFO:teuthology.orchestra.run.smithi078.stderr: 61 | ftruncate(fd, 0); 2023-06-09T11:14:31.456 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:31.456 INFO:teuthology.orchestra.run.smithi078.stderr: 62 | ftruncate(fd, MiB(2)); 2023-06-09T11:14:31.456 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:31.545 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_fallocate 2023-06-09T11:14:31.925 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsync-err 2023-06-09T11:14:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_write_ro 2023-06-09T11:14:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-09T11:14:33.083 INFO:teuthology.orchestra.run.smithi078.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-06-09T11:14:33.083 INFO:teuthology.orchestra.run.smithi078.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:33.083 INFO:teuthology.orchestra.run.smithi078.stderr: 61 | ftruncate(fd, 0); 2023-06-09T11:14:33.084 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-09T11:14:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_ofd_locks 2023-06-09T11:14:34.011 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_collision 2023-06-09T11:14:34.455 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mmap-write-concurrent 2023-06-09T11:14:34.870 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_get_file_time 2023-06-09T11:14:35.243 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_create_short_dirs 2023-06-09T11:14:35.641 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_create_long_dirs 2023-06-09T11:14:36.037 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_enospc 2023-06-09T11:14:36.471 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_writev_overlap 2023-06-09T11:14:36.866 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] checkpoint_journal 2023-06-09T11:14:37.252 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mmap-rw-fault 2023-06-09T11:14:37.664 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] allocstale 2023-06-09T11:14:38.070 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_cow_memory_failure 2023-06-09T11:14:38.476 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fake-dump-rootino 2023-06-09T11:14:38.856 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dio-buf-fault 2023-06-09T11:14:39.242 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] xfsctl 2023-06-09T11:14:39.676 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bstat 2023-06-09T11:14:40.132 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mtab 2023-06-09T11:14:40.435 INFO:teuthology.orchestra.run.smithi078.stderr:t_mtab.c: In function 'update_mtab': 2023-06-09T11:14:40.435 INFO:teuthology.orchestra.run.smithi078.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:40.436 INFO:teuthology.orchestra.run.smithi078.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-06-09T11:14:40.436 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:40.547 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] getdevicesize 2023-06-09T11:14:40.927 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] preallo_rw_pattern_reader 2023-06-09T11:14:41.261 INFO:teuthology.orchestra.run.smithi078.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-06-09T11:14:41.261 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c: In function 'main': 2023-06-09T11:14:41.261 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:41.261 INFO:teuthology.orchestra.run.smithi078.stderr: 38 | read(fd, &x, 1048576); 2023-06-09T11:14:41.262 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:41.340 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] preallo_rw_pattern_writer 2023-06-09T11:14:41.667 INFO:teuthology.orchestra.run.smithi078.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-06-09T11:14:41.667 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c: In function 'main': 2023-06-09T11:14:41.667 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:41.667 INFO:teuthology.orchestra.run.smithi078.stderr: 34 | write(fd, &x, 1048576); 2023-06-09T11:14:41.668 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:41.741 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] ftrunc 2023-06-09T11:14:42.136 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] trunc 2023-06-09T11:14:42.532 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fs_perms 2023-06-09T11:14:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c: In function 'main': 2023-06-09T11:14:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:42.848 INFO:teuthology.orchestra.run.smithi078.stderr: 54 | system("rm -f test.file"); 2023-06-09T11:14:42.849 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c: In function 'testsetup': 2023-06-09T11:14:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:42.849 INFO:teuthology.orchestra.run.smithi078.stderr: 67 | system("cp testx.file test.file"); 2023-06-09T11:14:42.849 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:42.849 INFO:teuthology.orchestra.run.smithi078.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-06-09T11:14:42.850 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c: In function 'testfperm': 2023-06-09T11:14:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:42.850 INFO:teuthology.orchestra.run.smithi078.stderr: 123 | seteuid(0); 2023-06-09T11:14:42.850 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~ 2023-06-09T11:14:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:42.850 INFO:teuthology.orchestra.run.smithi078.stderr: 124 | setegid(0); 2023-06-09T11:14:42.851 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~ 2023-06-09T11:14:42.930 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] testx 2023-06-09T11:14:43.282 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] looptest 2023-06-09T11:14:43.719 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] locktest 2023-06-09T11:14:44.299 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] unwritten_mmap 2023-06-09T11:14:44.708 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bulkstat_unlink_test 2023-06-09T11:14:45.044 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test.c: In function 'main': 2023-06-09T11:14:45.045 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:45.045 INFO:teuthology.orchestra.run.smithi078.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-06-09T11:14:45.045 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:45.045 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:45.045 INFO:teuthology.orchestra.run.smithi078.stderr: 178 | system(fname); 2023-06-09T11:14:45.045 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~ 2023-06-09T11:14:45.167 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] deduperace 2023-06-09T11:14:45.628 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bulkstat_unlink_test_modified 2023-06-09T11:14:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-06-09T11:14:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:45.956 INFO:teuthology.orchestra.run.smithi078.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-06-09T11:14:45.956 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:45.956 INFO:teuthology.orchestra.run.smithi078.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-06-09T11:14:45.957 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:45.957 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:45.957 INFO:teuthology.orchestra.run.smithi078.stderr: 185 | system(fname); 2023-06-09T11:14:45.957 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~ 2023-06-09T11:14:46.077 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_dir_offset 2023-06-09T11:14:46.444 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_futimens 2023-06-09T11:14:46.822 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_immutable 2023-06-09T11:14:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'create_test_area': 2023-06-09T11:14:47.172 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.172 INFO:teuthology.orchestra.run.smithi078.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T11:14:47.173 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.173 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.173 INFO:teuthology.orchestra.run.smithi078.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T11:14:47.173 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'remove_test_area': 2023-06-09T11:14:47.174 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T11:14:47.175 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.176 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.176 INFO:teuthology.orchestra.run.smithi078.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T11:14:47.176 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.176 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.176 INFO:teuthology.orchestra.run.smithi078.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T11:14:47.176 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'check_test_area': 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.177 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.178 INFO:teuthology.orchestra.run.smithi078.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T11:14:47.178 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.178 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.178 INFO:teuthology.orchestra.run.smithi078.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T11:14:47.178 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.178 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.178 INFO:teuthology.orchestra.run.smithi078.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.179 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.180 INFO:teuthology.orchestra.run.smithi078.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T11:14:47.180 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.180 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.180 INFO:teuthology.orchestra.run.smithi078.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T11:14:47.180 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.180 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.180 INFO:teuthology.orchestra.run.smithi078.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T11:14:47.181 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.181 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'test_immutable': 2023-06-09T11:14:47.181 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.182 INFO:teuthology.orchestra.run.smithi078.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T11:14:47.182 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.182 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.182 INFO:teuthology.orchestra.run.smithi078.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-06-09T11:14:47.182 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.182 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.182 INFO:teuthology.orchestra.run.smithi078.stderr: 408 | chown(path, 0, 0); 2023-06-09T11:14:47.183 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.183 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.183 INFO:teuthology.orchestra.run.smithi078.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-06-09T11:14:47.183 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.183 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.183 INFO:teuthology.orchestra.run.smithi078.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T11:14:47.183 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.184 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.184 INFO:teuthology.orchestra.run.smithi078.stderr: 553 | chown(path, 0, 0); 2023-06-09T11:14:47.184 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.184 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.184 INFO:teuthology.orchestra.run.smithi078.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-06-09T11:14:47.184 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.184 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-06-09T11:14:47.185 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.186 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.186 INFO:teuthology.orchestra.run.smithi078.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-06-09T11:14:47.186 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.186 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.187 INFO:teuthology.orchestra.run.smithi078.stderr: 653 | chown(path, 0, 0); 2023-06-09T11:14:47.187 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.187 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.187 INFO:teuthology.orchestra.run.smithi078.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T11:14:47.188 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.188 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.188 INFO:teuthology.orchestra.run.smithi078.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T11:14:47.189 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.189 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.189 INFO:teuthology.orchestra.run.smithi078.stderr: 705 | chown(path, 0, 0); 2023-06-09T11:14:47.189 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.190 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.190 INFO:teuthology.orchestra.run.smithi078.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T11:14:47.190 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.193 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'test_append': 2023-06-09T11:14:47.193 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.193 INFO:teuthology.orchestra.run.smithi078.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T11:14:47.194 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.194 INFO:teuthology.orchestra.run.smithi078.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-06-09T11:14:47.194 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.195 INFO:teuthology.orchestra.run.smithi078.stderr: 1051 | chown(path, 0, 0); 2023-06-09T11:14:47.195 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.195 INFO:teuthology.orchestra.run.smithi078.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-06-09T11:14:47.196 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.196 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.196 INFO:teuthology.orchestra.run.smithi078.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T11:14:47.197 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.197 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.197 INFO:teuthology.orchestra.run.smithi078.stderr: 1516 | chown(path, 0, 0); 2023-06-09T11:14:47.197 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.197 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.197 INFO:teuthology.orchestra.run.smithi078.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-06-09T11:14:47.197 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.198 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.198 INFO:teuthology.orchestra.run.smithi078.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-06-09T11:14:47.198 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.198 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.198 INFO:teuthology.orchestra.run.smithi078.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-06-09T11:14:47.198 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.198 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-06-09T11:14:47.199 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.200 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.200 INFO:teuthology.orchestra.run.smithi078.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-06-09T11:14:47.200 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.200 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.200 INFO:teuthology.orchestra.run.smithi078.stderr: 1618 | chown(path, 0, 0); 2023-06-09T11:14:47.200 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr: 1644 | chown(path, 0, 0); 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.201 INFO:teuthology.orchestra.run.smithi078.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T11:14:47.202 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.202 INFO:teuthology.orchestra.run.smithi078.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T11:14:47.202 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.202 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.202 INFO:teuthology.orchestra.run.smithi078.stderr: 1692 | chown(path, 0, 0); 2023-06-09T11:14:47.202 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.203 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:47.203 INFO:teuthology.orchestra.run.smithi078.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T11:14:47.203 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:47.841 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] stale_handle 2023-06-09T11:14:48.175 INFO:teuthology.orchestra.run.smithi078.stderr:stale_handle.c: In function 'main': 2023-06-09T11:14:48.175 INFO:teuthology.orchestra.run.smithi078.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:48.176 INFO:teuthology.orchestra.run.smithi078.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-06-09T11:14:48.176 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:48.263 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] pwrite_mmap_blocked 2023-06-09T11:14:48.660 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_dir_offset2 2023-06-09T11:14:49.104 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] seek_sanity_test 2023-06-09T11:14:49.448 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c: In function 'test18': 2023-06-09T11:14:49.448 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:49.448 INFO:teuthology.orchestra.run.smithi078.stderr: 460 | ftruncate(fd, 0); 2023-06-09T11:14:49.449 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:49.451 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-06-09T11:14:49.451 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:49.451 INFO:teuthology.orchestra.run.smithi078.stderr: 1207 | ftruncate(fd, 0); 2023-06-09T11:14:49.452 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:49.452 INFO:teuthology.orchestra.run.smithi078.stderr: 1256 | ftruncate(fd, 0); 2023-06-09T11:14:49.452 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr: 88 | ftruncate(fd, 0); 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:49.453 INFO:teuthology.orchestra.run.smithi078.stderr: 98 | ftruncate(fd, 0); 2023-06-09T11:14:49.454 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T11:14:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:49.454 INFO:teuthology.orchestra.run.smithi078.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-06-09T11:14:49.454 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:49.820 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] seek_copy_test 2023-06-09T11:14:50.228 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_readdir_1 2023-06-09T11:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:t_readdir_1.c: In function 'main': 2023-06-09T11:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr: 30 | read(fd, buf, 100); 2023-06-09T11:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:50.559 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_readdir_2 2023-06-09T11:14:50.938 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsync-tester 2023-06-09T11:14:51.259 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c: In function 'main': 2023-06-09T11:14:51.259 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:51.259 INFO:teuthology.orchestra.run.smithi078.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-06-09T11:14:51.260 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:51.260 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:51.260 INFO:teuthology.orchestra.run.smithi078.stderr: 541 | system("reboot -fn"); 2023-06-09T11:14:51.260 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:51.261 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-06-09T11:14:51.261 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:51.261 INFO:teuthology.orchestra.run.smithi078.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-06-09T11:14:51.261 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:51.456 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] nsexec 2023-06-09T11:14:51.890 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] cloner 2023-06-09T11:14:52.314 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] renameat2 2023-06-09T11:14:52.713 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_getcwd 2023-06-09T11:14:53.023 INFO:teuthology.orchestra.run.smithi078.stderr:t_getcwd.c: In function 'test_getcwd': 2023-06-09T11:14:53.023 INFO:teuthology.orchestra.run.smithi078.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:53.024 INFO:teuthology.orchestra.run.smithi078.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-06-09T11:14:53.024 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:53.106 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] e4compact 2023-06-09T11:14:53.559 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] test-nextquota 2023-06-09T11:14:53.964 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] punch-alternating 2023-06-09T11:14:54.360 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-09T11:14:54.776 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] listxattr 2023-06-09T11:14:55.156 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dio-interleaved 2023-06-09T11:14:55.554 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_dir_type 2023-06-09T11:14:55.947 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dio-invalidate-cache 2023-06-09T11:14:56.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:56.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:56.252 INFO:teuthology.orchestra.run.smithi078.stderr:dio-invalidate-cache.c: In function 'main': 2023-06-09T11:14:56.252 INFO:teuthology.orchestra.run.smithi078.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:14:56.252 INFO:teuthology.orchestra.run.smithi078.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-06-09T11:14:56.252 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:14:56.388 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] stat_test 2023-06-09T11:14:56.956 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_encrypted_d_revalidate 2023-06-09T11:14:57.363 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] attr_replace_test 2023-06-09T11:14:57.769 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] swapon 2023-06-09T11:14:58.171 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mkswap 2023-06-09T11:14:58.555 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_attr_corruption 2023-06-09T11:14:58.942 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_open_tmpfiles 2023-06-09T11:14:59.372 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fscrypt-crypt-util 2023-06-09T11:15:00.343 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bulkstat_null_ocount 2023-06-09T11:15:00.724 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] splice-test 2023-06-09T11:15:01.160 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] chprojid_fail 2023-06-09T11:15:01.556 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] detached_mounts_propagation 2023-06-09T11:15:01.986 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] ext4_resize 2023-06-09T11:15:02.369 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_readdir_3 2023-06-09T11:15:02.820 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] splice2pipe 2023-06-09T11:15:03.132 INFO:teuthology.orchestra.run.smithi078.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-06-09T11:15:03.132 INFO:teuthology.orchestra.run.smithi078.stderr:splice2pipe.c:56:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:15:03.132 INFO:teuthology.orchestra.run.smithi078.stderr: 56 | write(p[1], buffer, n); 2023-06-09T11:15:03.133 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:15:03.133 INFO:teuthology.orchestra.run.smithi078.stderr:splice2pipe.c:64:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:15:03.133 INFO:teuthology.orchestra.run.smithi078.stderr: 64 | read(p[0], buffer, n); 2023-06-09T11:15:03.133 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:15:03.223 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] uuid_ioctl 2023-06-09T11:15:03.621 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fiemap-tester 2023-06-09T11:15:04.140 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_stripealign 2023-06-09T11:15:04.535 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] open_by_handle 2023-06-09T11:15:05.049 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_dio 2023-06-09T11:15:05.456 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] xfsfind 2023-06-09T11:15:05.888 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fssum 2023-06-09T11:15:06.605 INFO:teuthology.orchestra.run.smithi078.stdout:Building log-writes 2023-06-09T11:15:06.622 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] replay-log 2023-06-09T11:15:07.233 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-06-09T11:15:07.244 INFO:teuthology.orchestra.run.smithi078.stdout:Building aio-dio-regress 2023-06-09T11:15:07.265 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-09T11:15:07.686 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-fcntl-race 2023-06-09T11:15:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-subblock-eof-read 2023-06-09T11:15:08.490 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-append-write-read-race 2023-06-09T11:15:08.920 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-invalidate-readahead 2023-06-09T11:15:09.337 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-hole-filling-race 2023-06-09T11:15:09.726 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-09T11:15:10.100 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-last-ref-held-by-io 2023-06-09T11:15:10.518 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-cycle-write 2023-06-09T11:15:10.823 INFO:teuthology.orchestra.run.smithi078.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-06-09T11:15:10.824 INFO:teuthology.orchestra.run.smithi078.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:15:10.824 INFO:teuthology.orchestra.run.smithi078.stderr: 83 | ftruncate(fd, buf_size); 2023-06-09T11:15:10.824 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:15:10.948 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-extend-stat 2023-06-09T11:15:11.358 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-09T11:15:11.719 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aiocp 2023-06-09T11:15:12.207 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-invalidate-failure 2023-06-09T11:15:12.619 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aiodio_sparse2 2023-06-09T11:15:12.939 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-06-09T11:15:12.939 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:15:12.939 INFO:teuthology.orchestra.run.smithi078.stderr: 111 | ftruncate(fd, filesize); 2023-06-09T11:15:12.939 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T11:15:12.939 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-06-09T11:15:12.940 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T11:15:12.940 INFO:teuthology.orchestra.run.smithi078.stderr: 274 | ftruncate(fd, size); 2023-06-09T11:15:12.940 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-06-09T11:15:13.105 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-cow-race 2023-06-09T11:15:13.518 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-write-verify 2023-06-09T11:15:13.963 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-eof-race 2023-06-09T11:15:14.380 INFO:teuthology.orchestra.run.smithi078.stdout:Building vfs 2023-06-09T11:15:14.399 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] vfstest 2023-06-09T11:15:17.091 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mount-idmapped 2023-06-09T11:15:17.771 INFO:teuthology.orchestra.run.smithi078.stdout:Building m4 2023-06-09T11:15:17.787 INFO:teuthology.orchestra.run.smithi078.stdout:Building common 2023-06-09T11:15:17.800 INFO:teuthology.orchestra.run.smithi078.stdout:Building tests 2023-06-09T11:15:17.820 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-06-09T11:15:17.837 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/perf/group.list 2023-06-09T11:15:17.892 INFO:teuthology.orchestra.run.smithi078.stdout:Building ext4 2023-06-09T11:15:17.912 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ext4/group.list 2023-06-09T11:15:18.108 INFO:teuthology.orchestra.run.smithi078.stdout:Building ocfs2 2023-06-09T11:15:18.125 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ocfs2/group.list 2023-06-09T11:15:18.200 INFO:teuthology.orchestra.run.smithi078.stdout:Building overlay 2023-06-09T11:15:18.217 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/overlay/group.list 2023-06-09T11:15:18.405 INFO:teuthology.orchestra.run.smithi078.stdout:Building cifs 2023-06-09T11:15:18.421 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/cifs/group.list 2023-06-09T11:15:18.485 INFO:teuthology.orchestra.run.smithi078.stdout:Building generic 2023-06-09T11:15:18.503 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/generic/group.list 2023-06-09T11:15:18.957 INFO:teuthology.orchestra.run.smithi078.stdout:Building shared 2023-06-09T11:15:18.972 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/shared/group.list 2023-06-09T11:15:19.059 INFO:teuthology.orchestra.run.smithi078.stdout:Building xfs 2023-06-09T11:15:19.079 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/xfs/group.list 2023-06-09T11:15:19.534 INFO:teuthology.orchestra.run.smithi078.stdout:Building f2fs 2023-06-09T11:15:19.551 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/f2fs/group.list 2023-06-09T11:15:19.638 INFO:teuthology.orchestra.run.smithi078.stdout:Building udf 2023-06-09T11:15:19.657 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/udf/group.list 2023-06-09T11:15:19.709 INFO:teuthology.orchestra.run.smithi078.stdout:Building ceph 2023-06-09T11:15:19.725 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ceph/group.list 2023-06-09T11:15:19.801 INFO:teuthology.orchestra.run.smithi078.stdout:Building nfs 2023-06-09T11:15:19.816 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/nfs/group.list 2023-06-09T11:15:19.885 INFO:teuthology.orchestra.run.smithi078.stdout:Building btrfs 2023-06-09T11:15:19.904 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/btrfs/group.list 2023-06-09T11:15:20.180 INFO:teuthology.orchestra.run.smithi078.stdout:Building tmpfs 2023-06-09T11:15:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/tmpfs/group.list 2023-06-09T11:15:20.265 INFO:teuthology.orchestra.run.smithi078.stdout:Building selftest 2023-06-09T11:15:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/selftest/group.list 2023-06-09T11:15:20.349 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo make install) 2023-06-09T11:15:20.432 INFO:teuthology.orchestra.run.smithi078.stdout:Building include 2023-06-09T11:15:20.446 INFO:teuthology.orchestra.run.smithi078.stdout:Building lib 2023-06-09T11:15:20.460 INFO:teuthology.orchestra.run.smithi078.stdout:Building ltp 2023-06-09T11:15:20.478 INFO:teuthology.orchestra.run.smithi078.stdout:Building src 2023-06-09T11:15:20.596 INFO:teuthology.orchestra.run.smithi078.stdout:Building log-writes 2023-06-09T11:15:20.609 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-06-09T11:15:20.622 INFO:teuthology.orchestra.run.smithi078.stdout:Building aio-dio-regress 2023-06-09T11:15:20.637 INFO:teuthology.orchestra.run.smithi078.stdout:Building vfs 2023-06-09T11:15:20.651 INFO:teuthology.orchestra.run.smithi078.stdout:Building m4 2023-06-09T11:15:20.664 INFO:teuthology.orchestra.run.smithi078.stdout:Building common 2023-06-09T11:15:20.678 INFO:teuthology.orchestra.run.smithi078.stdout:Building tests 2023-06-09T11:15:20.695 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-06-09T11:15:20.710 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/perf/group.list 2023-06-09T11:15:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:Building ext4 2023-06-09T11:15:20.788 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ext4/group.list 2023-06-09T11:15:20.970 INFO:teuthology.orchestra.run.smithi078.stdout:Building ocfs2 2023-06-09T11:15:20.987 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ocfs2/group.list 2023-06-09T11:15:21.053 INFO:teuthology.orchestra.run.smithi078.stdout:Building overlay 2023-06-09T11:15:21.071 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/overlay/group.list 2023-06-09T11:15:21.262 INFO:teuthology.orchestra.run.smithi078.stdout:Building cifs 2023-06-09T11:15:21.277 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/cifs/group.list 2023-06-09T11:15:21.333 INFO:teuthology.orchestra.run.smithi078.stdout:Building generic 2023-06-09T11:15:21.354 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/generic/group.list 2023-06-09T11:15:21.809 INFO:teuthology.orchestra.run.smithi078.stdout:Building shared 2023-06-09T11:15:21.824 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/shared/group.list 2023-06-09T11:15:21.901 INFO:teuthology.orchestra.run.smithi078.stdout:Building xfs 2023-06-09T11:15:21.922 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/xfs/group.list 2023-06-09T11:15:22.386 INFO:teuthology.orchestra.run.smithi078.stdout:Building f2fs 2023-06-09T11:15:22.405 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/f2fs/group.list 2023-06-09T11:15:22.488 INFO:teuthology.orchestra.run.smithi078.stdout:Building udf 2023-06-09T11:15:22.508 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/udf/group.list 2023-06-09T11:15:22.565 INFO:teuthology.orchestra.run.smithi078.stdout:Building ceph 2023-06-09T11:15:22.581 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ceph/group.list 2023-06-09T11:15:22.649 INFO:teuthology.orchestra.run.smithi078.stdout:Building nfs 2023-06-09T11:15:22.669 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/nfs/group.list 2023-06-09T11:15:22.733 INFO:teuthology.orchestra.run.smithi078.stdout:Building btrfs 2023-06-09T11:15:22.749 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/btrfs/group.list 2023-06-09T11:15:23.025 INFO:teuthology.orchestra.run.smithi078.stdout:Building tmpfs 2023-06-09T11:15:23.042 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/tmpfs/group.list 2023-06-09T11:15:23.105 INFO:teuthology.orchestra.run.smithi078.stdout:Building selftest 2023-06-09T11:15:23.124 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/selftest/group.list 2023-06-09T11:15:23.184 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-06-09T11:15:23.191 INFO:teuthology.orchestra.run.smithi078.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T11:15:23.191 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-06-09T11:15:23.199 INFO:teuthology.orchestra.run.smithi078.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T11:15:23.200 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-06-09T11:15:23.206 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-09T11:15:23.249 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-09T11:15:23.603 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-09T11:15:23.649 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-06-09T11:15:23.710 INFO:teuthology.orchestra.run.smithi078.stdout:Building log-writes 2023-06-09T11:15:23.723 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-06-09T11:15:23.738 INFO:teuthology.orchestra.run.smithi078.stdout:Building aio-dio-regress 2023-06-09T11:15:23.753 INFO:teuthology.orchestra.run.smithi078.stdout:Building vfs 2023-06-09T11:15:23.762 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make -C log-writes install 2023-06-09T11:15:23.768 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-09T11:15:23.812 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-09T11:15:23.856 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make -C perf install 2023-06-09T11:15:23.863 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-09T11:15:23.911 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-09T11:15:24.013 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make -C aio-dio-regress install 2023-06-09T11:15:24.023 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-09T11:15:24.065 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-09T11:15:24.317 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make -C vfs install 2023-06-09T11:15:24.324 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-09T11:15:24.366 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-09T11:15:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-09T11:15:24.474 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-09T11:15:26.287 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:26.294 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:30.490 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-09T11:15:30.934 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-09T11:15:31.040 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-06-09T11:15:31.046 INFO:teuthology.orchestra.run.smithi078.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T11:15:31.046 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-06-09T11:15:31.055 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-09T11:15:31.097 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-09T11:15:31.730 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-06-09T11:15:31.740 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/btrfs/ install 2023-06-09T11:15:31.752 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-09T11:15:31.797 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-09T11:15:35.611 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-09T11:15:35.660 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 016.out 064.out 186.out 240.out 279.out 180.out 282.out 267.out 280.out 140.out 265.out 206.out 121.out 040.out 106.out 199.out 233.out 234.out 248.out 009.out 033.out 082.out 252.out 270.out 148.out 088.out 137.out 002.out 125.out 110.out 165.out 152.out 143.out 264.out 015.out 192.out 075.out 178.out 284.out 052.out 228.out 276.out 046.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 179.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 087.out 212.out 112.out 012.out 107.out 162.out 147.out 196.out 145.out 004.out 187.out 024.out 220.out 238.out 120.out 202.out 102.out 171.out 261.out 156.out 092.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 047.out 011.out 029.out 035.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 246.out 056.out 216.out 116.out 043.out 274.out 287.out 010.out 001.out 138.out 237.out 097.out 153.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 200.out 100.out 025.out 258.out 269.out 208.out 039.out 222.out 275.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 159.out 211.out 158.out 085.out 277.out 146.out 188.out 189.out 204.out 104.out 225.out 242.out 268.out 135.out 257.out 124.out 142.out 172.out 103.out 058.out 262.out 042.out 096.out 193.out 283.out 083.out 099.out 247.out 053.out 109.out 157.out 164.out 154.out 094.out 241.out 089.out 141.out 214.out 114.out 014.out 278.out 041.out 223.out 028.out 086.out 123.out 144.out 032.out 182.out 205.out 136.out 005.out 036.out 198.out 008.out 190.out 173.out 050.out 038.out 105.out 263.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 057.out 272.out 078.out 184.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 130.out 023.out 044.out 073.out 030.out 203.out 003.out 101.out 055.out 166.out 245.out 243.out 194.out 249.out 122.out 076.out 022.out 174.out 045.out 281.out 090.out 224.out 181.out 271.out 149.out 183.out 077.out 218.out 118.out 018.out 256.out 168.out 007.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 255.out 139.out 221.out /var/lib/xfstests/tests/btrfs 2023-06-09T11:15:39.497 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ceph/ install 2023-06-09T11:15:39.505 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-09T11:15:39.550 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-09T11:15:39.643 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-09T11:15:39.684 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-09T11:15:39.786 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/cifs/ install 2023-06-09T11:15:39.795 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-09T11:15:39.841 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-09T11:15:39.882 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-09T11:15:39.925 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-09T11:15:39.973 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ext4/ install 2023-06-09T11:15:40.045 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-09T11:15:40.089 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-09T11:15:41.022 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-09T11:15:41.070 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-06-09T11:15:42.014 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/f2fs/ install 2023-06-09T11:15:42.022 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-09T11:15:42.068 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-09T11:15:42.126 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-09T11:15:42.169 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-09T11:15:42.226 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/generic/ install 2023-06-09T11:15:42.237 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-09T11:15:42.281 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-09T11:15:51.717 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-09T11:15:51.762 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 047.out 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 472.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 645.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 555.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 167.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 377.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 663.out 599.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 703.out 619.out 727.out 685.out 562.out 419.out 570.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 447.out 460.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 375.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 183.out 486.out 223.out 123.out 179.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 181.out 676.out 271.out 149.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 554.out 471.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 444.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 640.out 483.out 096.out 393.out /var/lib/xfstests/tests/generic 2023-06-09T11:15:56.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:56.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:01.380 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/nfs/ install 2023-06-09T11:16:01.387 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-09T11:16:01.435 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-09T11:16:01.481 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-09T11:16:01.522 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-09T11:16:01.566 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/ocfs2/ install 2023-06-09T11:16:01.575 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-09T11:16:01.618 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-09T11:16:01.663 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-09T11:16:01.706 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-09T11:16:01.754 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/overlay/ install 2023-06-09T11:16:01.764 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-09T11:16:01.811 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-09T11:16:03.099 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-09T11:16:03.141 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 050.out 044.out 019.out 103.out 003.out 074.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 045.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 037.out 029.out 111.out 112.out 042.out 035.out 073.out 068.out 030.out 034.out 017.out 055.out 053.out 109.out 116.out 043.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 100.out 064.out 104.out 028.out 027.out 023.out 059.out 049.out 032.out 039.out 077.out 105.out 005.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 063.out 021.out 016.out 047.out 110.out 046.out 012.out 101.out 054.out 033.out 057.out /var/lib/xfstests/tests/overlay 2023-06-09T11:16:04.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/perf/ install 2023-06-09T11:16:04.455 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-09T11:16:04.501 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-09T11:16:04.549 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-09T11:16:04.594 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-09T11:16:04.639 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/selftest/ install 2023-06-09T11:16:04.646 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-09T11:16:04.689 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-09T11:16:04.794 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-09T11:16:04.839 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-09T11:16:04.954 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/shared/ install 2023-06-09T11:16:04.963 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-09T11:16:05.013 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-09T11:16:05.086 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-09T11:16:05.130 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-09T11:16:05.201 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/tmpfs/ install 2023-06-09T11:16:05.208 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-09T11:16:05.256 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-09T11:16:05.300 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-09T11:16:05.343 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-09T11:16:05.390 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/udf/ install 2023-06-09T11:16:05.400 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-09T11:16:05.449 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-09T11:16:05.494 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-09T11:16:05.541 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-09T11:16:05.587 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.bWnQzKjaCzxfstests-dev/tests/xfs/ install 2023-06-09T11:16:05.598 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-09T11:16:05.645 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-09T11:16:14.752 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-09T11:16:14.794 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 216.out.64mblog 071.out.32 216.cfg 033.cfg 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 021.out 455.out 233.out 194.out 443.out 295.out 337.out 237.out 759.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 595.out 789.out 195.out 346.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 329.out 467.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 373.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 498.out 742.out 290.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 017.out 542.out 783.out 485.out 442.out 188.out 099.out 342.out 279.out 524.out 174.out 771.out 324.out 224.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 497.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 558.out 474.out 341.out 094.out 555.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 414.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 449.out 185.out 334.out 504.out 525.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 433.out 036.out 169.out 483.out 393.out 333.out 476.out 087.out 192.out 199.out 739.out 278.out 591.out 752.out 736.out 236.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 064.out 444.out 580.out 452.out 020.out 252.out 724.out 352.out 794.out 348.out 709.out 394.out 356.out 184.out 435.out 509.out 466.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 761.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 063.out 101.out 561.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 281.out 548.out 299.out 364.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 026.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 076.out 747.out 585.out 162.out 796.out 288.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 529.out 434.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 516.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 068.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 291.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 249.out 122.out 166.out 022.out 038.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 247.out 738.out 163.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 773.out 720.out 196.out 520.out 242.out 420.out 098.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 357.out 072.out 778.out 084.out 056.out 369.out 711.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 755.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 141.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 553.out 763.out 446.out 090.out 080.out 070.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out 588.out 146.out /var/lib/xfstests/tests/xfs 2023-06-09T11:16:23.989 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-09T11:16:24.030 INFO:teuthology.orchestra.run.smithi078.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-09T11:16:24.074 INFO:teuthology.orchestra.run.smithi078.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-09T11:16:24.117 INFO:teuthology.orchestra.run.smithi078.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-09T11:16:24.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:16:24.162 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec ls tests/generic) 2023-06-09T11:16:24.184 INFO:teuthology.orchestra.run.smithi078.stdout:001 2023-06-09T11:16:24.185 INFO:teuthology.orchestra.run.smithi078.stdout:001.out 2023-06-09T11:16:24.185 INFO:teuthology.orchestra.run.smithi078.stdout:002 2023-06-09T11:16:24.185 INFO:teuthology.orchestra.run.smithi078.stdout:002.out 2023-06-09T11:16:24.185 INFO:teuthology.orchestra.run.smithi078.stdout:003 2023-06-09T11:16:24.185 INFO:teuthology.orchestra.run.smithi078.stdout:003.out 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:004 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:004.out 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:005 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:005.out 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:006 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:006.out 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:007 2023-06-09T11:16:24.186 INFO:teuthology.orchestra.run.smithi078.stdout:007.out 2023-06-09T11:16:24.187 INFO:teuthology.orchestra.run.smithi078.stdout:008 2023-06-09T11:16:24.187 INFO:teuthology.orchestra.run.smithi078.stdout:008.out 2023-06-09T11:16:24.187 INFO:teuthology.orchestra.run.smithi078.stdout:009 2023-06-09T11:16:24.187 INFO:teuthology.orchestra.run.smithi078.stdout:009.out 2023-06-09T11:16:24.187 INFO:teuthology.orchestra.run.smithi078.stdout:010 2023-06-09T11:16:24.187 INFO:teuthology.orchestra.run.smithi078.stdout:010.out 2023-06-09T11:16:24.187 INFO:teuthology.orchestra.run.smithi078.stdout:011 2023-06-09T11:16:24.188 INFO:teuthology.orchestra.run.smithi078.stdout:011.out 2023-06-09T11:16:24.188 INFO:teuthology.orchestra.run.smithi078.stdout:012 2023-06-09T11:16:24.188 INFO:teuthology.orchestra.run.smithi078.stdout:012.out 2023-06-09T11:16:24.188 INFO:teuthology.orchestra.run.smithi078.stdout:013 2023-06-09T11:16:24.188 INFO:teuthology.orchestra.run.smithi078.stdout:013.out 2023-06-09T11:16:24.188 INFO:teuthology.orchestra.run.smithi078.stdout:014 2023-06-09T11:16:24.189 INFO:teuthology.orchestra.run.smithi078.stdout:014.out 2023-06-09T11:16:24.189 INFO:teuthology.orchestra.run.smithi078.stdout:015 2023-06-09T11:16:24.189 INFO:teuthology.orchestra.run.smithi078.stdout:015.out 2023-06-09T11:16:24.189 INFO:teuthology.orchestra.run.smithi078.stdout:016 2023-06-09T11:16:24.190 INFO:teuthology.orchestra.run.smithi078.stdout:016.out 2023-06-09T11:16:24.190 INFO:teuthology.orchestra.run.smithi078.stdout:017 2023-06-09T11:16:24.190 INFO:teuthology.orchestra.run.smithi078.stdout:017.out 2023-06-09T11:16:24.190 INFO:teuthology.orchestra.run.smithi078.stdout:018 2023-06-09T11:16:24.190 INFO:teuthology.orchestra.run.smithi078.stdout:018.out 2023-06-09T11:16:24.190 INFO:teuthology.orchestra.run.smithi078.stdout:019 2023-06-09T11:16:24.191 INFO:teuthology.orchestra.run.smithi078.stdout:019.out 2023-06-09T11:16:24.191 INFO:teuthology.orchestra.run.smithi078.stdout:020 2023-06-09T11:16:24.191 INFO:teuthology.orchestra.run.smithi078.stdout:020.out 2023-06-09T11:16:24.191 INFO:teuthology.orchestra.run.smithi078.stdout:021 2023-06-09T11:16:24.191 INFO:teuthology.orchestra.run.smithi078.stdout:021.out 2023-06-09T11:16:24.192 INFO:teuthology.orchestra.run.smithi078.stdout:022 2023-06-09T11:16:24.192 INFO:teuthology.orchestra.run.smithi078.stdout:022.out 2023-06-09T11:16:24.192 INFO:teuthology.orchestra.run.smithi078.stdout:023 2023-06-09T11:16:24.192 INFO:teuthology.orchestra.run.smithi078.stdout:023.out 2023-06-09T11:16:24.192 INFO:teuthology.orchestra.run.smithi078.stdout:024 2023-06-09T11:16:24.193 INFO:teuthology.orchestra.run.smithi078.stdout:024.out 2023-06-09T11:16:24.193 INFO:teuthology.orchestra.run.smithi078.stdout:025 2023-06-09T11:16:24.193 INFO:teuthology.orchestra.run.smithi078.stdout:025.out 2023-06-09T11:16:24.193 INFO:teuthology.orchestra.run.smithi078.stdout:026 2023-06-09T11:16:24.193 INFO:teuthology.orchestra.run.smithi078.stdout:026.out 2023-06-09T11:16:24.193 INFO:teuthology.orchestra.run.smithi078.stdout:027 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:027.out 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:028 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:028.out 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:029 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:029.out 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:030 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:030.out 2023-06-09T11:16:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:031 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:031.out 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:032 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:032.out 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:033 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:033.out 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:034 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:034.out 2023-06-09T11:16:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:035 2023-06-09T11:16:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:035.cfg 2023-06-09T11:16:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:035.out.default 2023-06-09T11:16:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:035.out.nfs 2023-06-09T11:16:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:036 2023-06-09T11:16:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:036.out 2023-06-09T11:16:24.197 INFO:teuthology.orchestra.run.smithi078.stdout:037 2023-06-09T11:16:24.197 INFO:teuthology.orchestra.run.smithi078.stdout:037.out 2023-06-09T11:16:24.197 INFO:teuthology.orchestra.run.smithi078.stdout:038 2023-06-09T11:16:24.198 INFO:teuthology.orchestra.run.smithi078.stdout:038.out 2023-06-09T11:16:24.198 INFO:teuthology.orchestra.run.smithi078.stdout:039 2023-06-09T11:16:24.198 INFO:teuthology.orchestra.run.smithi078.stdout:039.out 2023-06-09T11:16:24.198 INFO:teuthology.orchestra.run.smithi078.stdout:040 2023-06-09T11:16:24.198 INFO:teuthology.orchestra.run.smithi078.stdout:040.out 2023-06-09T11:16:24.199 INFO:teuthology.orchestra.run.smithi078.stdout:041 2023-06-09T11:16:24.199 INFO:teuthology.orchestra.run.smithi078.stdout:041.out 2023-06-09T11:16:24.199 INFO:teuthology.orchestra.run.smithi078.stdout:042 2023-06-09T11:16:24.199 INFO:teuthology.orchestra.run.smithi078.stdout:042.out 2023-06-09T11:16:24.199 INFO:teuthology.orchestra.run.smithi078.stdout:043 2023-06-09T11:16:24.200 INFO:teuthology.orchestra.run.smithi078.stdout:043.out 2023-06-09T11:16:24.200 INFO:teuthology.orchestra.run.smithi078.stdout:044 2023-06-09T11:16:24.200 INFO:teuthology.orchestra.run.smithi078.stdout:044.out 2023-06-09T11:16:24.200 INFO:teuthology.orchestra.run.smithi078.stdout:045 2023-06-09T11:16:24.200 INFO:teuthology.orchestra.run.smithi078.stdout:045.out 2023-06-09T11:16:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:046 2023-06-09T11:16:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:046.out 2023-06-09T11:16:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:047 2023-06-09T11:16:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:047.out 2023-06-09T11:16:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:048 2023-06-09T11:16:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:048.out 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:049 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:049.out 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:050 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:050.cfg 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:050.out.default 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:050.out.nojournal 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:050.out.xfsquota 2023-06-09T11:16:24.202 INFO:teuthology.orchestra.run.smithi078.stdout:051 2023-06-09T11:16:24.203 INFO:teuthology.orchestra.run.smithi078.stdout:051.out 2023-06-09T11:16:24.203 INFO:teuthology.orchestra.run.smithi078.stdout:052 2023-06-09T11:16:24.203 INFO:teuthology.orchestra.run.smithi078.stdout:052.out 2023-06-09T11:16:24.203 INFO:teuthology.orchestra.run.smithi078.stdout:053 2023-06-09T11:16:24.203 INFO:teuthology.orchestra.run.smithi078.stdout:053.out 2023-06-09T11:16:24.203 INFO:teuthology.orchestra.run.smithi078.stdout:054 2023-06-09T11:16:24.204 INFO:teuthology.orchestra.run.smithi078.stdout:054.out 2023-06-09T11:16:24.204 INFO:teuthology.orchestra.run.smithi078.stdout:055 2023-06-09T11:16:24.204 INFO:teuthology.orchestra.run.smithi078.stdout:055.out 2023-06-09T11:16:24.204 INFO:teuthology.orchestra.run.smithi078.stdout:056 2023-06-09T11:16:24.204 INFO:teuthology.orchestra.run.smithi078.stdout:056.out 2023-06-09T11:16:24.204 INFO:teuthology.orchestra.run.smithi078.stdout:057 2023-06-09T11:16:24.205 INFO:teuthology.orchestra.run.smithi078.stdout:057.out 2023-06-09T11:16:24.205 INFO:teuthology.orchestra.run.smithi078.stdout:058 2023-06-09T11:16:24.205 INFO:teuthology.orchestra.run.smithi078.stdout:058.out 2023-06-09T11:16:24.205 INFO:teuthology.orchestra.run.smithi078.stdout:059 2023-06-09T11:16:24.206 INFO:teuthology.orchestra.run.smithi078.stdout:059.out 2023-06-09T11:16:24.206 INFO:teuthology.orchestra.run.smithi078.stdout:060 2023-06-09T11:16:24.206 INFO:teuthology.orchestra.run.smithi078.stdout:060.out 2023-06-09T11:16:24.206 INFO:teuthology.orchestra.run.smithi078.stdout:061 2023-06-09T11:16:24.207 INFO:teuthology.orchestra.run.smithi078.stdout:061.out 2023-06-09T11:16:24.207 INFO:teuthology.orchestra.run.smithi078.stdout:062 2023-06-09T11:16:24.207 INFO:teuthology.orchestra.run.smithi078.stdout:062.out 2023-06-09T11:16:24.207 INFO:teuthology.orchestra.run.smithi078.stdout:063 2023-06-09T11:16:24.207 INFO:teuthology.orchestra.run.smithi078.stdout:063.out 2023-06-09T11:16:24.207 INFO:teuthology.orchestra.run.smithi078.stdout:064 2023-06-09T11:16:24.208 INFO:teuthology.orchestra.run.smithi078.stdout:064.out 2023-06-09T11:16:24.208 INFO:teuthology.orchestra.run.smithi078.stdout:065 2023-06-09T11:16:24.208 INFO:teuthology.orchestra.run.smithi078.stdout:065.out 2023-06-09T11:16:24.208 INFO:teuthology.orchestra.run.smithi078.stdout:066 2023-06-09T11:16:24.208 INFO:teuthology.orchestra.run.smithi078.stdout:066.out 2023-06-09T11:16:24.209 INFO:teuthology.orchestra.run.smithi078.stdout:067 2023-06-09T11:16:24.209 INFO:teuthology.orchestra.run.smithi078.stdout:067.out 2023-06-09T11:16:24.209 INFO:teuthology.orchestra.run.smithi078.stdout:068 2023-06-09T11:16:24.209 INFO:teuthology.orchestra.run.smithi078.stdout:068.out 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:069 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:069.out 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:070 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:070.out 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:071 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:071.out 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:072 2023-06-09T11:16:24.210 INFO:teuthology.orchestra.run.smithi078.stdout:072.out 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:073 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:073.out 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:074 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:074.out 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:075 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:075.out 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:076 2023-06-09T11:16:24.211 INFO:teuthology.orchestra.run.smithi078.stdout:076.out 2023-06-09T11:16:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:077 2023-06-09T11:16:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:077.out 2023-06-09T11:16:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:078 2023-06-09T11:16:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:078.out 2023-06-09T11:16:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:079 2023-06-09T11:16:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:079.out 2023-06-09T11:16:24.212 INFO:teuthology.orchestra.run.smithi078.stdout:080 2023-06-09T11:16:24.213 INFO:teuthology.orchestra.run.smithi078.stdout:080.out 2023-06-09T11:16:24.213 INFO:teuthology.orchestra.run.smithi078.stdout:081 2023-06-09T11:16:24.213 INFO:teuthology.orchestra.run.smithi078.stdout:081.out 2023-06-09T11:16:24.214 INFO:teuthology.orchestra.run.smithi078.stdout:082 2023-06-09T11:16:24.214 INFO:teuthology.orchestra.run.smithi078.stdout:082.out 2023-06-09T11:16:24.214 INFO:teuthology.orchestra.run.smithi078.stdout:083 2023-06-09T11:16:24.214 INFO:teuthology.orchestra.run.smithi078.stdout:083.out 2023-06-09T11:16:24.215 INFO:teuthology.orchestra.run.smithi078.stdout:084 2023-06-09T11:16:24.215 INFO:teuthology.orchestra.run.smithi078.stdout:084.out 2023-06-09T11:16:24.215 INFO:teuthology.orchestra.run.smithi078.stdout:085 2023-06-09T11:16:24.215 INFO:teuthology.orchestra.run.smithi078.stdout:085.out 2023-06-09T11:16:24.215 INFO:teuthology.orchestra.run.smithi078.stdout:086 2023-06-09T11:16:24.215 INFO:teuthology.orchestra.run.smithi078.stdout:086.out 2023-06-09T11:16:24.215 INFO:teuthology.orchestra.run.smithi078.stdout:087 2023-06-09T11:16:24.216 INFO:teuthology.orchestra.run.smithi078.stdout:087.out 2023-06-09T11:16:24.216 INFO:teuthology.orchestra.run.smithi078.stdout:088 2023-06-09T11:16:24.216 INFO:teuthology.orchestra.run.smithi078.stdout:088.out 2023-06-09T11:16:24.216 INFO:teuthology.orchestra.run.smithi078.stdout:089 2023-06-09T11:16:24.217 INFO:teuthology.orchestra.run.smithi078.stdout:089.out 2023-06-09T11:16:24.217 INFO:teuthology.orchestra.run.smithi078.stdout:090 2023-06-09T11:16:24.217 INFO:teuthology.orchestra.run.smithi078.stdout:090.out 2023-06-09T11:16:24.217 INFO:teuthology.orchestra.run.smithi078.stdout:091 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:091.out 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:092 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:092.out 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:093 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:093.out 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:094 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:094.out 2023-06-09T11:16:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:095 2023-06-09T11:16:24.219 INFO:teuthology.orchestra.run.smithi078.stdout:095.out 2023-06-09T11:16:24.219 INFO:teuthology.orchestra.run.smithi078.stdout:096 2023-06-09T11:16:24.219 INFO:teuthology.orchestra.run.smithi078.stdout:096.out 2023-06-09T11:16:24.219 INFO:teuthology.orchestra.run.smithi078.stdout:097 2023-06-09T11:16:24.219 INFO:teuthology.orchestra.run.smithi078.stdout:097.out 2023-06-09T11:16:24.219 INFO:teuthology.orchestra.run.smithi078.stdout:098 2023-06-09T11:16:24.219 INFO:teuthology.orchestra.run.smithi078.stdout:098.out 2023-06-09T11:16:24.220 INFO:teuthology.orchestra.run.smithi078.stdout:099 2023-06-09T11:16:24.220 INFO:teuthology.orchestra.run.smithi078.stdout:099.out 2023-06-09T11:16:24.220 INFO:teuthology.orchestra.run.smithi078.stdout:100 2023-06-09T11:16:24.220 INFO:teuthology.orchestra.run.smithi078.stdout:100.out 2023-06-09T11:16:24.220 INFO:teuthology.orchestra.run.smithi078.stdout:101 2023-06-09T11:16:24.220 INFO:teuthology.orchestra.run.smithi078.stdout:101.out 2023-06-09T11:16:24.221 INFO:teuthology.orchestra.run.smithi078.stdout:102 2023-06-09T11:16:24.221 INFO:teuthology.orchestra.run.smithi078.stdout:102.out 2023-06-09T11:16:24.221 INFO:teuthology.orchestra.run.smithi078.stdout:103 2023-06-09T11:16:24.221 INFO:teuthology.orchestra.run.smithi078.stdout:103.out 2023-06-09T11:16:24.222 INFO:teuthology.orchestra.run.smithi078.stdout:104 2023-06-09T11:16:24.222 INFO:teuthology.orchestra.run.smithi078.stdout:104.out 2023-06-09T11:16:24.222 INFO:teuthology.orchestra.run.smithi078.stdout:105 2023-06-09T11:16:24.222 INFO:teuthology.orchestra.run.smithi078.stdout:105.out 2023-06-09T11:16:24.223 INFO:teuthology.orchestra.run.smithi078.stdout:106 2023-06-09T11:16:24.223 INFO:teuthology.orchestra.run.smithi078.stdout:106.out 2023-06-09T11:16:24.223 INFO:teuthology.orchestra.run.smithi078.stdout:107 2023-06-09T11:16:24.223 INFO:teuthology.orchestra.run.smithi078.stdout:107.out 2023-06-09T11:16:24.223 INFO:teuthology.orchestra.run.smithi078.stdout:108 2023-06-09T11:16:24.224 INFO:teuthology.orchestra.run.smithi078.stdout:108.out 2023-06-09T11:16:24.224 INFO:teuthology.orchestra.run.smithi078.stdout:109 2023-06-09T11:16:24.224 INFO:teuthology.orchestra.run.smithi078.stdout:109.out 2023-06-09T11:16:24.224 INFO:teuthology.orchestra.run.smithi078.stdout:110 2023-06-09T11:16:24.225 INFO:teuthology.orchestra.run.smithi078.stdout:110.out 2023-06-09T11:16:24.225 INFO:teuthology.orchestra.run.smithi078.stdout:111 2023-06-09T11:16:24.225 INFO:teuthology.orchestra.run.smithi078.stdout:111.out 2023-06-09T11:16:24.225 INFO:teuthology.orchestra.run.smithi078.stdout:112 2023-06-09T11:16:24.225 INFO:teuthology.orchestra.run.smithi078.stdout:112.out 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:113 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:113.out 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:114 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:114.out 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:115 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:115.out 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:116 2023-06-09T11:16:24.226 INFO:teuthology.orchestra.run.smithi078.stdout:116.out 2023-06-09T11:16:24.227 INFO:teuthology.orchestra.run.smithi078.stdout:117 2023-06-09T11:16:24.227 INFO:teuthology.orchestra.run.smithi078.stdout:117.out 2023-06-09T11:16:24.227 INFO:teuthology.orchestra.run.smithi078.stdout:118 2023-06-09T11:16:24.227 INFO:teuthology.orchestra.run.smithi078.stdout:118.out 2023-06-09T11:16:24.227 INFO:teuthology.orchestra.run.smithi078.stdout:119 2023-06-09T11:16:24.227 INFO:teuthology.orchestra.run.smithi078.stdout:119.out 2023-06-09T11:16:24.228 INFO:teuthology.orchestra.run.smithi078.stdout:120 2023-06-09T11:16:24.228 INFO:teuthology.orchestra.run.smithi078.stdout:120.out 2023-06-09T11:16:24.228 INFO:teuthology.orchestra.run.smithi078.stdout:121 2023-06-09T11:16:24.228 INFO:teuthology.orchestra.run.smithi078.stdout:121.out 2023-06-09T11:16:24.229 INFO:teuthology.orchestra.run.smithi078.stdout:122 2023-06-09T11:16:24.229 INFO:teuthology.orchestra.run.smithi078.stdout:122.out 2023-06-09T11:16:24.229 INFO:teuthology.orchestra.run.smithi078.stdout:123 2023-06-09T11:16:24.230 INFO:teuthology.orchestra.run.smithi078.stdout:123.out 2023-06-09T11:16:24.230 INFO:teuthology.orchestra.run.smithi078.stdout:124 2023-06-09T11:16:24.230 INFO:teuthology.orchestra.run.smithi078.stdout:124.out 2023-06-09T11:16:24.230 INFO:teuthology.orchestra.run.smithi078.stdout:125 2023-06-09T11:16:24.230 INFO:teuthology.orchestra.run.smithi078.stdout:125.out 2023-06-09T11:16:24.231 INFO:teuthology.orchestra.run.smithi078.stdout:126 2023-06-09T11:16:24.231 INFO:teuthology.orchestra.run.smithi078.stdout:126.out 2023-06-09T11:16:24.231 INFO:teuthology.orchestra.run.smithi078.stdout:127 2023-06-09T11:16:24.231 INFO:teuthology.orchestra.run.smithi078.stdout:127.out 2023-06-09T11:16:24.231 INFO:teuthology.orchestra.run.smithi078.stdout:128 2023-06-09T11:16:24.232 INFO:teuthology.orchestra.run.smithi078.stdout:128.out 2023-06-09T11:16:24.232 INFO:teuthology.orchestra.run.smithi078.stdout:129 2023-06-09T11:16:24.232 INFO:teuthology.orchestra.run.smithi078.stdout:129.out 2023-06-09T11:16:24.233 INFO:teuthology.orchestra.run.smithi078.stdout:130 2023-06-09T11:16:24.233 INFO:teuthology.orchestra.run.smithi078.stdout:130.out 2023-06-09T11:16:24.233 INFO:teuthology.orchestra.run.smithi078.stdout:131 2023-06-09T11:16:24.233 INFO:teuthology.orchestra.run.smithi078.stdout:131.out 2023-06-09T11:16:24.234 INFO:teuthology.orchestra.run.smithi078.stdout:132 2023-06-09T11:16:24.234 INFO:teuthology.orchestra.run.smithi078.stdout:132.out 2023-06-09T11:16:24.234 INFO:teuthology.orchestra.run.smithi078.stdout:133 2023-06-09T11:16:24.234 INFO:teuthology.orchestra.run.smithi078.stdout:133.out 2023-06-09T11:16:24.234 INFO:teuthology.orchestra.run.smithi078.stdout:134 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:134.out 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:135 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:135.out 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:136 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:136.out 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:137 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:137.out 2023-06-09T11:16:24.235 INFO:teuthology.orchestra.run.smithi078.stdout:138 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:138.out 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:139 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:139.out 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:140 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:140.out 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:141 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:141.out 2023-06-09T11:16:24.236 INFO:teuthology.orchestra.run.smithi078.stdout:142 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:142.out 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:143 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:143.out 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:144 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:144.out 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:145 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:145.out 2023-06-09T11:16:24.237 INFO:teuthology.orchestra.run.smithi078.stdout:146 2023-06-09T11:16:24.238 INFO:teuthology.orchestra.run.smithi078.stdout:146.out 2023-06-09T11:16:24.238 INFO:teuthology.orchestra.run.smithi078.stdout:147 2023-06-09T11:16:24.238 INFO:teuthology.orchestra.run.smithi078.stdout:147.out 2023-06-09T11:16:24.238 INFO:teuthology.orchestra.run.smithi078.stdout:148 2023-06-09T11:16:24.238 INFO:teuthology.orchestra.run.smithi078.stdout:148.out 2023-06-09T11:16:24.238 INFO:teuthology.orchestra.run.smithi078.stdout:149 2023-06-09T11:16:24.238 INFO:teuthology.orchestra.run.smithi078.stdout:149.out 2023-06-09T11:16:24.239 INFO:teuthology.orchestra.run.smithi078.stdout:150 2023-06-09T11:16:24.239 INFO:teuthology.orchestra.run.smithi078.stdout:150.out 2023-06-09T11:16:24.239 INFO:teuthology.orchestra.run.smithi078.stdout:151 2023-06-09T11:16:24.239 INFO:teuthology.orchestra.run.smithi078.stdout:151.out 2023-06-09T11:16:24.240 INFO:teuthology.orchestra.run.smithi078.stdout:152 2023-06-09T11:16:24.240 INFO:teuthology.orchestra.run.smithi078.stdout:152.out 2023-06-09T11:16:24.240 INFO:teuthology.orchestra.run.smithi078.stdout:153 2023-06-09T11:16:24.240 INFO:teuthology.orchestra.run.smithi078.stdout:153.out 2023-06-09T11:16:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:154 2023-06-09T11:16:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:154.out 2023-06-09T11:16:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:155 2023-06-09T11:16:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:155.out 2023-06-09T11:16:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:156 2023-06-09T11:16:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:156.out 2023-06-09T11:16:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:157 2023-06-09T11:16:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:157.out 2023-06-09T11:16:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:158 2023-06-09T11:16:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:158.out 2023-06-09T11:16:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:159 2023-06-09T11:16:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:159.out 2023-06-09T11:16:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:160 2023-06-09T11:16:24.242 INFO:teuthology.orchestra.run.smithi078.stdout:160.out 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:161 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:161.out 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:162 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:162.out 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:163 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:163.out 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:164 2023-06-09T11:16:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:164.out 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:165 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:165.out 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:166 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:166.out 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:167 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:167.out 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:168 2023-06-09T11:16:24.244 INFO:teuthology.orchestra.run.smithi078.stdout:168.out 2023-06-09T11:16:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:169 2023-06-09T11:16:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:169.out 2023-06-09T11:16:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:170 2023-06-09T11:16:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:170.out 2023-06-09T11:16:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:171 2023-06-09T11:16:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:171.out 2023-06-09T11:16:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:172 2023-06-09T11:16:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:172.out 2023-06-09T11:16:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:173 2023-06-09T11:16:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:173.out 2023-06-09T11:16:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:174 2023-06-09T11:16:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:174.out 2023-06-09T11:16:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:175 2023-06-09T11:16:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:175.out 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:176 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:176.out 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:177 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:177.out 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:178 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:178.out 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:179 2023-06-09T11:16:24.247 INFO:teuthology.orchestra.run.smithi078.stdout:179.out 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:180 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:180.out 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:181 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:181.out 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:182 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:182.out 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:183 2023-06-09T11:16:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:183.out 2023-06-09T11:16:24.249 INFO:teuthology.orchestra.run.smithi078.stdout:184 2023-06-09T11:16:24.249 INFO:teuthology.orchestra.run.smithi078.stdout:184.out 2023-06-09T11:16:24.249 INFO:teuthology.orchestra.run.smithi078.stdout:185 2023-06-09T11:16:24.249 INFO:teuthology.orchestra.run.smithi078.stdout:185.out 2023-06-09T11:16:24.249 INFO:teuthology.orchestra.run.smithi078.stdout:186 2023-06-09T11:16:24.249 INFO:teuthology.orchestra.run.smithi078.stdout:186.out 2023-06-09T11:16:24.250 INFO:teuthology.orchestra.run.smithi078.stdout:187 2023-06-09T11:16:24.250 INFO:teuthology.orchestra.run.smithi078.stdout:187.out 2023-06-09T11:16:24.250 INFO:teuthology.orchestra.run.smithi078.stdout:188 2023-06-09T11:16:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:188.out 2023-06-09T11:16:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:189 2023-06-09T11:16:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:189.out 2023-06-09T11:16:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:190 2023-06-09T11:16:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:190.out 2023-06-09T11:16:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:191 2023-06-09T11:16:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:191.out 2023-06-09T11:16:24.252 INFO:teuthology.orchestra.run.smithi078.stdout:192 2023-06-09T11:16:24.252 INFO:teuthology.orchestra.run.smithi078.stdout:192.out 2023-06-09T11:16:24.252 INFO:teuthology.orchestra.run.smithi078.stdout:193 2023-06-09T11:16:24.252 INFO:teuthology.orchestra.run.smithi078.stdout:193.out 2023-06-09T11:16:24.252 INFO:teuthology.orchestra.run.smithi078.stdout:194 2023-06-09T11:16:24.253 INFO:teuthology.orchestra.run.smithi078.stdout:194.out 2023-06-09T11:16:24.253 INFO:teuthology.orchestra.run.smithi078.stdout:195 2023-06-09T11:16:24.253 INFO:teuthology.orchestra.run.smithi078.stdout:195.out 2023-06-09T11:16:24.253 INFO:teuthology.orchestra.run.smithi078.stdout:196 2023-06-09T11:16:24.253 INFO:teuthology.orchestra.run.smithi078.stdout:196.out 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:197 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:197.out 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:198 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:198.out 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:199 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:199.out 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:200 2023-06-09T11:16:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:200.out 2023-06-09T11:16:24.255 INFO:teuthology.orchestra.run.smithi078.stdout:201 2023-06-09T11:16:24.255 INFO:teuthology.orchestra.run.smithi078.stdout:201.out 2023-06-09T11:16:24.255 INFO:teuthology.orchestra.run.smithi078.stdout:202 2023-06-09T11:16:24.255 INFO:teuthology.orchestra.run.smithi078.stdout:202.out 2023-06-09T11:16:24.256 INFO:teuthology.orchestra.run.smithi078.stdout:203 2023-06-09T11:16:24.256 INFO:teuthology.orchestra.run.smithi078.stdout:203.out 2023-06-09T11:16:24.256 INFO:teuthology.orchestra.run.smithi078.stdout:204 2023-06-09T11:16:24.256 INFO:teuthology.orchestra.run.smithi078.stdout:204.out 2023-06-09T11:16:24.257 INFO:teuthology.orchestra.run.smithi078.stdout:205 2023-06-09T11:16:24.257 INFO:teuthology.orchestra.run.smithi078.stdout:205.out 2023-06-09T11:16:24.257 INFO:teuthology.orchestra.run.smithi078.stdout:206 2023-06-09T11:16:24.257 INFO:teuthology.orchestra.run.smithi078.stdout:206.out 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:207 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:207.out 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:208 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:208.out 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:209 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:209.out 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:210 2023-06-09T11:16:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:210.out 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:211 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:211.out 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:212 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:212.out 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:213 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:213.out 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:214 2023-06-09T11:16:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:214.out 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:215 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:215.out 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:216 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:216.out 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:217 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:217.out 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:218 2023-06-09T11:16:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:218.out 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:219 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:219.out 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:220 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:220.out 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:221 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:221.out 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:222 2023-06-09T11:16:24.261 INFO:teuthology.orchestra.run.smithi078.stdout:222.out 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:223 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:223.out 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:224 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:224.out 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:225 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:225.out 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:226 2023-06-09T11:16:24.262 INFO:teuthology.orchestra.run.smithi078.stdout:226.out 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:227 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:227.out 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:228 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:228.out 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:229 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:229.out 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:230 2023-06-09T11:16:24.263 INFO:teuthology.orchestra.run.smithi078.stdout:230.out 2023-06-09T11:16:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:231 2023-06-09T11:16:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:231.out 2023-06-09T11:16:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:232 2023-06-09T11:16:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:232.out 2023-06-09T11:16:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:233 2023-06-09T11:16:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:233.out 2023-06-09T11:16:24.264 INFO:teuthology.orchestra.run.smithi078.stdout:234 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:234.out 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:235 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:235.out 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:236 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:236.out 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:237 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:237.out 2023-06-09T11:16:24.265 INFO:teuthology.orchestra.run.smithi078.stdout:238 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:238.out 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:239 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:239.out 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:240 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:240.out 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:241 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:241.out 2023-06-09T11:16:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:242 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:242.out 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:243 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:243.out 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:244 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:244.out 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:245 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:245.out 2023-06-09T11:16:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:246 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:246.out 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:247 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:247.out 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:248 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:248.out 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:249 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:249.out 2023-06-09T11:16:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:250 2023-06-09T11:16:24.269 INFO:teuthology.orchestra.run.smithi078.stdout:250.out 2023-06-09T11:16:24.269 INFO:teuthology.orchestra.run.smithi078.stdout:251 2023-06-09T11:16:24.269 INFO:teuthology.orchestra.run.smithi078.stdout:251.out 2023-06-09T11:16:24.269 INFO:teuthology.orchestra.run.smithi078.stdout:252 2023-06-09T11:16:24.269 INFO:teuthology.orchestra.run.smithi078.stdout:252.out 2023-06-09T11:16:24.270 INFO:teuthology.orchestra.run.smithi078.stdout:253 2023-06-09T11:16:24.270 INFO:teuthology.orchestra.run.smithi078.stdout:253.out 2023-06-09T11:16:24.270 INFO:teuthology.orchestra.run.smithi078.stdout:254 2023-06-09T11:16:24.270 INFO:teuthology.orchestra.run.smithi078.stdout:254.out 2023-06-09T11:16:24.271 INFO:teuthology.orchestra.run.smithi078.stdout:255 2023-06-09T11:16:24.271 INFO:teuthology.orchestra.run.smithi078.stdout:255.out 2023-06-09T11:16:24.271 INFO:teuthology.orchestra.run.smithi078.stdout:256 2023-06-09T11:16:24.271 INFO:teuthology.orchestra.run.smithi078.stdout:256.out 2023-06-09T11:16:24.271 INFO:teuthology.orchestra.run.smithi078.stdout:257 2023-06-09T11:16:24.271 INFO:teuthology.orchestra.run.smithi078.stdout:257.out 2023-06-09T11:16:24.272 INFO:teuthology.orchestra.run.smithi078.stdout:258 2023-06-09T11:16:24.272 INFO:teuthology.orchestra.run.smithi078.stdout:258.out 2023-06-09T11:16:24.272 INFO:teuthology.orchestra.run.smithi078.stdout:259 2023-06-09T11:16:24.272 INFO:teuthology.orchestra.run.smithi078.stdout:259.out 2023-06-09T11:16:24.272 INFO:teuthology.orchestra.run.smithi078.stdout:260 2023-06-09T11:16:24.272 INFO:teuthology.orchestra.run.smithi078.stdout:260.out 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:261 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:261.out 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:262 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:262.out 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:263 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:263.out 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:264 2023-06-09T11:16:24.273 INFO:teuthology.orchestra.run.smithi078.stdout:264.out 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:265 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:265.out 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:266 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:266.out 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:267 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:267.out 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:268 2023-06-09T11:16:24.274 INFO:teuthology.orchestra.run.smithi078.stdout:268.out 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:269 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:269.out 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:270 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:270.out 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:271 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:271.out 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:272 2023-06-09T11:16:24.275 INFO:teuthology.orchestra.run.smithi078.stdout:272.out 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:273 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:273.out 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:274 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:274.out 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:275 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:275.out 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:276 2023-06-09T11:16:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:276.out 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:277 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:277.out 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:278 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:278.out 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:279 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:279.out 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:280 2023-06-09T11:16:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:280.out 2023-06-09T11:16:24.278 INFO:teuthology.orchestra.run.smithi078.stdout:281 2023-06-09T11:16:24.278 INFO:teuthology.orchestra.run.smithi078.stdout:281.out 2023-06-09T11:16:24.278 INFO:teuthology.orchestra.run.smithi078.stdout:282 2023-06-09T11:16:24.278 INFO:teuthology.orchestra.run.smithi078.stdout:282.out 2023-06-09T11:16:24.278 INFO:teuthology.orchestra.run.smithi078.stdout:283 2023-06-09T11:16:24.279 INFO:teuthology.orchestra.run.smithi078.stdout:283.out 2023-06-09T11:16:24.279 INFO:teuthology.orchestra.run.smithi078.stdout:284 2023-06-09T11:16:24.279 INFO:teuthology.orchestra.run.smithi078.stdout:284.out 2023-06-09T11:16:24.279 INFO:teuthology.orchestra.run.smithi078.stdout:285 2023-06-09T11:16:24.280 INFO:teuthology.orchestra.run.smithi078.stdout:285.out 2023-06-09T11:16:24.280 INFO:teuthology.orchestra.run.smithi078.stdout:286 2023-06-09T11:16:24.280 INFO:teuthology.orchestra.run.smithi078.stdout:286.out 2023-06-09T11:16:24.280 INFO:teuthology.orchestra.run.smithi078.stdout:287 2023-06-09T11:16:24.280 INFO:teuthology.orchestra.run.smithi078.stdout:287.out 2023-06-09T11:16:24.280 INFO:teuthology.orchestra.run.smithi078.stdout:288 2023-06-09T11:16:24.280 INFO:teuthology.orchestra.run.smithi078.stdout:288.out 2023-06-09T11:16:24.281 INFO:teuthology.orchestra.run.smithi078.stdout:289 2023-06-09T11:16:24.281 INFO:teuthology.orchestra.run.smithi078.stdout:289.out 2023-06-09T11:16:24.281 INFO:teuthology.orchestra.run.smithi078.stdout:290 2023-06-09T11:16:24.281 INFO:teuthology.orchestra.run.smithi078.stdout:290.out 2023-06-09T11:16:24.282 INFO:teuthology.orchestra.run.smithi078.stdout:291 2023-06-09T11:16:24.282 INFO:teuthology.orchestra.run.smithi078.stdout:291.out 2023-06-09T11:16:24.282 INFO:teuthology.orchestra.run.smithi078.stdout:292 2023-06-09T11:16:24.282 INFO:teuthology.orchestra.run.smithi078.stdout:292.out 2023-06-09T11:16:24.283 INFO:teuthology.orchestra.run.smithi078.stdout:293 2023-06-09T11:16:24.283 INFO:teuthology.orchestra.run.smithi078.stdout:293.out 2023-06-09T11:16:24.283 INFO:teuthology.orchestra.run.smithi078.stdout:294 2023-06-09T11:16:24.283 INFO:teuthology.orchestra.run.smithi078.stdout:294.out 2023-06-09T11:16:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:295 2023-06-09T11:16:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:295.out 2023-06-09T11:16:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:296 2023-06-09T11:16:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:296.out 2023-06-09T11:16:24.285 INFO:teuthology.orchestra.run.smithi078.stdout:297 2023-06-09T11:16:24.285 INFO:teuthology.orchestra.run.smithi078.stdout:297.out 2023-06-09T11:16:24.285 INFO:teuthology.orchestra.run.smithi078.stdout:298 2023-06-09T11:16:24.285 INFO:teuthology.orchestra.run.smithi078.stdout:298.out 2023-06-09T11:16:24.286 INFO:teuthology.orchestra.run.smithi078.stdout:299 2023-06-09T11:16:24.286 INFO:teuthology.orchestra.run.smithi078.stdout:299.out 2023-06-09T11:16:24.286 INFO:teuthology.orchestra.run.smithi078.stdout:300 2023-06-09T11:16:24.286 INFO:teuthology.orchestra.run.smithi078.stdout:300.out 2023-06-09T11:16:24.287 INFO:teuthology.orchestra.run.smithi078.stdout:301 2023-06-09T11:16:24.287 INFO:teuthology.orchestra.run.smithi078.stdout:301.out 2023-06-09T11:16:24.287 INFO:teuthology.orchestra.run.smithi078.stdout:302 2023-06-09T11:16:24.287 INFO:teuthology.orchestra.run.smithi078.stdout:302.out 2023-06-09T11:16:24.288 INFO:teuthology.orchestra.run.smithi078.stdout:303 2023-06-09T11:16:24.288 INFO:teuthology.orchestra.run.smithi078.stdout:303.out 2023-06-09T11:16:24.288 INFO:teuthology.orchestra.run.smithi078.stdout:304 2023-06-09T11:16:24.289 INFO:teuthology.orchestra.run.smithi078.stdout:304.out 2023-06-09T11:16:24.289 INFO:teuthology.orchestra.run.smithi078.stdout:305 2023-06-09T11:16:24.289 INFO:teuthology.orchestra.run.smithi078.stdout:305.out 2023-06-09T11:16:24.289 INFO:teuthology.orchestra.run.smithi078.stdout:306 2023-06-09T11:16:24.290 INFO:teuthology.orchestra.run.smithi078.stdout:306.out 2023-06-09T11:16:24.290 INFO:teuthology.orchestra.run.smithi078.stdout:307 2023-06-09T11:16:24.290 INFO:teuthology.orchestra.run.smithi078.stdout:307.out 2023-06-09T11:16:24.290 INFO:teuthology.orchestra.run.smithi078.stdout:308 2023-06-09T11:16:24.291 INFO:teuthology.orchestra.run.smithi078.stdout:308.out 2023-06-09T11:16:24.291 INFO:teuthology.orchestra.run.smithi078.stdout:309 2023-06-09T11:16:24.291 INFO:teuthology.orchestra.run.smithi078.stdout:309.out 2023-06-09T11:16:24.291 INFO:teuthology.orchestra.run.smithi078.stdout:310 2023-06-09T11:16:24.292 INFO:teuthology.orchestra.run.smithi078.stdout:310.out 2023-06-09T11:16:24.292 INFO:teuthology.orchestra.run.smithi078.stdout:311 2023-06-09T11:16:24.292 INFO:teuthology.orchestra.run.smithi078.stdout:311.out 2023-06-09T11:16:24.292 INFO:teuthology.orchestra.run.smithi078.stdout:312 2023-06-09T11:16:24.293 INFO:teuthology.orchestra.run.smithi078.stdout:312.out 2023-06-09T11:16:24.293 INFO:teuthology.orchestra.run.smithi078.stdout:313 2023-06-09T11:16:24.293 INFO:teuthology.orchestra.run.smithi078.stdout:313.out 2023-06-09T11:16:24.293 INFO:teuthology.orchestra.run.smithi078.stdout:314 2023-06-09T11:16:24.294 INFO:teuthology.orchestra.run.smithi078.stdout:314.out 2023-06-09T11:16:24.294 INFO:teuthology.orchestra.run.smithi078.stdout:315 2023-06-09T11:16:24.294 INFO:teuthology.orchestra.run.smithi078.stdout:315.out 2023-06-09T11:16:24.295 INFO:teuthology.orchestra.run.smithi078.stdout:316 2023-06-09T11:16:24.295 INFO:teuthology.orchestra.run.smithi078.stdout:316.out 2023-06-09T11:16:24.295 INFO:teuthology.orchestra.run.smithi078.stdout:317 2023-06-09T11:16:24.295 INFO:teuthology.orchestra.run.smithi078.stdout:317.out 2023-06-09T11:16:24.296 INFO:teuthology.orchestra.run.smithi078.stdout:318 2023-06-09T11:16:24.296 INFO:teuthology.orchestra.run.smithi078.stdout:318.out 2023-06-09T11:16:24.296 INFO:teuthology.orchestra.run.smithi078.stdout:319 2023-06-09T11:16:24.296 INFO:teuthology.orchestra.run.smithi078.stdout:319.out 2023-06-09T11:16:24.297 INFO:teuthology.orchestra.run.smithi078.stdout:320 2023-06-09T11:16:24.297 INFO:teuthology.orchestra.run.smithi078.stdout:320.out 2023-06-09T11:16:24.297 INFO:teuthology.orchestra.run.smithi078.stdout:321 2023-06-09T11:16:24.297 INFO:teuthology.orchestra.run.smithi078.stdout:321.out 2023-06-09T11:16:24.297 INFO:teuthology.orchestra.run.smithi078.stdout:322 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:322.out 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:323 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:323.out 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:324 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:324.out 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:325 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:325.out 2023-06-09T11:16:24.298 INFO:teuthology.orchestra.run.smithi078.stdout:326 2023-06-09T11:16:24.299 INFO:teuthology.orchestra.run.smithi078.stdout:326.out 2023-06-09T11:16:24.299 INFO:teuthology.orchestra.run.smithi078.stdout:327 2023-06-09T11:16:24.299 INFO:teuthology.orchestra.run.smithi078.stdout:327.out 2023-06-09T11:16:24.299 INFO:teuthology.orchestra.run.smithi078.stdout:328 2023-06-09T11:16:24.299 INFO:teuthology.orchestra.run.smithi078.stdout:328.out 2023-06-09T11:16:24.299 INFO:teuthology.orchestra.run.smithi078.stdout:329 2023-06-09T11:16:24.299 INFO:teuthology.orchestra.run.smithi078.stdout:329.out 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:330 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:330.out 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:331 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:331.out 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:332 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:332.out 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:333 2023-06-09T11:16:24.300 INFO:teuthology.orchestra.run.smithi078.stdout:333.out 2023-06-09T11:16:24.301 INFO:teuthology.orchestra.run.smithi078.stdout:334 2023-06-09T11:16:24.301 INFO:teuthology.orchestra.run.smithi078.stdout:334.out 2023-06-09T11:16:24.301 INFO:teuthology.orchestra.run.smithi078.stdout:335 2023-06-09T11:16:24.301 INFO:teuthology.orchestra.run.smithi078.stdout:335.out 2023-06-09T11:16:24.301 INFO:teuthology.orchestra.run.smithi078.stdout:336 2023-06-09T11:16:24.301 INFO:teuthology.orchestra.run.smithi078.stdout:336.out 2023-06-09T11:16:24.301 INFO:teuthology.orchestra.run.smithi078.stdout:337 2023-06-09T11:16:24.302 INFO:teuthology.orchestra.run.smithi078.stdout:337.out 2023-06-09T11:16:24.302 INFO:teuthology.orchestra.run.smithi078.stdout:338 2023-06-09T11:16:24.302 INFO:teuthology.orchestra.run.smithi078.stdout:338.out 2023-06-09T11:16:24.302 INFO:teuthology.orchestra.run.smithi078.stdout:339 2023-06-09T11:16:24.303 INFO:teuthology.orchestra.run.smithi078.stdout:339.out 2023-06-09T11:16:24.303 INFO:teuthology.orchestra.run.smithi078.stdout:340 2023-06-09T11:16:24.303 INFO:teuthology.orchestra.run.smithi078.stdout:340.out 2023-06-09T11:16:24.303 INFO:teuthology.orchestra.run.smithi078.stdout:341 2023-06-09T11:16:24.304 INFO:teuthology.orchestra.run.smithi078.stdout:341.out 2023-06-09T11:16:24.304 INFO:teuthology.orchestra.run.smithi078.stdout:342 2023-06-09T11:16:24.304 INFO:teuthology.orchestra.run.smithi078.stdout:342.out 2023-06-09T11:16:24.304 INFO:teuthology.orchestra.run.smithi078.stdout:343 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:343.out 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:344 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:344.out 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:345 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:345.out 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:346 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:346.out 2023-06-09T11:16:24.305 INFO:teuthology.orchestra.run.smithi078.stdout:347 2023-06-09T11:16:24.306 INFO:teuthology.orchestra.run.smithi078.stdout:347.out 2023-06-09T11:16:24.306 INFO:teuthology.orchestra.run.smithi078.stdout:348 2023-06-09T11:16:24.306 INFO:teuthology.orchestra.run.smithi078.stdout:348.out 2023-06-09T11:16:24.306 INFO:teuthology.orchestra.run.smithi078.stdout:349 2023-06-09T11:16:24.306 INFO:teuthology.orchestra.run.smithi078.stdout:349.out 2023-06-09T11:16:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:350 2023-06-09T11:16:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:350.out 2023-06-09T11:16:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:351 2023-06-09T11:16:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:351.out 2023-06-09T11:16:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:352 2023-06-09T11:16:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:352.out 2023-06-09T11:16:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:353 2023-06-09T11:16:24.308 INFO:teuthology.orchestra.run.smithi078.stdout:353.out 2023-06-09T11:16:24.308 INFO:teuthology.orchestra.run.smithi078.stdout:354 2023-06-09T11:16:24.308 INFO:teuthology.orchestra.run.smithi078.stdout:354.out 2023-06-09T11:16:24.308 INFO:teuthology.orchestra.run.smithi078.stdout:355 2023-06-09T11:16:24.308 INFO:teuthology.orchestra.run.smithi078.stdout:355.out 2023-06-09T11:16:24.308 INFO:teuthology.orchestra.run.smithi078.stdout:356 2023-06-09T11:16:24.309 INFO:teuthology.orchestra.run.smithi078.stdout:356.out 2023-06-09T11:16:24.309 INFO:teuthology.orchestra.run.smithi078.stdout:357 2023-06-09T11:16:24.309 INFO:teuthology.orchestra.run.smithi078.stdout:357.out 2023-06-09T11:16:24.309 INFO:teuthology.orchestra.run.smithi078.stdout:358 2023-06-09T11:16:24.310 INFO:teuthology.orchestra.run.smithi078.stdout:358.out 2023-06-09T11:16:24.310 INFO:teuthology.orchestra.run.smithi078.stdout:359 2023-06-09T11:16:24.310 INFO:teuthology.orchestra.run.smithi078.stdout:359.out 2023-06-09T11:16:24.310 INFO:teuthology.orchestra.run.smithi078.stdout:360 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:360.out 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:361 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:361.out 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:362 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:362.out 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:363 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:363.out 2023-06-09T11:16:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:364 2023-06-09T11:16:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:364.out 2023-06-09T11:16:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:365 2023-06-09T11:16:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:365.out 2023-06-09T11:16:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:366 2023-06-09T11:16:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:366.out 2023-06-09T11:16:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:367 2023-06-09T11:16:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:367.out 2023-06-09T11:16:24.313 INFO:teuthology.orchestra.run.smithi078.stdout:368 2023-06-09T11:16:24.313 INFO:teuthology.orchestra.run.smithi078.stdout:368.out 2023-06-09T11:16:24.313 INFO:teuthology.orchestra.run.smithi078.stdout:369 2023-06-09T11:16:24.313 INFO:teuthology.orchestra.run.smithi078.stdout:369.out 2023-06-09T11:16:24.314 INFO:teuthology.orchestra.run.smithi078.stdout:370 2023-06-09T11:16:24.314 INFO:teuthology.orchestra.run.smithi078.stdout:370.out 2023-06-09T11:16:24.314 INFO:teuthology.orchestra.run.smithi078.stdout:371 2023-06-09T11:16:24.314 INFO:teuthology.orchestra.run.smithi078.stdout:371.out 2023-06-09T11:16:24.315 INFO:teuthology.orchestra.run.smithi078.stdout:372 2023-06-09T11:16:24.315 INFO:teuthology.orchestra.run.smithi078.stdout:372.out 2023-06-09T11:16:24.315 INFO:teuthology.orchestra.run.smithi078.stdout:373 2023-06-09T11:16:24.315 INFO:teuthology.orchestra.run.smithi078.stdout:373.out 2023-06-09T11:16:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:374 2023-06-09T11:16:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:374.out 2023-06-09T11:16:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:375 2023-06-09T11:16:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:375.out 2023-06-09T11:16:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:376 2023-06-09T11:16:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:376.out 2023-06-09T11:16:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:377 2023-06-09T11:16:24.317 INFO:teuthology.orchestra.run.smithi078.stdout:377.out 2023-06-09T11:16:24.317 INFO:teuthology.orchestra.run.smithi078.stdout:378 2023-06-09T11:16:24.317 INFO:teuthology.orchestra.run.smithi078.stdout:378.out 2023-06-09T11:16:24.317 INFO:teuthology.orchestra.run.smithi078.stdout:379 2023-06-09T11:16:24.317 INFO:teuthology.orchestra.run.smithi078.stdout:379.out 2023-06-09T11:16:24.318 INFO:teuthology.orchestra.run.smithi078.stdout:380 2023-06-09T11:16:24.318 INFO:teuthology.orchestra.run.smithi078.stdout:380.out 2023-06-09T11:16:24.318 INFO:teuthology.orchestra.run.smithi078.stdout:381 2023-06-09T11:16:24.319 INFO:teuthology.orchestra.run.smithi078.stdout:381.out 2023-06-09T11:16:24.319 INFO:teuthology.orchestra.run.smithi078.stdout:382 2023-06-09T11:16:24.319 INFO:teuthology.orchestra.run.smithi078.stdout:382.out 2023-06-09T11:16:24.319 INFO:teuthology.orchestra.run.smithi078.stdout:383 2023-06-09T11:16:24.320 INFO:teuthology.orchestra.run.smithi078.stdout:383.out 2023-06-09T11:16:24.320 INFO:teuthology.orchestra.run.smithi078.stdout:384 2023-06-09T11:16:24.320 INFO:teuthology.orchestra.run.smithi078.stdout:384.out 2023-06-09T11:16:24.321 INFO:teuthology.orchestra.run.smithi078.stdout:385 2023-06-09T11:16:24.321 INFO:teuthology.orchestra.run.smithi078.stdout:385.out 2023-06-09T11:16:24.321 INFO:teuthology.orchestra.run.smithi078.stdout:386 2023-06-09T11:16:24.321 INFO:teuthology.orchestra.run.smithi078.stdout:386.out 2023-06-09T11:16:24.322 INFO:teuthology.orchestra.run.smithi078.stdout:387 2023-06-09T11:16:24.322 INFO:teuthology.orchestra.run.smithi078.stdout:387.out 2023-06-09T11:16:24.322 INFO:teuthology.orchestra.run.smithi078.stdout:388 2023-06-09T11:16:24.322 INFO:teuthology.orchestra.run.smithi078.stdout:388.out 2023-06-09T11:16:24.323 INFO:teuthology.orchestra.run.smithi078.stdout:389 2023-06-09T11:16:24.323 INFO:teuthology.orchestra.run.smithi078.stdout:389.out 2023-06-09T11:16:24.323 INFO:teuthology.orchestra.run.smithi078.stdout:390 2023-06-09T11:16:24.323 INFO:teuthology.orchestra.run.smithi078.stdout:390.out 2023-06-09T11:16:24.324 INFO:teuthology.orchestra.run.smithi078.stdout:391 2023-06-09T11:16:24.324 INFO:teuthology.orchestra.run.smithi078.stdout:391.out 2023-06-09T11:16:24.324 INFO:teuthology.orchestra.run.smithi078.stdout:392 2023-06-09T11:16:24.325 INFO:teuthology.orchestra.run.smithi078.stdout:392.out 2023-06-09T11:16:24.325 INFO:teuthology.orchestra.run.smithi078.stdout:393 2023-06-09T11:16:24.325 INFO:teuthology.orchestra.run.smithi078.stdout:393.out 2023-06-09T11:16:24.325 INFO:teuthology.orchestra.run.smithi078.stdout:394 2023-06-09T11:16:24.326 INFO:teuthology.orchestra.run.smithi078.stdout:394.out 2023-06-09T11:16:24.326 INFO:teuthology.orchestra.run.smithi078.stdout:395 2023-06-09T11:16:24.326 INFO:teuthology.orchestra.run.smithi078.stdout:395.out 2023-06-09T11:16:24.326 INFO:teuthology.orchestra.run.smithi078.stdout:396 2023-06-09T11:16:24.327 INFO:teuthology.orchestra.run.smithi078.stdout:396.out 2023-06-09T11:16:24.327 INFO:teuthology.orchestra.run.smithi078.stdout:397 2023-06-09T11:16:24.327 INFO:teuthology.orchestra.run.smithi078.stdout:397.out 2023-06-09T11:16:24.327 INFO:teuthology.orchestra.run.smithi078.stdout:398 2023-06-09T11:16:24.328 INFO:teuthology.orchestra.run.smithi078.stdout:398.out 2023-06-09T11:16:24.328 INFO:teuthology.orchestra.run.smithi078.stdout:399 2023-06-09T11:16:24.328 INFO:teuthology.orchestra.run.smithi078.stdout:399.out 2023-06-09T11:16:24.328 INFO:teuthology.orchestra.run.smithi078.stdout:400 2023-06-09T11:16:24.329 INFO:teuthology.orchestra.run.smithi078.stdout:400.out 2023-06-09T11:16:24.329 INFO:teuthology.orchestra.run.smithi078.stdout:401 2023-06-09T11:16:24.329 INFO:teuthology.orchestra.run.smithi078.stdout:401.out 2023-06-09T11:16:24.330 INFO:teuthology.orchestra.run.smithi078.stdout:402 2023-06-09T11:16:24.330 INFO:teuthology.orchestra.run.smithi078.stdout:402.out 2023-06-09T11:16:24.330 INFO:teuthology.orchestra.run.smithi078.stdout:403 2023-06-09T11:16:24.330 INFO:teuthology.orchestra.run.smithi078.stdout:403.out 2023-06-09T11:16:24.331 INFO:teuthology.orchestra.run.smithi078.stdout:404 2023-06-09T11:16:24.331 INFO:teuthology.orchestra.run.smithi078.stdout:404.out 2023-06-09T11:16:24.331 INFO:teuthology.orchestra.run.smithi078.stdout:405 2023-06-09T11:16:24.331 INFO:teuthology.orchestra.run.smithi078.stdout:405.out 2023-06-09T11:16:24.332 INFO:teuthology.orchestra.run.smithi078.stdout:406 2023-06-09T11:16:24.332 INFO:teuthology.orchestra.run.smithi078.stdout:406.out 2023-06-09T11:16:24.332 INFO:teuthology.orchestra.run.smithi078.stdout:407 2023-06-09T11:16:24.333 INFO:teuthology.orchestra.run.smithi078.stdout:407.out 2023-06-09T11:16:24.333 INFO:teuthology.orchestra.run.smithi078.stdout:408 2023-06-09T11:16:24.333 INFO:teuthology.orchestra.run.smithi078.stdout:408.out 2023-06-09T11:16:24.333 INFO:teuthology.orchestra.run.smithi078.stdout:409 2023-06-09T11:16:24.334 INFO:teuthology.orchestra.run.smithi078.stdout:409.out 2023-06-09T11:16:24.334 INFO:teuthology.orchestra.run.smithi078.stdout:410 2023-06-09T11:16:24.334 INFO:teuthology.orchestra.run.smithi078.stdout:410.out 2023-06-09T11:16:24.334 INFO:teuthology.orchestra.run.smithi078.stdout:411 2023-06-09T11:16:24.335 INFO:teuthology.orchestra.run.smithi078.stdout:411.out 2023-06-09T11:16:24.335 INFO:teuthology.orchestra.run.smithi078.stdout:412 2023-06-09T11:16:24.335 INFO:teuthology.orchestra.run.smithi078.stdout:412.out 2023-06-09T11:16:24.335 INFO:teuthology.orchestra.run.smithi078.stdout:413 2023-06-09T11:16:24.336 INFO:teuthology.orchestra.run.smithi078.stdout:413.out 2023-06-09T11:16:24.336 INFO:teuthology.orchestra.run.smithi078.stdout:414 2023-06-09T11:16:24.336 INFO:teuthology.orchestra.run.smithi078.stdout:414.out 2023-06-09T11:16:24.337 INFO:teuthology.orchestra.run.smithi078.stdout:415 2023-06-09T11:16:24.337 INFO:teuthology.orchestra.run.smithi078.stdout:415.out 2023-06-09T11:16:24.337 INFO:teuthology.orchestra.run.smithi078.stdout:416 2023-06-09T11:16:24.337 INFO:teuthology.orchestra.run.smithi078.stdout:416.out 2023-06-09T11:16:24.338 INFO:teuthology.orchestra.run.smithi078.stdout:417 2023-06-09T11:16:24.338 INFO:teuthology.orchestra.run.smithi078.stdout:417.out 2023-06-09T11:16:24.338 INFO:teuthology.orchestra.run.smithi078.stdout:418 2023-06-09T11:16:24.338 INFO:teuthology.orchestra.run.smithi078.stdout:418.out 2023-06-09T11:16:24.339 INFO:teuthology.orchestra.run.smithi078.stdout:419 2023-06-09T11:16:24.339 INFO:teuthology.orchestra.run.smithi078.stdout:419.out 2023-06-09T11:16:24.339 INFO:teuthology.orchestra.run.smithi078.stdout:420 2023-06-09T11:16:24.340 INFO:teuthology.orchestra.run.smithi078.stdout:420.out 2023-06-09T11:16:24.340 INFO:teuthology.orchestra.run.smithi078.stdout:421 2023-06-09T11:16:24.340 INFO:teuthology.orchestra.run.smithi078.stdout:421.out 2023-06-09T11:16:24.340 INFO:teuthology.orchestra.run.smithi078.stdout:422 2023-06-09T11:16:24.341 INFO:teuthology.orchestra.run.smithi078.stdout:422.out 2023-06-09T11:16:24.341 INFO:teuthology.orchestra.run.smithi078.stdout:423 2023-06-09T11:16:24.341 INFO:teuthology.orchestra.run.smithi078.stdout:423.out 2023-06-09T11:16:24.342 INFO:teuthology.orchestra.run.smithi078.stdout:424 2023-06-09T11:16:24.342 INFO:teuthology.orchestra.run.smithi078.stdout:424.out 2023-06-09T11:16:24.342 INFO:teuthology.orchestra.run.smithi078.stdout:425 2023-06-09T11:16:24.342 INFO:teuthology.orchestra.run.smithi078.stdout:425.out 2023-06-09T11:16:24.343 INFO:teuthology.orchestra.run.smithi078.stdout:426 2023-06-09T11:16:24.343 INFO:teuthology.orchestra.run.smithi078.stdout:426.out 2023-06-09T11:16:24.343 INFO:teuthology.orchestra.run.smithi078.stdout:427 2023-06-09T11:16:24.343 INFO:teuthology.orchestra.run.smithi078.stdout:427.out 2023-06-09T11:16:24.344 INFO:teuthology.orchestra.run.smithi078.stdout:428 2023-06-09T11:16:24.344 INFO:teuthology.orchestra.run.smithi078.stdout:428.out 2023-06-09T11:16:24.344 INFO:teuthology.orchestra.run.smithi078.stdout:429 2023-06-09T11:16:24.344 INFO:teuthology.orchestra.run.smithi078.stdout:429.out 2023-06-09T11:16:24.345 INFO:teuthology.orchestra.run.smithi078.stdout:430 2023-06-09T11:16:24.345 INFO:teuthology.orchestra.run.smithi078.stdout:430.out 2023-06-09T11:16:24.345 INFO:teuthology.orchestra.run.smithi078.stdout:431 2023-06-09T11:16:24.346 INFO:teuthology.orchestra.run.smithi078.stdout:431.out 2023-06-09T11:16:24.346 INFO:teuthology.orchestra.run.smithi078.stdout:432 2023-06-09T11:16:24.346 INFO:teuthology.orchestra.run.smithi078.stdout:432.out 2023-06-09T11:16:24.346 INFO:teuthology.orchestra.run.smithi078.stdout:433 2023-06-09T11:16:24.347 INFO:teuthology.orchestra.run.smithi078.stdout:433.out 2023-06-09T11:16:24.347 INFO:teuthology.orchestra.run.smithi078.stdout:434 2023-06-09T11:16:24.347 INFO:teuthology.orchestra.run.smithi078.stdout:434.out 2023-06-09T11:16:24.347 INFO:teuthology.orchestra.run.smithi078.stdout:435 2023-06-09T11:16:24.348 INFO:teuthology.orchestra.run.smithi078.stdout:435.out 2023-06-09T11:16:24.348 INFO:teuthology.orchestra.run.smithi078.stdout:436 2023-06-09T11:16:24.348 INFO:teuthology.orchestra.run.smithi078.stdout:436.out 2023-06-09T11:16:24.349 INFO:teuthology.orchestra.run.smithi078.stdout:437 2023-06-09T11:16:24.349 INFO:teuthology.orchestra.run.smithi078.stdout:437.out 2023-06-09T11:16:24.349 INFO:teuthology.orchestra.run.smithi078.stdout:438 2023-06-09T11:16:24.349 INFO:teuthology.orchestra.run.smithi078.stdout:438.out 2023-06-09T11:16:24.350 INFO:teuthology.orchestra.run.smithi078.stdout:439 2023-06-09T11:16:24.350 INFO:teuthology.orchestra.run.smithi078.stdout:439.out 2023-06-09T11:16:24.350 INFO:teuthology.orchestra.run.smithi078.stdout:440 2023-06-09T11:16:24.350 INFO:teuthology.orchestra.run.smithi078.stdout:440.out 2023-06-09T11:16:24.351 INFO:teuthology.orchestra.run.smithi078.stdout:441 2023-06-09T11:16:24.351 INFO:teuthology.orchestra.run.smithi078.stdout:441.out 2023-06-09T11:16:24.351 INFO:teuthology.orchestra.run.smithi078.stdout:442 2023-06-09T11:16:24.352 INFO:teuthology.orchestra.run.smithi078.stdout:442.out 2023-06-09T11:16:24.352 INFO:teuthology.orchestra.run.smithi078.stdout:443 2023-06-09T11:16:24.352 INFO:teuthology.orchestra.run.smithi078.stdout:443.out 2023-06-09T11:16:24.352 INFO:teuthology.orchestra.run.smithi078.stdout:444 2023-06-09T11:16:24.353 INFO:teuthology.orchestra.run.smithi078.stdout:444.out 2023-06-09T11:16:24.353 INFO:teuthology.orchestra.run.smithi078.stdout:445 2023-06-09T11:16:24.353 INFO:teuthology.orchestra.run.smithi078.stdout:445.out 2023-06-09T11:16:24.353 INFO:teuthology.orchestra.run.smithi078.stdout:446 2023-06-09T11:16:24.354 INFO:teuthology.orchestra.run.smithi078.stdout:446.out 2023-06-09T11:16:24.354 INFO:teuthology.orchestra.run.smithi078.stdout:447 2023-06-09T11:16:24.354 INFO:teuthology.orchestra.run.smithi078.stdout:447.out 2023-06-09T11:16:24.355 INFO:teuthology.orchestra.run.smithi078.stdout:448 2023-06-09T11:16:24.355 INFO:teuthology.orchestra.run.smithi078.stdout:448.out 2023-06-09T11:16:24.355 INFO:teuthology.orchestra.run.smithi078.stdout:449 2023-06-09T11:16:24.355 INFO:teuthology.orchestra.run.smithi078.stdout:449.out 2023-06-09T11:16:24.356 INFO:teuthology.orchestra.run.smithi078.stdout:450 2023-06-09T11:16:24.356 INFO:teuthology.orchestra.run.smithi078.stdout:450.out 2023-06-09T11:16:24.356 INFO:teuthology.orchestra.run.smithi078.stdout:451 2023-06-09T11:16:24.356 INFO:teuthology.orchestra.run.smithi078.stdout:451.out 2023-06-09T11:16:24.357 INFO:teuthology.orchestra.run.smithi078.stdout:452 2023-06-09T11:16:24.357 INFO:teuthology.orchestra.run.smithi078.stdout:452.out 2023-06-09T11:16:24.357 INFO:teuthology.orchestra.run.smithi078.stdout:453 2023-06-09T11:16:24.358 INFO:teuthology.orchestra.run.smithi078.stdout:453.out 2023-06-09T11:16:24.358 INFO:teuthology.orchestra.run.smithi078.stdout:454 2023-06-09T11:16:24.358 INFO:teuthology.orchestra.run.smithi078.stdout:454.out 2023-06-09T11:16:24.358 INFO:teuthology.orchestra.run.smithi078.stdout:455 2023-06-09T11:16:24.359 INFO:teuthology.orchestra.run.smithi078.stdout:455.out 2023-06-09T11:16:24.359 INFO:teuthology.orchestra.run.smithi078.stdout:456 2023-06-09T11:16:24.359 INFO:teuthology.orchestra.run.smithi078.stdout:456.out 2023-06-09T11:16:24.359 INFO:teuthology.orchestra.run.smithi078.stdout:457 2023-06-09T11:16:24.360 INFO:teuthology.orchestra.run.smithi078.stdout:457.out 2023-06-09T11:16:24.360 INFO:teuthology.orchestra.run.smithi078.stdout:458 2023-06-09T11:16:24.360 INFO:teuthology.orchestra.run.smithi078.stdout:458.out 2023-06-09T11:16:24.361 INFO:teuthology.orchestra.run.smithi078.stdout:459 2023-06-09T11:16:24.361 INFO:teuthology.orchestra.run.smithi078.stdout:459.out 2023-06-09T11:16:24.361 INFO:teuthology.orchestra.run.smithi078.stdout:460 2023-06-09T11:16:24.361 INFO:teuthology.orchestra.run.smithi078.stdout:460.out 2023-06-09T11:16:24.362 INFO:teuthology.orchestra.run.smithi078.stdout:461 2023-06-09T11:16:24.362 INFO:teuthology.orchestra.run.smithi078.stdout:461.out 2023-06-09T11:16:24.362 INFO:teuthology.orchestra.run.smithi078.stdout:462 2023-06-09T11:16:24.362 INFO:teuthology.orchestra.run.smithi078.stdout:462.out 2023-06-09T11:16:24.363 INFO:teuthology.orchestra.run.smithi078.stdout:463 2023-06-09T11:16:24.363 INFO:teuthology.orchestra.run.smithi078.stdout:463.out 2023-06-09T11:16:24.363 INFO:teuthology.orchestra.run.smithi078.stdout:464 2023-06-09T11:16:24.363 INFO:teuthology.orchestra.run.smithi078.stdout:464.out 2023-06-09T11:16:24.364 INFO:teuthology.orchestra.run.smithi078.stdout:465 2023-06-09T11:16:24.364 INFO:teuthology.orchestra.run.smithi078.stdout:465.out 2023-06-09T11:16:24.364 INFO:teuthology.orchestra.run.smithi078.stdout:466 2023-06-09T11:16:24.365 INFO:teuthology.orchestra.run.smithi078.stdout:466.out 2023-06-09T11:16:24.365 INFO:teuthology.orchestra.run.smithi078.stdout:467 2023-06-09T11:16:24.365 INFO:teuthology.orchestra.run.smithi078.stdout:467.out 2023-06-09T11:16:24.365 INFO:teuthology.orchestra.run.smithi078.stdout:468 2023-06-09T11:16:24.366 INFO:teuthology.orchestra.run.smithi078.stdout:468.out 2023-06-09T11:16:24.366 INFO:teuthology.orchestra.run.smithi078.stdout:469 2023-06-09T11:16:24.366 INFO:teuthology.orchestra.run.smithi078.stdout:469.out 2023-06-09T11:16:24.366 INFO:teuthology.orchestra.run.smithi078.stdout:470 2023-06-09T11:16:24.367 INFO:teuthology.orchestra.run.smithi078.stdout:470.out 2023-06-09T11:16:24.367 INFO:teuthology.orchestra.run.smithi078.stdout:471 2023-06-09T11:16:24.367 INFO:teuthology.orchestra.run.smithi078.stdout:471.out 2023-06-09T11:16:24.368 INFO:teuthology.orchestra.run.smithi078.stdout:472 2023-06-09T11:16:24.368 INFO:teuthology.orchestra.run.smithi078.stdout:472.out 2023-06-09T11:16:24.368 INFO:teuthology.orchestra.run.smithi078.stdout:473 2023-06-09T11:16:24.368 INFO:teuthology.orchestra.run.smithi078.stdout:473.out 2023-06-09T11:16:24.369 INFO:teuthology.orchestra.run.smithi078.stdout:474 2023-06-09T11:16:24.369 INFO:teuthology.orchestra.run.smithi078.stdout:474.out 2023-06-09T11:16:24.369 INFO:teuthology.orchestra.run.smithi078.stdout:475 2023-06-09T11:16:24.369 INFO:teuthology.orchestra.run.smithi078.stdout:475.out 2023-06-09T11:16:24.370 INFO:teuthology.orchestra.run.smithi078.stdout:476 2023-06-09T11:16:24.370 INFO:teuthology.orchestra.run.smithi078.stdout:476.out 2023-06-09T11:16:24.370 INFO:teuthology.orchestra.run.smithi078.stdout:477 2023-06-09T11:16:24.370 INFO:teuthology.orchestra.run.smithi078.stdout:477.out 2023-06-09T11:16:24.371 INFO:teuthology.orchestra.run.smithi078.stdout:478 2023-06-09T11:16:24.371 INFO:teuthology.orchestra.run.smithi078.stdout:478.out 2023-06-09T11:16:24.371 INFO:teuthology.orchestra.run.smithi078.stdout:479 2023-06-09T11:16:24.372 INFO:teuthology.orchestra.run.smithi078.stdout:479.out 2023-06-09T11:16:24.372 INFO:teuthology.orchestra.run.smithi078.stdout:480 2023-06-09T11:16:24.372 INFO:teuthology.orchestra.run.smithi078.stdout:480.out 2023-06-09T11:16:24.372 INFO:teuthology.orchestra.run.smithi078.stdout:481 2023-06-09T11:16:24.372 INFO:teuthology.orchestra.run.smithi078.stdout:481.out 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:482 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:482.out 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:483 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:483.out 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:484 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:484.out 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:485 2023-06-09T11:16:24.373 INFO:teuthology.orchestra.run.smithi078.stdout:485.out 2023-06-09T11:16:24.374 INFO:teuthology.orchestra.run.smithi078.stdout:486 2023-06-09T11:16:24.374 INFO:teuthology.orchestra.run.smithi078.stdout:486.out 2023-06-09T11:16:24.374 INFO:teuthology.orchestra.run.smithi078.stdout:487 2023-06-09T11:16:24.374 INFO:teuthology.orchestra.run.smithi078.stdout:487.out 2023-06-09T11:16:24.374 INFO:teuthology.orchestra.run.smithi078.stdout:488 2023-06-09T11:16:24.374 INFO:teuthology.orchestra.run.smithi078.stdout:488.out 2023-06-09T11:16:24.374 INFO:teuthology.orchestra.run.smithi078.stdout:489 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:489.out 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:490 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:490.out 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:491 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:491.out 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:492 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:492.out 2023-06-09T11:16:24.375 INFO:teuthology.orchestra.run.smithi078.stdout:493 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:493.out 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:494 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:494.out 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:495 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:495.out 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:496 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:496.out 2023-06-09T11:16:24.376 INFO:teuthology.orchestra.run.smithi078.stdout:497 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:497.out 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:498 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:498.out 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:499 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:499.out 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:500 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:500.out 2023-06-09T11:16:24.377 INFO:teuthology.orchestra.run.smithi078.stdout:501 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:501.out 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:502 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:502.out 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:503 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:503.out 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:504 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:504.out 2023-06-09T11:16:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:505 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:505.out 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:506 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:506.out 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:507 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:507.out 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:508 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:508.out 2023-06-09T11:16:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:509 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:509.out 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:510 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:510.out 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:511 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:511.out 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:512 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:512.out 2023-06-09T11:16:24.380 INFO:teuthology.orchestra.run.smithi078.stdout:513 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:513.out 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:514 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:514.out 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:515 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:515.out 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:516 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:516.out 2023-06-09T11:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:517 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:517.out 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:518 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:518.out 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:519 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:519.out 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:520 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:520.out 2023-06-09T11:16:24.382 INFO:teuthology.orchestra.run.smithi078.stdout:521 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:521.out 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:522 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:522.out 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:523 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:523.out 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:524 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:524.out 2023-06-09T11:16:24.383 INFO:teuthology.orchestra.run.smithi078.stdout:525 2023-06-09T11:16:24.384 INFO:teuthology.orchestra.run.smithi078.stdout:525.out 2023-06-09T11:16:24.384 INFO:teuthology.orchestra.run.smithi078.stdout:526 2023-06-09T11:16:24.384 INFO:teuthology.orchestra.run.smithi078.stdout:526.out 2023-06-09T11:16:24.384 INFO:teuthology.orchestra.run.smithi078.stdout:527 2023-06-09T11:16:24.384 INFO:teuthology.orchestra.run.smithi078.stdout:527.out 2023-06-09T11:16:24.384 INFO:teuthology.orchestra.run.smithi078.stdout:528 2023-06-09T11:16:24.384 INFO:teuthology.orchestra.run.smithi078.stdout:528.out 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:529 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:529.out 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:530 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:530.out 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:531 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:531.out 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:532 2023-06-09T11:16:24.385 INFO:teuthology.orchestra.run.smithi078.stdout:532.out 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:533 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:533.out 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:534 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:534.out 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:535 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:535.out 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:536 2023-06-09T11:16:24.386 INFO:teuthology.orchestra.run.smithi078.stdout:536.out 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:537 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:537.out 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:538 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:538.out 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:539 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:539.out 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:540 2023-06-09T11:16:24.387 INFO:teuthology.orchestra.run.smithi078.stdout:540.out 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:541 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:541.out 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:542 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:542.out 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:543 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:543.out 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:544 2023-06-09T11:16:24.388 INFO:teuthology.orchestra.run.smithi078.stdout:544.out 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:545 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:545.out 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:546 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:546.out 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:547 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:547.out 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:548 2023-06-09T11:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:548.out 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:549 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:549.out 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:550 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:550.out 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:551 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:551.out 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:552 2023-06-09T11:16:24.390 INFO:teuthology.orchestra.run.smithi078.stdout:552.out 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:553 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:553.out 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:554 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:554.out 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:555 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:555.out 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:556 2023-06-09T11:16:24.391 INFO:teuthology.orchestra.run.smithi078.stdout:556.out 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:557 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:557.out 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:558 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:558.out 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:559 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:559.out 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:560 2023-06-09T11:16:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:560.out 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:561 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:561.out 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:562 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:562.out 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:563 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:563.out 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:564 2023-06-09T11:16:24.393 INFO:teuthology.orchestra.run.smithi078.stdout:564.out 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:565 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:565.out 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:566 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:566.out 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:567 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:567.out 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:568 2023-06-09T11:16:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:568.out 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:569 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:569.out 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:570 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:570.out 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:571 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:571.out 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:572 2023-06-09T11:16:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:572.out 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:573 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:573.out 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:574 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:574.out 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:575 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:575.out 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:576 2023-06-09T11:16:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:576.out 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:577 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:577.out 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:578 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:578.out 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:579 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:579.out 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:580 2023-06-09T11:16:24.397 INFO:teuthology.orchestra.run.smithi078.stdout:580.out 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:581 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:581.out 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:582 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:582.out 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:583 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:583.out 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:584 2023-06-09T11:16:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:584.out 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:585 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:585.out 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:586 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:586.out 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:587 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:587.out 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:588 2023-06-09T11:16:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:588.out 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:589 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:589.out 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:590 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:590.out 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:591 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:591.out 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:592 2023-06-09T11:16:24.400 INFO:teuthology.orchestra.run.smithi078.stdout:592.out 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:593 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:593.out 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:594 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:594.out 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:595 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:595.out 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:596 2023-06-09T11:16:24.401 INFO:teuthology.orchestra.run.smithi078.stdout:596.out 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:597 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:597.out 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:598 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:598.out 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:599 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:599.out 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:600 2023-06-09T11:16:24.402 INFO:teuthology.orchestra.run.smithi078.stdout:600.out 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:601 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:601.out 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:602 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:602.out 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:603 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:603.out 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:604 2023-06-09T11:16:24.403 INFO:teuthology.orchestra.run.smithi078.stdout:604.out 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:605 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:605.out 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:606 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:606.out 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:607 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:607.out 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:608 2023-06-09T11:16:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:608.out 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:609 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:609.out 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:610 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:610.out 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:611 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:611.out 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:612 2023-06-09T11:16:24.405 INFO:teuthology.orchestra.run.smithi078.stdout:612.out 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:613 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:613.out 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:614 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:614.out 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:615 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:615.out 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:616 2023-06-09T11:16:24.406 INFO:teuthology.orchestra.run.smithi078.stdout:616.out 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:617 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:617.out 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:618 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:618.out 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:619 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:619.out 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:620 2023-06-09T11:16:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:620.out 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:621 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:621.out 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:622 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:622.out 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:623 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:623.out 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:624 2023-06-09T11:16:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:624.out 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:625 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:625.out 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:626 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:626.out 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:627 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:627.out 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:628 2023-06-09T11:16:24.409 INFO:teuthology.orchestra.run.smithi078.stdout:628.out 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:629 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:629.out 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:630 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:630.out 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:631 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:631.out 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:632 2023-06-09T11:16:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:632.out 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:633 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:633.out 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:634 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:634.out 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:635 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:635.out 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:636 2023-06-09T11:16:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:636.out 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:637 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:637.out 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:638 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:638.out 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:639 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:639.out 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:640 2023-06-09T11:16:24.412 INFO:teuthology.orchestra.run.smithi078.stdout:640.out 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:641 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:641.out 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:642 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:642.out 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:643 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:643.out 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:644 2023-06-09T11:16:24.413 INFO:teuthology.orchestra.run.smithi078.stdout:644.out 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:645 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:645.out 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:646 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:646.out 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:647 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:647.out 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:648 2023-06-09T11:16:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:648.out 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:649 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:649.out 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:650 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:650.out 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:651 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:651.out 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:652 2023-06-09T11:16:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:652.out 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:653 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:653.out 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:654 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:654.out 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:655 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:655.out 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:656 2023-06-09T11:16:24.416 INFO:teuthology.orchestra.run.smithi078.stdout:656.out 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:657 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:657.out 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:658 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:658.out 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:659 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:659.out 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:660 2023-06-09T11:16:24.417 INFO:teuthology.orchestra.run.smithi078.stdout:660.out 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:661 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:661.out 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:662 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:662.out 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:663 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:663.out 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:664 2023-06-09T11:16:24.418 INFO:teuthology.orchestra.run.smithi078.stdout:664.out 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:665 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:665.out 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:666 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:666.out 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:667 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:667.out 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:668 2023-06-09T11:16:24.419 INFO:teuthology.orchestra.run.smithi078.stdout:668.out 2023-06-09T11:16:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:669 2023-06-09T11:16:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:669.out 2023-06-09T11:16:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:670 2023-06-09T11:16:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:670.out 2023-06-09T11:16:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:671 2023-06-09T11:16:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:671.out 2023-06-09T11:16:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:672 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:672.out 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:673 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:673.out 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:674 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:674.out 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:675 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:675.out 2023-06-09T11:16:24.421 INFO:teuthology.orchestra.run.smithi078.stdout:676 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:676.out 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:677 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:677.out 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:678 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:678.out 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:679 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:679.out 2023-06-09T11:16:24.422 INFO:teuthology.orchestra.run.smithi078.stdout:680 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:680.out 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:681 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:681.out 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:682 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:682.out 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:683 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:683.out 2023-06-09T11:16:24.423 INFO:teuthology.orchestra.run.smithi078.stdout:684 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:684.out 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:685 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:685.out 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:686 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:686.out 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:687 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:687.out 2023-06-09T11:16:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:688 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:688.out 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:689 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:689.out 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:690 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:690.out 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:691 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:691.out 2023-06-09T11:16:24.425 INFO:teuthology.orchestra.run.smithi078.stdout:692 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:692.out 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:693 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:693.out 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:694 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:694.out 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:695 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:695.out 2023-06-09T11:16:24.426 INFO:teuthology.orchestra.run.smithi078.stdout:696 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:696.out 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:697 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:697.out 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:698 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:698.out 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:699 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:699.out 2023-06-09T11:16:24.427 INFO:teuthology.orchestra.run.smithi078.stdout:700 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:700.out 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:701 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:701.out 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:702 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:702.out 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:703 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:703.out 2023-06-09T11:16:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:704 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:704.out 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:705 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:705.out 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:706 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:706.out 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:707 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:707.out 2023-06-09T11:16:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:708 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:708.out 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:709 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:709.out 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:710 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:710.out 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:711 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:711.out 2023-06-09T11:16:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:712 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:712.out 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:713 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:713.out 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:714 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:714.out 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:715 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:715.out 2023-06-09T11:16:24.431 INFO:teuthology.orchestra.run.smithi078.stdout:716 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:716.out 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:717 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:717.out 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:718 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:718.out 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:719 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:719.out 2023-06-09T11:16:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:720 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:720.out 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:721 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:721.out 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:722 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:722.out 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:723 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:723.out 2023-06-09T11:16:24.433 INFO:teuthology.orchestra.run.smithi078.stdout:724 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:724.out 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:725 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:725.out 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:726 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:726.out 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:727 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:727.out 2023-06-09T11:16:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:group.list 2023-06-09T11:16:24.435 INFO:teuthology.orchestra.run.smithi078.stdout:Makefile 2023-06-09T11:16:24.436 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-09T11:16:25.333 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:16:25.354 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:16:25.358 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:16:25.364 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:16:25.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:26.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:26.485 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:39.564 INFO:teuthology.orchestra.run.smithi078.stdout:generic/001 14s 2023-06-09T11:16:39.593 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/001 2023-06-09T11:16:39.594 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:16:39.607 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:40.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:16:40.105 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-09T11:16:40.871 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:16:40.893 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:16:40.896 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:16:40.902 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:16:40.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:42.558 INFO:teuthology.orchestra.run.smithi078.stdout:generic/002 1s 2023-06-09T11:16:42.581 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/002 2023-06-09T11:16:42.581 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:16:42.594 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:42.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:16:42.714 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-09T11:16:43.445 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:16:43.467 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:16:43.470 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:16:43.476 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:16:43.476 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:44.394 INFO:teuthology.orchestra.run.smithi078.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-09T11:16:44.413 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/003 2023-06-09T11:16:44.413 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/003 2023-06-09T11:16:44.413 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:16:44.425 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:44.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:16:44.507 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-09T11:16:45.243 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:16:45.262 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:16:45.266 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:16:45.272 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:16:45.272 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:46.213 INFO:teuthology.orchestra.run.smithi078.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-09T11:16:46.231 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/004 2023-06-09T11:16:46.231 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/004 2023-06-09T11:16:46.231 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:16:46.244 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:46.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:16:46.326 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-09T11:16:47.052 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:16:47.074 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:16:47.077 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:16:47.083 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:16:47.083 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:48.554 INFO:teuthology.orchestra.run.smithi078.stdout:generic/005 1s 2023-06-09T11:16:48.578 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/005 2023-06-09T11:16:48.578 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:16:48.593 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:48.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:16:48.775 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-09T11:16:49.505 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:16:49.528 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:16:49.532 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:16:49.537 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:16:49.537 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:16:56.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:56.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:17.514 INFO:teuthology.orchestra.run.smithi078.stdout:generic/006 28s 2023-06-09T11:17:17.538 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/006 2023-06-09T11:17:17.539 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:17:17.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:17:17.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:17:17.692 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-09T11:17:18.420 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:17:18.443 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:17:18.447 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:17:18.453 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:17:18.453 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:17:26.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:26.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:56.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:56.816 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:18.247 INFO:teuthology.orchestra.run.smithi078.stdout:generic/007 60s 2023-06-09T11:18:18.266 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/007 2023-06-09T11:18:18.266 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:18:18.279 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:18.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:18:18.426 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-09T11:18:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:18:19.188 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:18:19.191 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:18:19.196 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:18:19.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:20.297 INFO:teuthology.orchestra.run.smithi078.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T11:18:20.316 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/008 2023-06-09T11:18:20.316 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/008 2023-06-09T11:18:20.317 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:18:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:20.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:18:20.423 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-09T11:18:21.180 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:18:21.203 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:18:21.206 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:18:21.211 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:18:21.211 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:22.251 INFO:teuthology.orchestra.run.smithi078.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T11:18:22.269 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/009 2023-06-09T11:18:22.269 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/009 2023-06-09T11:18:22.270 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:18:22.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:22.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:18:22.399 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-09T11:18:23.121 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:18:23.143 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:18:23.146 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:18:23.151 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:18:23.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:24.032 INFO:teuthology.orchestra.run.smithi078.stdout:generic/010 [not run] /tmp/tmp.bWnQzKjaCzxfstests-dev/src/dbtest not built 2023-06-09T11:18:24.054 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/010 2023-06-09T11:18:24.055 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/010 2023-06-09T11:18:24.055 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:18:24.068 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:24.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:18:24.153 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-09T11:18:24.868 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:18:24.888 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:18:24.890 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:18:24.896 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:18:24.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:18:27.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:27.941 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:58.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:58.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:03.946 INFO:teuthology.orchestra.run.smithi078.stdout:generic/011 38s 2023-06-09T11:19:03.973 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/011 2023-06-09T11:19:03.973 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:19:03.984 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:19:04.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:19:04.275 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-09T11:19:04.992 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:19:05.013 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:19:05.016 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:19:05.022 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:19:05.022 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:19:06.220 INFO:teuthology.orchestra.run.smithi078.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:19:06.240 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/012 2023-06-09T11:19:06.240 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/012 2023-06-09T11:19:06.240 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:19:06.253 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:19:06.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:19:06.392 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-09T11:19:07.095 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:19:07.115 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:19:07.118 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:19:07.124 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:19:07.124 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:19:28.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:28.100 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:58.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:58.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:04.225 INFO:teuthology.orchestra.run.smithi078.stdout:generic/013 57s 2023-06-09T11:20:04.249 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/013 2023-06-09T11:20:04.250 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:20:04.261 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:20:04.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:20:04.357 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-09T11:20:05.021 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:20:05.039 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:20:05.041 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:20:05.047 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:20:05.047 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:20:28.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:28.509 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:59.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:59.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:30.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:30.297 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:00.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:00.392 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:30.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:30.486 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:00.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:00.548 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:30.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:30.629 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:00.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:00.747 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:30.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:30.939 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:01.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:01.042 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:29.886 INFO:teuthology.orchestra.run.smithi078.stdout:generic/014 324s 2023-06-09T11:25:30.892 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/014 2023-06-09T11:25:30.893 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:30.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:31.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:31.013 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-09T11:25:31.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:31.599 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:31.634 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:31.636 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:31.640 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:31.640 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:32.411 INFO:teuthology.orchestra.run.smithi078.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T11:25:32.427 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/015 2023-06-09T11:25:32.427 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/015 2023-06-09T11:25:32.427 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:32.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:32.510 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-09T11:25:33.139 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:33.154 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:33.156 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:33.162 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:34.213 INFO:teuthology.orchestra.run.smithi078.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:25:34.226 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/016 2023-06-09T11:25:34.226 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/016 2023-06-09T11:25:34.226 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:34.236 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:34.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:34.569 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-09T11:25:35.206 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:35.225 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:35.226 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:35.231 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:35.231 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:36.042 INFO:teuthology.orchestra.run.smithi078.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T11:25:36.059 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/017 2023-06-09T11:25:36.060 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/017 2023-06-09T11:25:36.060 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:36.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:36.149 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-09T11:25:36.751 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:36.773 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:36.776 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:36.782 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:36.782 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:37.828 INFO:teuthology.orchestra.run.smithi078.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-09T11:25:37.898 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/018 2023-06-09T11:25:37.899 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/018 2023-06-09T11:25:37.899 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:37.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:37.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:37.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-09T11:25:38.613 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:38.629 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:38.631 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:38.634 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:38.635 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:39.400 INFO:teuthology.orchestra.run.smithi078.stdout:generic/019 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:25:39.416 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/019 2023-06-09T11:25:39.416 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/019 2023-06-09T11:25:39.416 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:39.428 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:39.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:39.496 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-09T11:25:40.145 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:40.160 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:40.162 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:40.164 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:40.165 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:49.429 INFO:teuthology.orchestra.run.smithi078.stdout:generic/020 9s 2023-06-09T11:25:49.448 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/020 2023-06-09T11:25:49.448 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:49.459 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:49.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:49.765 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-09T11:25:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:50.460 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:50.465 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:50.466 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:51.478 INFO:teuthology.orchestra.run.smithi078.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:25:51.496 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/021 2023-06-09T11:25:51.496 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/021 2023-06-09T11:25:51.496 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:51.505 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:51.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:51.813 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-09T11:25:52.449 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:52.462 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:52.466 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:52.471 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:52.471 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:53.460 INFO:teuthology.orchestra.run.smithi078.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:25:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/022 2023-06-09T11:25:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/022 2023-06-09T11:25:53.474 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:25:53.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:25:53.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:25:53.666 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-09T11:25:54.427 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:25:54.445 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:25:54.447 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:25:54.451 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:25:54.451 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:01.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:01.670 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:31.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:31.737 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:generic/023 45s 2023-06-09T11:26:39.224 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/023 2023-06-09T11:26:39.224 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:26:39.236 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:39.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:26:39.388 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-09T11:26:40.179 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:26:40.197 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:26:40.199 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:26:40.203 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:26:40.203 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:40.993 INFO:teuthology.orchestra.run.smithi078.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-09T11:26:41.007 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/024 2023-06-09T11:26:41.007 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/024 2023-06-09T11:26:41.007 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:26:41.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:41.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:26:41.252 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-09T11:26:41.955 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:26:41.974 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:26:41.977 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:26:41.982 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:26:41.982 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:42.791 INFO:teuthology.orchestra.run.smithi078.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-09T11:26:42.808 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/025 2023-06-09T11:26:42.808 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/025 2023-06-09T11:26:42.808 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:26:42.816 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:42.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:26:42.979 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-09T11:26:43.746 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:26:43.765 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:26:43.766 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:26:43.771 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:26:43.771 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:44.624 INFO:teuthology.orchestra.run.smithi078.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-09T11:26:44.641 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/026 2023-06-09T11:26:44.641 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/026 2023-06-09T11:26:44.641 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:26:44.652 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:44.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:26:44.746 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-09T11:26:45.386 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:26:45.402 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:26:45.404 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:26:45.410 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:26:45.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:46.177 INFO:teuthology.orchestra.run.smithi078.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T11:26:46.195 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/027 2023-06-09T11:26:46.195 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/027 2023-06-09T11:26:46.195 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:26:46.204 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:46.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:26:46.288 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-09T11:26:46.897 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:26:46.913 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:26:46.915 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:26:46.923 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:26:46.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:52.732 INFO:teuthology.orchestra.run.smithi078.stdout:generic/028 5s 2023-06-09T11:26:52.754 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/028 2023-06-09T11:26:52.754 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:26:52.761 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:52.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:26:52.850 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-09T11:26:53.490 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:26:53.505 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:26:53.507 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:26:53.510 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:26:53.510 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:57.141 INFO:teuthology.orchestra.run.smithi078.stdout:generic/029 4s 2023-06-09T11:26:57.166 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/029 2023-06-09T11:26:57.166 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:26:57.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:26:57.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:26:57.214 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-09T11:26:57.842 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:26:57.859 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:26:57.863 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:26:57.867 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:26:57.867 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:00.733 INFO:teuthology.orchestra.run.smithi078.stdout:generic/030 2s 2023-06-09T11:27:00.763 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/030 2023-06-09T11:27:00.763 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:00.771 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:00.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:00.804 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-09T11:27:01.449 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:01.464 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:01.465 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:01.470 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:01.470 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:01.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:01.817 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:02.437 INFO:teuthology.orchestra.run.smithi078.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T11:27:02.452 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/031 2023-06-09T11:27:02.453 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/031 2023-06-09T11:27:02.453 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:02.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:02.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:02.543 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-09T11:27:03.168 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:03.187 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:03.189 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:03.193 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:03.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:03.996 INFO:teuthology.orchestra.run.smithi078.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:27:04.010 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/032 2023-06-09T11:27:04.011 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/032 2023-06-09T11:27:04.011 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:04.022 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:04.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:04.102 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-09T11:27:04.757 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:04.775 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:04.783 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:04.787 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:04.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:05.767 INFO:teuthology.orchestra.run.smithi078.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T11:27:05.780 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/033 2023-06-09T11:27:05.780 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/033 2023-06-09T11:27:05.780 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:05.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:05.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:05.869 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-09T11:27:06.506 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:06.523 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:06.525 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:06.530 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:06.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:07.328 INFO:teuthology.orchestra.run.smithi078.stdout:generic/034 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:27:07.342 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/034 2023-06-09T11:27:07.342 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/034 2023-06-09T11:27:07.342 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:07.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:07.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:07.430 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-09T11:27:08.061 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:08.077 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:08.079 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:08.083 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:08.083 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:09.023 INFO:teuthology.orchestra.run.smithi078.stdout:generic/035 0s 2023-06-09T11:27:09.046 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/035 2023-06-09T11:27:09.047 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:09.058 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:09.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:09.369 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-09T11:27:10.038 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:10.059 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:10.061 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:10.067 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:10.067 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:21.163 INFO:teuthology.orchestra.run.smithi078.stdout:generic/036 11s 2023-06-09T11:27:21.188 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/036 2023-06-09T11:27:21.188 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:21.203 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:21.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:21.449 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-09T11:27:22.212 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:22.234 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:22.237 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:22.241 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:22.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:31.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:31.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:32.706 INFO:teuthology.orchestra.run.smithi078.stdout:generic/037 10s 2023-06-09T11:27:32.729 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/037 2023-06-09T11:27:32.730 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:32.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:32.781 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-09T11:27:33.505 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:33.526 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:33.529 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:33.534 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:34.494 INFO:teuthology.orchestra.run.smithi078.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:27:34.514 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/038 2023-06-09T11:27:34.515 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/038 2023-06-09T11:27:34.515 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:34.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:34.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:34.619 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-09T11:27:35.336 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:35.358 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:35.361 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:35.366 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:35.366 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:36.332 INFO:teuthology.orchestra.run.smithi078.stdout:generic/039 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:27:36.350 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/039 2023-06-09T11:27:36.350 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/039 2023-06-09T11:27:36.351 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:36.362 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:36.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:36.455 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-09T11:27:37.200 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:37.222 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:37.225 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:37.230 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:37.230 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:38.229 INFO:teuthology.orchestra.run.smithi078.stdout:generic/040 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:27:38.247 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/040 2023-06-09T11:27:38.247 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/040 2023-06-09T11:27:38.247 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:38.260 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:38.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:38.358 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-09T11:27:39.092 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:39.115 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:39.118 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:39.124 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:39.124 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:40.137 INFO:teuthology.orchestra.run.smithi078.stdout:generic/041 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:27:40.157 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/041 2023-06-09T11:27:40.157 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/041 2023-06-09T11:27:40.157 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:40.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:40.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:40.267 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-09T11:27:40.995 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:41.018 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:41.021 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:41.025 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:41.026 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:42.182 INFO:teuthology.orchestra.run.smithi078.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-09T11:27:42.251 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/042 2023-06-09T11:27:42.251 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/042 2023-06-09T11:27:42.251 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:42.264 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:42.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:42.362 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-09T11:27:43.092 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:43.111 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:43.114 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:43.119 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:43.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:44.274 INFO:teuthology.orchestra.run.smithi078.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-09T11:27:44.344 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/043 2023-06-09T11:27:44.344 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/043 2023-06-09T11:27:44.344 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:44.359 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:44.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:44.453 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-09T11:27:45.216 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:45.238 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:45.241 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:45.246 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:45.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:46.453 INFO:teuthology.orchestra.run.smithi078.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-09T11:27:46.522 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/044 2023-06-09T11:27:46.523 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/044 2023-06-09T11:27:46.523 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:46.534 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:46.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:46.613 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-09T11:27:47.355 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:47.378 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:47.382 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:47.388 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:47.388 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:48.558 INFO:teuthology.orchestra.run.smithi078.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-09T11:27:48.630 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/045 2023-06-09T11:27:48.630 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/045 2023-06-09T11:27:48.630 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:48.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:48.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:48.733 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-09T11:27:49.476 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:49.497 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:49.500 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:49.506 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:49.506 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:50.669 INFO:teuthology.orchestra.run.smithi078.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-09T11:27:50.738 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/046 2023-06-09T11:27:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/046 2023-06-09T11:27:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:50.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:50.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:50.830 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-09T11:27:51.575 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:51.599 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:51.602 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:51.607 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:51.607 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:52.751 INFO:teuthology.orchestra.run.smithi078.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-09T11:27:52.830 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/047 2023-06-09T11:27:52.830 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/047 2023-06-09T11:27:52.830 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:52.843 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:52.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:52.942 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-09T11:27:53.698 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:53.720 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:53.723 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:53.728 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:53.729 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:54.891 INFO:teuthology.orchestra.run.smithi078.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-09T11:27:54.967 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/048 2023-06-09T11:27:54.967 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/048 2023-06-09T11:27:54.968 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:54.981 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:55.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:55.085 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-09T11:27:55.829 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:55.850 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:55.853 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:55.859 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:55.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:56.998 INFO:teuthology.orchestra.run.smithi078.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-09T11:27:57.062 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/049 2023-06-09T11:27:57.062 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/049 2023-06-09T11:27:57.063 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:57.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:57.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:57.170 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-09T11:27:57.872 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:27:57.894 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:27:57.897 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:27:57.902 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:27:57.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:59.093 INFO:teuthology.orchestra.run.smithi078.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-09T11:27:59.156 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/050 2023-06-09T11:27:59.156 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/050 2023-06-09T11:27:59.156 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:27:59.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:27:59.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:27:59.257 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-09T11:27:59.991 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:00.013 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:00.016 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:00.022 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:00.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:01.228 INFO:teuthology.orchestra.run.smithi078.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-09T11:28:01.247 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/051 2023-06-09T11:28:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/051 2023-06-09T11:28:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:01.262 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:01.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:01.354 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-09T11:28:01.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:01.960 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:02.091 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:02.112 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:02.115 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:02.120 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:02.120 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:03.263 INFO:teuthology.orchestra.run.smithi078.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-09T11:28:03.342 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/052 2023-06-09T11:28:03.343 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/052 2023-06-09T11:28:03.343 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:03.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:03.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:03.453 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-09T11:28:04.186 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:04.210 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:04.212 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:04.217 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:04.217 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:06.331 INFO:teuthology.orchestra.run.smithi078.stdout:generic/053 2s 2023-06-09T11:28:06.351 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/053 2023-06-09T11:28:06.352 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:06.360 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:06.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:06.393 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-09T11:28:07.079 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:07.101 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:07.104 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:07.108 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:07.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:08.290 INFO:teuthology.orchestra.run.smithi078.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-09T11:28:08.354 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/054 2023-06-09T11:28:08.354 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/054 2023-06-09T11:28:08.355 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:08.366 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:08.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:08.455 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-09T11:28:09.200 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:09.223 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:09.226 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:09.231 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:09.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:10.385 INFO:teuthology.orchestra.run.smithi078.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-09T11:28:10.448 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/055 2023-06-09T11:28:10.448 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/055 2023-06-09T11:28:10.448 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:10.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:10.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:10.554 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-09T11:28:11.271 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:11.291 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:11.294 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:11.300 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:11.301 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:generic/056 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:28:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/056 2023-06-09T11:28:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/056 2023-06-09T11:28:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:12.362 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:12.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:12.465 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-09T11:28:13.208 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:13.229 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:13.233 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:13.238 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:13.238 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:14.267 INFO:teuthology.orchestra.run.smithi078.stdout:generic/057 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:28:14.290 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/057 2023-06-09T11:28:14.290 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/057 2023-06-09T11:28:14.291 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:14.305 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:14.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:14.439 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-09T11:28:15.168 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:15.192 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:15.196 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:15.202 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:15.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:16.386 INFO:teuthology.orchestra.run.smithi078.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:28:16.406 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/058 2023-06-09T11:28:16.407 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/058 2023-06-09T11:28:16.407 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:16.418 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:16.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:16.664 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-09T11:28:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:17.445 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:17.448 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:17.454 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:17.454 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:18.412 INFO:teuthology.orchestra.run.smithi078.stdout:generic/059 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:28:18.434 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/059 2023-06-09T11:28:18.434 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/059 2023-06-09T11:28:18.434 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:18.448 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:18.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:18.555 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-09T11:28:19.298 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:19.319 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:19.321 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:19.326 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:19.326 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:20.449 INFO:teuthology.orchestra.run.smithi078.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:28:20.469 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/060 2023-06-09T11:28:20.469 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/060 2023-06-09T11:28:20.470 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:20.481 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:20.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:20.723 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-09T11:28:21.517 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:21.539 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:21.542 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:21.547 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:21.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:22.723 INFO:teuthology.orchestra.run.smithi078.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:28:22.742 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/061 2023-06-09T11:28:22.742 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/061 2023-06-09T11:28:22.742 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:22.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:23.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:23.090 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-09T11:28:23.808 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:23.830 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:23.832 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:23.837 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:23.837 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:28.667 INFO:teuthology.orchestra.run.smithi078.stdout:generic/062 4s 2023-06-09T11:28:28.695 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/062 2023-06-09T11:28:28.695 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:28.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:28.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:28.735 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-09T11:28:29.466 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:29.486 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:29.490 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:29.495 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:29.495 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:30.748 INFO:teuthology.orchestra.run.smithi078.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:28:30.768 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/063 2023-06-09T11:28:30.768 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/063 2023-06-09T11:28:30.768 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:30.780 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:31.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:31.175 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-09T11:28:31.882 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:31.904 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:31.907 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:31.913 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:31.913 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:32.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:32.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:32.921 INFO:teuthology.orchestra.run.smithi078.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T11:28:32.941 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/064 2023-06-09T11:28:32.941 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/064 2023-06-09T11:28:32.941 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:33.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:33.056 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-09T11:28:33.776 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:33.799 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:33.803 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:33.808 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:33.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:34.832 INFO:teuthology.orchestra.run.smithi078.stdout:generic/065 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:28:34.852 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/065 2023-06-09T11:28:34.852 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/065 2023-06-09T11:28:34.852 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:34.866 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:34.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:34.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-09T11:28:35.707 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:35.730 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:35.733 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:35.737 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:35.737 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:36.743 INFO:teuthology.orchestra.run.smithi078.stdout:generic/066 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:28:36.765 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/066 2023-06-09T11:28:36.765 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/066 2023-06-09T11:28:36.765 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:36.777 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:36.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:36.852 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-09T11:28:37.595 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:37.620 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:37.622 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:37.627 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:37.627 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:38.635 INFO:teuthology.orchestra.run.smithi078.stdout:generic/067 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:28:38.653 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/067 2023-06-09T11:28:38.653 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/067 2023-06-09T11:28:38.654 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:38.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:38.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:38.771 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-09T11:28:39.488 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:39.509 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:39.512 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:39.517 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:39.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:40.489 INFO:teuthology.orchestra.run.smithi078.stdout:generic/068 [not run] ceph does not support freezing 2023-06-09T11:28:40.508 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/068 2023-06-09T11:28:40.509 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/068 2023-06-09T11:28:40.509 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:28:40.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:28:40.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:28:40.613 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-09T11:28:41.367 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:28:41.391 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:28:41.394 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:28:41.398 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:28:41.399 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:02.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:02.101 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:02.309 INFO:teuthology.orchestra.run.smithi078.stdout:generic/069 21s 2023-06-09T11:29:02.327 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/069 2023-06-09T11:29:02.327 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:29:02.339 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:02.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:29:02.368 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-09T11:29:03.089 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:29:03.112 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:29:03.114 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:29:03.120 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:29:03.120 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:29.017 INFO:teuthology.orchestra.run.smithi078.stdout:generic/070 25s 2023-06-09T11:29:29.039 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/070 2023-06-09T11:29:29.039 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:29:29.049 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:29.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:29:29.306 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-09T11:29:30.023 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:29:30.042 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:29:30.043 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:29:30.048 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:29:30.048 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:30.877 INFO:teuthology.orchestra.run.smithi078.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T11:29:30.892 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/071 2023-06-09T11:29:30.892 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/071 2023-06-09T11:29:30.892 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:29:30.903 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:30.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:29:30.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-09T11:29:31.587 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:29:31.604 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:29:31.606 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:29:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:29:31.614 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:32.316 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:32.324 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:32.557 INFO:teuthology.orchestra.run.smithi078.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T11:29:32.575 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/072 2023-06-09T11:29:32.576 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/072 2023-06-09T11:29:32.576 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:29:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:32.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:29:32.666 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-09T11:29:33.294 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:29:33.310 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:29:33.313 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:29:33.316 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:29:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:34.083 INFO:teuthology.orchestra.run.smithi078.stdout:generic/073 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:29:34.095 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/073 2023-06-09T11:29:34.095 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/073 2023-06-09T11:29:34.095 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:29:34.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:29:34.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:29:34.187 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-09T11:29:34.800 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:29:34.817 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:29:34.819 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:29:34.823 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:29:34.823 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:30:02.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:02.419 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:02.472 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T11:30:02.459+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40477) UID: 0 2023-06-09T11:30:02.473 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T11:30:02.459+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40477) UID: 0 2023-06-09T11:30:18.313 INFO:teuthology.orchestra.run.smithi078.stdout:generic/074 43s 2023-06-09T11:30:18.333 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/074 2023-06-09T11:30:18.334 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:30:18.343 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:30:19.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:30:19.416 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-09T11:30:20.173 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:30:20.191 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:30:20.192 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:30:20.197 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:30:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:30:57.281 INFO:teuthology.orchestra.run.smithi078.stdout:generic/075 37s 2023-06-09T11:30:57.303 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/075 2023-06-09T11:30:57.303 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:30:57.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:30:57.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:30:57.624 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-09T11:30:58.316 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:30:58.329 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:30:58.331 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:30:58.334 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:30:58.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:30:59.125 INFO:teuthology.orchestra.run.smithi078.stdout:generic/076 [not run] require 172.21.15.78:6789:/scratch to be local device 2023-06-09T11:30:59.143 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/076 2023-06-09T11:30:59.143 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/076 2023-06-09T11:30:59.143 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:30:59.152 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:30:59.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:30:59.222 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-09T11:30:59.851 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:30:59.872 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:30:59.873 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:30:59.877 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:30:59.877 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:01.903 INFO:teuthology.orchestra.run.smithi078.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T11:31:01.921 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/077 2023-06-09T11:31:01.922 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/077 2023-06-09T11:31:01.922 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:01.934 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:02.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:02.196 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-09T11:31:02.960 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:02.978 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:02.980 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:02.982 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:02.983 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:03.811 INFO:teuthology.orchestra.run.smithi078.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-09T11:31:03.831 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/078 2023-06-09T11:31:03.832 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/078 2023-06-09T11:31:03.833 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:03.842 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:04.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:04.096 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-09T11:31:04.832 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:04.858 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:04.865 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:04.868 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:04.868 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:05.663 INFO:teuthology.orchestra.run.smithi078.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-09T11:31:05.679 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/079 2023-06-09T11:31:05.680 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/079 2023-06-09T11:31:05.680 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:05.689 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:05.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:05.761 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-09T11:31:06.410 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:06.429 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:06.430 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:06.434 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:06.434 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:09.341 INFO:teuthology.orchestra.run.smithi078.stdout:generic/080 3s 2023-06-09T11:31:09.368 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/080 2023-06-09T11:31:09.369 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:09.380 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:09.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:09.481 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-09T11:31:10.109 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:10.130 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:10.132 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:10.136 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:10.136 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:11.026 INFO:teuthology.orchestra.run.smithi078.stdout:generic/081 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:31:11.050 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/081 2023-06-09T11:31:11.050 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/081 2023-06-09T11:31:11.050 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:11.060 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:11.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:11.134 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-09T11:31:11.780 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:11.801 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:11.803 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:11.807 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:11.807 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:12.606 INFO:teuthology.orchestra.run.smithi078.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T11:31:12.622 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/082 2023-06-09T11:31:12.622 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/082 2023-06-09T11:31:12.622 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:12.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:12.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:12.716 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-09T11:31:13.315 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:13.333 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:13.334 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:13.338 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:13.339 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:14.146 INFO:teuthology.orchestra.run.smithi078.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T11:31:14.162 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/083 2023-06-09T11:31:14.163 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/083 2023-06-09T11:31:14.163 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:14.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:14.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:14.251 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-09T11:31:14.917 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:14.932 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:14.934 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:14.937 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:14.937 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:21.487 INFO:teuthology.orchestra.run.smithi078.stdout:generic/084 6s 2023-06-09T11:31:21.509 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/084 2023-06-09T11:31:21.509 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:21.521 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:21.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:21.557 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-09T11:31:22.213 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:22.228 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:22.229 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:22.234 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:22.234 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:23.046 INFO:teuthology.orchestra.run.smithi078.stdout:generic/085 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:31:23.062 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/085 2023-06-09T11:31:23.062 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/085 2023-06-09T11:31:23.062 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:23.071 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:23.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:23.142 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-09T11:31:23.775 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:23.794 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:23.797 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:23.802 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:23.802 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:24.608 INFO:teuthology.orchestra.run.smithi078.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:31:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/086 2023-06-09T11:31:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/086 2023-06-09T11:31:24.631 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:24.645 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:24.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:24.731 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-09T11:31:25.365 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:25.383 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:25.385 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:25.389 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:25.389 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:26.366 INFO:teuthology.orchestra.run.smithi078.stdout:generic/087 1s 2023-06-09T11:31:26.390 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/087 2023-06-09T11:31:26.390 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:26.400 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:26.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:26.735 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-09T11:31:27.399 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:27.419 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:27.420 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:27.424 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:27.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:28.300 INFO:teuthology.orchestra.run.smithi078.stdout:generic/088 1s 2023-06-09T11:31:28.324 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/088 2023-06-09T11:31:28.324 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:31:28.333 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:31:28.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:31:28.510 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-09T11:31:29.285 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:31:29.300 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:31:29.301 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:31:29.305 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:31:29.305 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:33:15.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:15.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:50.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:50.994 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:21.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:21.065 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:51.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:51.203 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:21.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:21.351 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:51.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:51.412 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:22.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:22.643 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:22.705 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T11:36:22.695+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40510) UID: 0 2023-06-09T11:36:22.712 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T11:36:22.699+0000 7f852cb5d700 -1 Fail to open '/proc/40510/cmdline' error = (2) No such file or directory 2023-06-09T11:36:22.712 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T11:36:22.699+0000 7f852cb5d700 -1 received signal: Hangup from (PID: 40510) UID: 0 2023-06-09T11:39:09.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:09.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:39.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:39.563 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:10.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:10.302 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:40.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:40.389 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:10.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:10.533 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:40.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:40.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:40.773 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T11:41:40.763+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40536) UID: 0 2023-06-09T11:41:40.779 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T11:41:40.763+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40536) UID: 0 2023-06-09T11:44:06.311 INFO:teuthology.orchestra.run.smithi078.stdout:generic/089 757s 2023-06-09T11:44:06.338 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/089 2023-06-09T11:44:06.338 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:44:06.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:44:06.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:44:06.997 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-06-09T11:44:07.841 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:44:07.863 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:44:07.865 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:44:07.872 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:44:07.872 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:44:08.897 INFO:teuthology.orchestra.run.smithi078.stdout:generic/090 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:44:08.916 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/090 2023-06-09T11:44:08.916 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/090 2023-06-09T11:44:08.917 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:44:08.929 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:44:09.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:44:09.029 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-06-09T11:44:09.754 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:44:09.774 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:44:09.777 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:44:09.784 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:44:09.784 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:44:31.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:31.668 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:01.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:01.751 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:31.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:31.819 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:01.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:01.912 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:32.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:32.012 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:02.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:02.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:08.535 INFO:teuthology.orchestra.run.smithi078.stdout:generic/091 178s 2023-06-09T11:47:08.563 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/091 2023-06-09T11:47:08.563 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:08.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:08.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:08.876 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-06-09T11:47:09.616 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:09.639 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:09.642 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:09.648 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:09.648 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:10.617 INFO:teuthology.orchestra.run.smithi078.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:47:10.639 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/092 2023-06-09T11:47:10.639 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/092 2023-06-09T11:47:10.639 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:10.651 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:10.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:10.736 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-06-09T11:47:11.485 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:11.505 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:11.507 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:11.513 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:11.513 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:13.067 INFO:teuthology.orchestra.run.smithi078.stdout:generic/093 2s 2023-06-09T11:47:13.094 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/093 2023-06-09T11:47:13.094 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:13.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:13.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:13.327 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-06-09T11:47:14.118 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:14.139 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:14.142 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:14.148 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:14.149 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:15.207 INFO:teuthology.orchestra.run.smithi078.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T11:47:15.228 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/094 2023-06-09T11:47:15.228 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/094 2023-06-09T11:47:15.228 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:15.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:15.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:15.534 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-06-09T11:47:16.280 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:16.300 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:16.303 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:16.309 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:16.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:32.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:32.300 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:34.060 INFO:teuthology.orchestra.run.smithi078.stdout:generic/095 18s 2023-06-09T11:47:34.078 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/095 2023-06-09T11:47:34.078 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:34.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:34.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:34.118 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-06-09T11:47:34.856 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:34.878 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:34.881 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:34.886 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:34.886 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:36.026 INFO:teuthology.orchestra.run.smithi078.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T11:47:36.047 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/096 2023-06-09T11:47:36.047 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/096 2023-06-09T11:47:36.047 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:36.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:36.165 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-06-09T11:47:36.879 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:36.901 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:36.904 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:36.909 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:36.910 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:38.504 INFO:teuthology.orchestra.run.smithi078.stdout:generic/097 1s 2023-06-09T11:47:38.529 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/097 2023-06-09T11:47:38.530 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:38.540 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:38.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:38.662 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-06-09T11:47:39.395 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:39.415 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:39.418 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:39.424 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:39.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:42.121 INFO:teuthology.orchestra.run.smithi078.stdout:generic/098 3s 2023-06-09T11:47:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/098 2023-06-09T11:47:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:42.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:42.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:42.203 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-06-09T11:47:42.937 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:42.959 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:42.961 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:42.967 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:42.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:45.414 INFO:teuthology.orchestra.run.smithi078.stdout:generic/099 2s 2023-06-09T11:47:45.438 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/099 2023-06-09T11:47:45.439 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:47:45.449 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:47:45.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:47:45.790 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-06-09T11:47:46.504 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:47:46.527 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:47:46.529 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:47:46.536 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:47:46.536 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:02.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:02.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:generic/100 45s 2023-06-09T11:48:31.635 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/100 2023-06-09T11:48:31.635 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:31.649 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:32.534 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:32.539 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:33.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:33.251 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-06-09T11:48:33.963 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:33.984 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:33.987 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:33.992 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:33.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:35.044 INFO:teuthology.orchestra.run.smithi078.stdout:generic/101 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:48:35.064 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/101 2023-06-09T11:48:35.065 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/101 2023-06-09T11:48:35.065 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:35.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:35.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:35.167 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-06-09T11:48:35.910 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:35.932 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:35.935 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:35.940 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:35.941 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:36.887 INFO:teuthology.orchestra.run.smithi078.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T11:48:36.904 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/102 2023-06-09T11:48:36.904 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/102 2023-06-09T11:48:36.905 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:36.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:37.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:37.003 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-06-09T11:48:37.750 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:37.774 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:37.777 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:37.782 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:37.782 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:38.764 INFO:teuthology.orchestra.run.smithi078.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:48:38.787 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/103 2023-06-09T11:48:38.788 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/103 2023-06-09T11:48:38.788 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:38.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:39.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:39.148 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-06-09T11:48:39.854 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:39.874 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:39.877 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:39.883 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:39.883 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:40.880 INFO:teuthology.orchestra.run.smithi078.stdout:generic/104 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:48:40.900 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/104 2023-06-09T11:48:40.900 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/104 2023-06-09T11:48:40.900 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:40.913 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:41.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:41.015 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-06-09T11:48:41.723 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:41.746 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:41.749 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:41.754 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:41.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:43.607 INFO:teuthology.orchestra.run.smithi078.stdout:generic/105 1s 2023-06-09T11:48:43.755 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/105 2023-06-09T11:48:43.755 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:43.767 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:43.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:43.802 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-06-09T11:48:44.527 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:44.551 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:44.554 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:44.559 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:44.559 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:45.607 INFO:teuthology.orchestra.run.smithi078.stdout:generic/106 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:48:45.629 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/106 2023-06-09T11:48:45.629 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/106 2023-06-09T11:48:45.629 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:45.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:45.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:45.749 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-06-09T11:48:46.481 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:46.501 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:46.504 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:46.510 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:46.510 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:47.499 INFO:teuthology.orchestra.run.smithi078.stdout:generic/107 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:48:47.519 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/107 2023-06-09T11:48:47.519 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/107 2023-06-09T11:48:47.519 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:47.530 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:47.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:47.635 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-06-09T11:48:48.345 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:48.366 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:48.369 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:48.375 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:48.375 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:49.673 INFO:teuthology.orchestra.run.smithi078.stdout:generic/108 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T11:48:49.694 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/108 2023-06-09T11:48:49.694 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/108 2023-06-09T11:48:49.694 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:48:49.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:48:49.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:48:49.802 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-06-09T11:48:50.529 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:48:50.552 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:48:50.555 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:48:50.561 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:48:50.561 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:49:01.602 INFO:teuthology.orchestra.run.smithi078.stdout:generic/109 11s 2023-06-09T11:49:01.631 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/109 2023-06-09T11:49:01.631 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:49:01.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:49:01.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:49:01.679 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-06-09T11:49:02.437 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:49:02.459 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:49:02.462 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:49:02.469 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:49:02.469 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:49:02.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:02.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:29.452 INFO:teuthology.orchestra.run.smithi078.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T11:49:29.469 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/110 2023-06-09T11:49:29.470 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/110 2023-06-09T11:49:29.470 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:49:29.481 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:49:29.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:49:29.795 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-06-09T11:49:30.524 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:49:30.544 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:49:30.547 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:49:30.553 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:49:30.553 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:49:31.586 INFO:teuthology.orchestra.run.smithi078.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T11:49:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/111 2023-06-09T11:49:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/111 2023-06-09T11:49:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:49:31.623 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:49:31.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:49:31.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-06-09T11:49:32.746 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:49:32.767 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:49:32.769 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:49:32.775 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:49:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:49:33.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:33.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:01.508 INFO:teuthology.orchestra.run.smithi078.stdout:generic/112 28s 2023-06-09T11:50:01.532 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/112 2023-06-09T11:50:01.532 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:01.545 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:01.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:01.904 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-06-09T11:50:02.636 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:02.656 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:02.658 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:02.664 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:02.664 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:04.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:04.036 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:22.226 INFO:teuthology.orchestra.run.smithi078.stdout:generic/113 19s 2023-06-09T11:50:22.250 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/113 2023-06-09T11:50:22.251 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:22.266 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:22.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:22.551 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-06-09T11:50:23.296 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:23.319 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:23.322 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:23.328 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:23.328 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:24.392 INFO:teuthology.orchestra.run.smithi078.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-06-09T11:50:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/114 2023-06-09T11:50:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/114 2023-06-09T11:50:24.415 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:24.426 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:24.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:24.507 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-06-09T11:50:25.253 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:25.272 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:25.275 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:25.281 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:25.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:26.322 INFO:teuthology.orchestra.run.smithi078.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T11:50:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/115 2023-06-09T11:50:26.340 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/115 2023-06-09T11:50:26.341 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:26.352 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:26.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:26.720 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-06-09T11:50:27.434 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:27.457 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:27.460 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:27.466 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:27.466 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:28.495 INFO:teuthology.orchestra.run.smithi078.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T11:50:28.514 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/116 2023-06-09T11:50:28.515 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/116 2023-06-09T11:50:28.515 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:28.529 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:28.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:28.904 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-06-09T11:50:29.598 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:29.622 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:29.625 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:29.630 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:34.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:34.267 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:44.011 INFO:teuthology.orchestra.run.smithi078.stdout:generic/117 14s 2023-06-09T11:50:44.031 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/117 2023-06-09T11:50:44.031 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:44.041 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:44.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:44.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-06-09T11:50:44.811 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:44.835 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:44.838 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:44.843 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:44.843 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:46.588 INFO:teuthology.orchestra.run.smithi078.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T11:50:46.608 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/118 2023-06-09T11:50:46.608 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/118 2023-06-09T11:50:46.609 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:46.622 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:47.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:47.025 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-06-09T11:50:47.737 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:47.758 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:47.760 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:47.766 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:47.766 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:48.797 INFO:teuthology.orchestra.run.smithi078.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T11:50:48.817 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/119 2023-06-09T11:50:48.818 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/119 2023-06-09T11:50:48.818 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:48.829 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:49.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:49.184 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-06-09T11:50:49.886 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:49.909 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:49.912 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:49.917 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:49.917 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:50.860 INFO:teuthology.orchestra.run.smithi078.stdout:generic/120 [not run] atime not maintained by ceph 2023-06-09T11:50:50.878 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/120 2023-06-09T11:50:50.879 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/120 2023-06-09T11:50:50.879 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:50.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:50.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:50.980 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-06-09T11:50:51.722 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:51.742 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:51.745 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:51.750 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:51.750 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:52.777 INFO:teuthology.orchestra.run.smithi078.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T11:50:52.799 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/121 2023-06-09T11:50:52.802 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/121 2023-06-09T11:50:52.802 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:52.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:53.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:53.173 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-06-09T11:50:53.884 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:53.906 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:53.909 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:53.914 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:53.914 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:54.964 INFO:teuthology.orchestra.run.smithi078.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T11:50:54.986 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/122 2023-06-09T11:50:54.986 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/122 2023-06-09T11:50:54.986 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:54.997 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:55.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:55.267 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-06-09T11:50:56.024 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:56.043 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:56.045 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:56.050 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:56.050 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:57.638 INFO:teuthology.orchestra.run.smithi078.stdout:generic/123 1s 2023-06-09T11:50:57.662 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/123 2023-06-09T11:50:57.662 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:50:57.674 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:50:57.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:50:57.998 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-06-09T11:50:58.698 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:50:58.722 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:50:58.725 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:50:58.731 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:50:58.731 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:51:04.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:04.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:06.243 INFO:teuthology.orchestra.run.smithi078.stdout:generic/124 7s 2023-06-09T11:51:06.270 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/124 2023-06-09T11:51:06.270 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:51:06.279 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:51:06.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:51:06.638 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-06-09T11:51:07.481 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:51:07.502 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:51:07.504 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:51:07.509 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:51:07.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:51:34.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:34.493 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:04.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:04.625 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:10.071 INFO:teuthology.orchestra.run.smithi078.stdout:generic/125 63s 2023-06-09T11:52:10.094 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/125 2023-06-09T11:52:10.095 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:52:10.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:52:10.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:52:10.292 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-06-09T11:52:11.123 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:52:11.144 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:52:11.148 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:52:11.153 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:52:11.153 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:52:12.677 INFO:teuthology.orchestra.run.smithi078.stdout:generic/126 1s 2023-06-09T11:52:12.705 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/126 2023-06-09T11:52:12.706 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T11:52:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:52:13.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:52:13.064 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-06-09T11:52:13.799 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T11:52:13.821 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:52:13.824 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T11:52:13.830 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T11:52:13.830 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T11:52:34.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:34.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:04.832 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:04.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:34.913 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:34.918 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:05.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:05.009 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:35.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:35.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:05.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:05.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:35.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:35.378 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:05.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:05.468 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:35.557 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:35.563 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:05.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:05.695 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:35.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:35.820 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:05.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:05.984 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:36.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:36.132 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:06.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:06.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:36.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:36.338 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:06.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:06.492 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:36.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:36.667 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:06.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:07.005 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:37.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:37.111 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:07.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:07.251 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:37.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:37.397 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:07.458 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:07.465 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:37.746 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:37.754 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:07.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:07.825 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:37.914 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:37.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:08.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:08.736 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:38.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:38.886 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:38.933 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T12:05:38.927+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40677) UID: 0 2023-06-09T12:05:38.934 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T12:05:38.927+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40677) UID: 0 2023-06-09T12:08:16.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:16.297 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:46.415 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:46.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:16.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:16.493 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:43.530 INFO:teuthology.orchestra.run.smithi078.stdout:generic/127 1049s 2023-06-09T12:09:43.555 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/127 2023-06-09T12:09:43.555 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:09:43.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:09:43.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:09:43.808 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-06-09T12:09:44.537 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:09:44.559 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:09:44.562 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:09:44.567 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:09:44.568 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:09:46.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:46.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:46.832 INFO:teuthology.orchestra.run.smithi078.stdout:generic/128 2s 2023-06-09T12:09:46.855 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/128 2023-06-09T12:09:46.856 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:09:46.867 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:09:46.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:09:46.905 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-06-09T12:09:47.653 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:09:47.676 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:09:47.679 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:09:47.684 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:09:47.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:10:16.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:16.752 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:46.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:46.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:17.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:17.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:47.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:47.115 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:17.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:17.216 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:47.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:47.339 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:18.377 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:18.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:48.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:48.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:18.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:18.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:49.402 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:49.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:19.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:19.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:49.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:49.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:19.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:19.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:50.025 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:50.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:20.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:20.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:50.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:50.385 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:20.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:20.658 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:50.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:50.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:21.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:21.150 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:51.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:51.342 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:21.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:21.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:51.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:51.737 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:21.849 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:21.854 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:51.936 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:51.941 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:22.100 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:22.105 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:22.223 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T12:22:22.215+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40960) UID: 0 2023-06-09T12:22:22.223 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T12:22:22.215+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40960) UID: 0 2023-06-09T12:22:22.223 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T12:22:22.215+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40960) UID: 0 2023-06-09T12:22:22.224 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T12:22:22.215+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40960) UID: 0 2023-06-09T12:27:38.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:38.798 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:08.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:08.962 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:40.120 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:40.124 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:10.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:10.253 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:40.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:40.309 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:10.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:10.533 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:10.752 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T12:30:10.744+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173147) UID: 0 2023-06-09T12:30:10.752 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T12:30:10.744+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173147) UID: 0 2023-06-09T12:30:10.761 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T12:30:10.744+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173147) UID: 0 2023-06-09T12:30:10.761 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T12:30:10.744+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 173147) UID: 0 2023-06-09T12:33:24.714 INFO:teuthology.orchestra.run.smithi078.stdout:generic/129 1416s 2023-06-09T12:33:24.823 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/129 2023-06-09T12:33:24.823 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:33:24.835 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:33:24.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:33:24.870 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-06-09T12:33:25.738 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:33:25.756 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:33:25.759 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:33:25.764 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:33:25.764 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:33:44.678 INFO:teuthology.orchestra.run.smithi078.stdout:generic/130 18s 2023-06-09T12:33:46.337 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/130 2023-06-09T12:33:46.337 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:33:46.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:33:46.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:33:46.383 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-06-09T12:33:47.058 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:33:47.082 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:33:47.084 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:33:47.089 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:33:47.089 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:33:49.199 INFO:teuthology.orchestra.run.smithi078.stdout:generic/131 2s 2023-06-09T12:33:49.220 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/131 2023-06-09T12:33:49.221 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:33:49.230 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:33:49.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:33:49.523 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-06-09T12:33:50.304 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:33:50.320 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:33:50.322 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:33:50.326 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:33:50.326 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:34:05.872 INFO:teuthology.orchestra.run.smithi078.stdout:generic/132 15s 2023-06-09T12:34:05.896 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/132 2023-06-09T12:34:05.896 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:34:05.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:34:05.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:34:05.948 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-06-09T12:34:06.686 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:34:06.705 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:34:06.708 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:34:06.713 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:34:06.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:34:35.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:35.775 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:05.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:05.871 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:35.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:35.951 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:06.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:06.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:36.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:36.095 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:06.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:06.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:36.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:36.317 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:06.468 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:06.474 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:36.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:36.540 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:06.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:06.619 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:36.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:36.692 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:06.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:06.778 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:36.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:36.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:06.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:06.969 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:34.459 INFO:teuthology.orchestra.run.smithi078.stdout:generic/133 447s 2023-06-09T12:41:34.488 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/133 2023-06-09T12:41:34.488 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:34.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:34.803 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-06-09T12:41:35.546 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:35.564 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:35.567 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:35.569 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:35.570 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:36.644 INFO:teuthology.orchestra.run.smithi078.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:36.663 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/134 2023-06-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/134 2023-06-09T12:41:36.664 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:36.676 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:36.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:36.891 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-06-09T12:41:37.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:37.090 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:37.683 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:37.703 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:37.706 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:37.712 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:37.712 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:39.797 INFO:teuthology.orchestra.run.smithi078.stdout:generic/135 1s 2023-06-09T12:41:39.823 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/135 2023-06-09T12:41:39.824 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:39.836 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:39.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:39.879 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-06-09T12:41:40.613 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:40.633 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:40.636 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:40.640 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:40.640 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:41.734 INFO:teuthology.orchestra.run.smithi078.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T12:41:41.754 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/136 2023-06-09T12:41:41.754 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/136 2023-06-09T12:41:41.755 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:41.767 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:42.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:42.040 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-06-09T12:41:42.830 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:42.853 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:42.855 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:42.861 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:42.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:43.921 INFO:teuthology.orchestra.run.smithi078.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:43.942 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/137 2023-06-09T12:41:43.942 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/137 2023-06-09T12:41:43.942 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:43.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:44.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:44.309 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-06-09T12:41:45.068 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:45.092 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:45.095 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:45.100 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:45.100 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:46.150 INFO:teuthology.orchestra.run.smithi078.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:46.172 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/138 2023-06-09T12:41:46.173 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/138 2023-06-09T12:41:46.173 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:46.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:46.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:46.541 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-06-09T12:41:47.270 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:47.292 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:47.295 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:47.300 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:47.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:48.345 INFO:teuthology.orchestra.run.smithi078.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:48.366 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/139 2023-06-09T12:41:48.366 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/139 2023-06-09T12:41:48.367 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:48.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:48.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:48.731 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-06-09T12:41:49.471 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:49.488 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:49.491 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:49.495 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:49.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/140 2023-06-09T12:41:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/140 2023-06-09T12:41:50.585 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:50.598 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:50.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:50.901 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-06-09T12:41:51.682 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:51.705 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:51.708 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:51.714 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:53.134 INFO:teuthology.orchestra.run.smithi078.stdout:generic/141 1s 2023-06-09T12:41:53.160 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/141 2023-06-09T12:41:53.160 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:53.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:53.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:53.212 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-06-09T12:41:53.957 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:53.977 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:53.981 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:53.987 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:53.987 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:55.027 INFO:teuthology.orchestra.run.smithi078.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:55.047 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/142 2023-06-09T12:41:55.047 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/142 2023-06-09T12:41:55.047 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:55.062 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:55.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:55.383 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-06-09T12:41:56.084 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:56.105 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:56.108 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:56.114 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:56.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:57.190 INFO:teuthology.orchestra.run.smithi078.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:57.210 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/143 2023-06-09T12:41:57.211 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/143 2023-06-09T12:41:57.211 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:57.223 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:57.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:57.402 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-06-09T12:41:58.270 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:41:58.292 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:41:58.294 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:41:58.300 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:41:58.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:59.355 INFO:teuthology.orchestra.run.smithi078.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:41:59.376 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/144 2023-06-09T12:41:59.376 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/144 2023-06-09T12:41:59.376 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:41:59.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:41:59.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:41:59.756 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-06-09T12:42:00.476 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:00.497 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:00.500 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:00.506 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:00.506 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:01.579 INFO:teuthology.orchestra.run.smithi078.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:01.598 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/145 2023-06-09T12:42:01.599 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/145 2023-06-09T12:42:01.599 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:01.612 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:01.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:01.968 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-06-09T12:42:02.656 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:02.679 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:02.682 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:02.687 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:02.687 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:03.739 INFO:teuthology.orchestra.run.smithi078.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:03.760 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/146 2023-06-09T12:42:03.760 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/146 2023-06-09T12:42:03.761 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:03.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:04.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:04.098 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-06-09T12:42:04.828 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:04.850 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:04.853 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:04.859 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:04.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:05.937 INFO:teuthology.orchestra.run.smithi078.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:05.955 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/147 2023-06-09T12:42:05.955 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/147 2023-06-09T12:42:05.955 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:05.968 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:06.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:06.285 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-06-09T12:42:07.003 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:07.021 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:07.025 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:07.032 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:07.032 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:07.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:07.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:08.080 INFO:teuthology.orchestra.run.smithi078.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/148 2023-06-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/148 2023-06-09T12:42:08.103 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:08.118 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:08.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:08.515 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-06-09T12:42:09.209 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:09.229 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:09.233 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:09.238 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:09.238 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:10.315 INFO:teuthology.orchestra.run.smithi078.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:10.337 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/149 2023-06-09T12:42:10.337 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/149 2023-06-09T12:42:10.337 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:10.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:10.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:10.664 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-06-09T12:42:11.391 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:11.412 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:11.415 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:11.421 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:11.421 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:12.476 INFO:teuthology.orchestra.run.smithi078.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:12.496 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/150 2023-06-09T12:42:12.496 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/150 2023-06-09T12:42:12.496 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:12.508 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:12.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:12.892 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-06-09T12:42:13.583 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:13.607 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:13.610 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:13.615 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:13.615 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:14.711 INFO:teuthology.orchestra.run.smithi078.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:14.729 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/151 2023-06-09T12:42:14.730 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/151 2023-06-09T12:42:14.730 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:14.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:15.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:15.183 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-06-09T12:42:15.891 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:15.913 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:15.916 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:15.922 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:15.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:16.980 INFO:teuthology.orchestra.run.smithi078.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:16.999 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/152 2023-06-09T12:42:16.999 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/152 2023-06-09T12:42:16.999 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:17.010 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:17.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:17.332 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-06-09T12:42:18.067 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:18.088 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:18.092 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:18.097 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:18.097 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:19.186 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/153 2023-06-09T12:42:19.186 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/153 2023-06-09T12:42:19.186 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:19.198 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:19.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:19.561 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-06-09T12:42:20.269 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:20.290 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:20.294 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:20.299 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:21.354 INFO:teuthology.orchestra.run.smithi078.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:21.374 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/154 2023-06-09T12:42:21.374 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/154 2023-06-09T12:42:21.374 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:21.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:21.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:21.756 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-06-09T12:42:22.434 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:22.456 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:22.459 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:22.465 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:22.466 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:23.541 INFO:teuthology.orchestra.run.smithi078.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:23.563 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/155 2023-06-09T12:42:23.563 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/155 2023-06-09T12:42:23.563 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:23.578 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:23.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:23.829 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-06-09T12:42:24.592 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:24.614 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:24.617 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:24.621 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:24.622 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:25.677 INFO:teuthology.orchestra.run.smithi078.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:25.698 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/156 2023-06-09T12:42:25.698 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/156 2023-06-09T12:42:25.698 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:25.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:26.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:26.014 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-06-09T12:42:26.732 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:26.752 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:26.756 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:26.762 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:27.864 INFO:teuthology.orchestra.run.smithi078.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:42:27.882 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/157 2023-06-09T12:42:27.883 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/157 2023-06-09T12:42:27.883 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:27.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:28.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:28.249 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-06-09T12:42:28.970 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:28.994 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:28.998 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:29.003 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:29.004 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:30.080 INFO:teuthology.orchestra.run.smithi078.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T12:42:30.101 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/158 2023-06-09T12:42:30.101 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/158 2023-06-09T12:42:30.102 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:30.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:30.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:30.414 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-06-09T12:42:31.169 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:31.190 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:31.193 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:31.199 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:31.199 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:32.263 INFO:teuthology.orchestra.run.smithi078.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-06-09T12:42:32.280 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/159 2023-06-09T12:42:32.281 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/159 2023-06-09T12:42:32.281 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:32.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:32.403 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-06-09T12:42:33.137 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:33.159 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:33.162 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:33.168 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:34.177 INFO:teuthology.orchestra.run.smithi078.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-06-09T12:42:34.199 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/160 2023-06-09T12:42:34.199 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/160 2023-06-09T12:42:34.200 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:34.215 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:34.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:34.319 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-06-09T12:42:35.051 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:35.072 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:35.075 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:35.080 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:35.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:36.603 INFO:teuthology.orchestra.run.smithi078.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:42:36.676 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/161 2023-06-09T12:42:36.676 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/161 2023-06-09T12:42:36.677 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:36.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:36.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:36.786 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-06-09T12:42:37.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:37.302 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:37.510 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:37.527 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:37.530 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:37.535 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:37.536 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:38.814 INFO:teuthology.orchestra.run.smithi078.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T12:42:39.040 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/162 2023-06-09T12:42:39.041 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/162 2023-06-09T12:42:39.041 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:39.053 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:39.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:39.257 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-06-09T12:42:39.987 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:40.006 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:40.008 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:40.014 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:40.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:41.355 INFO:teuthology.orchestra.run.smithi078.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T12:42:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/163 2023-06-09T12:42:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/163 2023-06-09T12:42:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:41.608 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:41.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:41.777 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-06-09T12:42:42.464 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:42.485 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:42.489 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:42.494 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:42.494 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:43.926 INFO:teuthology.orchestra.run.smithi078.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:42:43.979 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/164 2023-06-09T12:42:43.980 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/164 2023-06-09T12:42:43.980 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:44.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:44.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:44.230 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-06-09T12:42:44.940 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:44.961 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:44.964 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:44.970 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:44.970 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:46.534 INFO:teuthology.orchestra.run.smithi078.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:42:46.638 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/165 2023-06-09T12:42:46.639 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/165 2023-06-09T12:42:46.639 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:46.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:46.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:46.784 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-06-09T12:42:47.534 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:47.557 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:47.560 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:47.566 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:47.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:49.084 INFO:teuthology.orchestra.run.smithi078.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:42:49.169 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/166 2023-06-09T12:42:49.169 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/166 2023-06-09T12:42:49.170 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:49.204 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:49.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:49.362 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-06-09T12:42:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:50.097 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:50.099 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:50.104 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:50.104 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:51.559 INFO:teuthology.orchestra.run.smithi078.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:42:51.715 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/167 2023-06-09T12:42:51.715 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/167 2023-06-09T12:42:51.715 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:51.738 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:51.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:51.819 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-06-09T12:42:52.534 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:52.557 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:52.560 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:52.566 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:52.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:54.108 INFO:teuthology.orchestra.run.smithi078.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:42:54.156 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/168 2023-06-09T12:42:54.157 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/168 2023-06-09T12:42:54.157 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:54.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:54.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:54.311 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-06-09T12:42:55.023 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:55.044 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:55.047 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:55.053 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:55.053 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:56.879 INFO:teuthology.orchestra.run.smithi078.stdout:generic/169 1s 2023-06-09T12:42:56.904 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/169 2023-06-09T12:42:56.905 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:56.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:56.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:56.957 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-06-09T12:42:57.690 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:42:57.711 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:42:57.713 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:42:57.719 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:42:57.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:59.362 INFO:teuthology.orchestra.run.smithi078.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:42:59.390 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/170 2023-06-09T12:42:59.390 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/170 2023-06-09T12:42:59.391 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:42:59.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:42:59.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:42:59.498 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-06-09T12:43:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:00.210 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:00.212 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:00.219 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:00.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:01.949 INFO:teuthology.orchestra.run.smithi078.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:01.984 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/171 2023-06-09T12:43:01.984 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/171 2023-06-09T12:43:01.984 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:02.000 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:02.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:02.077 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-06-09T12:43:02.791 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:02.812 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:02.815 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:02.820 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:02.820 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:04.404 INFO:teuthology.orchestra.run.smithi078.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:04.465 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/172 2023-06-09T12:43:04.466 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/172 2023-06-09T12:43:04.466 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:04.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:04.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:04.651 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-06-09T12:43:05.374 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:05.397 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:05.400 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:05.405 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:05.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:06.831 INFO:teuthology.orchestra.run.smithi078.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:06.919 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/173 2023-06-09T12:43:06.920 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/173 2023-06-09T12:43:06.920 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:06.970 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:07.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:07.154 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-06-09T12:43:07.872 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:07.894 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:07.896 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:07.904 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:07.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:07.915 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:07.921 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:07.975 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T12:43:07.969+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41056) UID: 0 2023-06-09T12:43:07.975 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T12:43:07.969+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41056) UID: 0 2023-06-09T12:43:07.975 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T12:43:07.969+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41056) UID: 0 2023-06-09T12:43:07.976 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T12:43:07.969+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41056) UID: 0 2023-06-09T12:43:09.365 INFO:teuthology.orchestra.run.smithi078.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:09.493 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/174 2023-06-09T12:43:09.493 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/174 2023-06-09T12:43:09.494 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:09.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:09.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:09.616 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-06-09T12:43:10.351 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:10.370 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:10.373 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:10.380 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:10.380 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:11.887 INFO:teuthology.orchestra.run.smithi078.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:11.921 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/175 2023-06-09T12:43:11.921 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/175 2023-06-09T12:43:11.923 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:11.945 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:12.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:12.093 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-06-09T12:43:12.816 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:12.839 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:12.841 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:12.847 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:12.847 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:14.418 INFO:teuthology.orchestra.run.smithi078.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:14.477 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/176 2023-06-09T12:43:14.477 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/176 2023-06-09T12:43:14.478 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:14.508 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:14.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:14.581 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-06-09T12:43:15.287 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:15.308 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:15.311 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:15.316 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:15.316 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:16.698 INFO:teuthology.orchestra.run.smithi078.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T12:43:16.717 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/177 2023-06-09T12:43:16.717 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/177 2023-06-09T12:43:16.718 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:16.731 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:17.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:17.105 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-06-09T12:43:17.822 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:17.844 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:17.847 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:17.853 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:17.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:18.921 INFO:teuthology.orchestra.run.smithi078.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:43:18.938 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/178 2023-06-09T12:43:18.939 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/178 2023-06-09T12:43:18.939 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:18.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:19.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:19.334 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-06-09T12:43:19.999 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:20.022 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:20.024 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:20.028 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:20.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:21.065 INFO:teuthology.orchestra.run.smithi078.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:43:21.086 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/179 2023-06-09T12:43:21.086 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/179 2023-06-09T12:43:21.086 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:21.097 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:21.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:21.426 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-06-09T12:43:22.149 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:22.169 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:22.172 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:22.177 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:22.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:23.215 INFO:teuthology.orchestra.run.smithi078.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:43:23.234 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/180 2023-06-09T12:43:23.234 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/180 2023-06-09T12:43:23.234 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:23.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:23.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:23.632 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-06-09T12:43:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:24.332 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:24.335 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:24.340 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:24.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:25.443 INFO:teuthology.orchestra.run.smithi078.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:43:25.464 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/181 2023-06-09T12:43:25.465 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/181 2023-06-09T12:43:25.465 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:25.480 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:25.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:25.885 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-06-09T12:43:26.546 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:26.567 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:26.570 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:26.576 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:26.576 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:27.638 INFO:teuthology.orchestra.run.smithi078.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T12:43:27.657 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/182 2023-06-09T12:43:27.658 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/182 2023-06-09T12:43:27.658 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:27.670 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:28.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:28.008 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-06-09T12:43:28.713 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:28.733 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:28.735 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:28.741 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:28.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:30.276 INFO:teuthology.orchestra.run.smithi078.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:30.326 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/183 2023-06-09T12:43:30.326 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/183 2023-06-09T12:43:30.326 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:30.359 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:30.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:30.476 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-06-09T12:43:31.192 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:31.215 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:31.218 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:31.222 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:31.222 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:32.369 INFO:teuthology.orchestra.run.smithi078.stdout:generic/184 1s 2023-06-09T12:43:32.396 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/184 2023-06-09T12:43:32.396 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:32.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:32.500 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-06-09T12:43:33.235 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:33.257 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:33.260 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:33.266 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:34.837 INFO:teuthology.orchestra.run.smithi078.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:34.873 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/185 2023-06-09T12:43:34.874 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/185 2023-06-09T12:43:34.874 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:34.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:34.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:34.968 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-06-09T12:43:35.677 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:35.700 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:35.704 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:35.709 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:35.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:37.183 INFO:teuthology.orchestra.run.smithi078.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:37.319 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/186 2023-06-09T12:43:37.319 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/186 2023-06-09T12:43:37.319 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:37.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:37.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:37.440 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-06-09T12:43:38.132 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:38.155 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:38.158 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:38.164 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:38.164 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:39.722 INFO:teuthology.orchestra.run.smithi078.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:39.778 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/187 2023-06-09T12:43:39.779 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/187 2023-06-09T12:43:39.779 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:39.821 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:39.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:39.905 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-06-09T12:43:40.623 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:40.643 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:40.646 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:40.653 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:40.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:42.111 INFO:teuthology.orchestra.run.smithi078.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:42.239 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/188 2023-06-09T12:43:42.239 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/188 2023-06-09T12:43:42.239 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:42.279 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:42.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:42.391 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-06-09T12:43:43.100 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:43.122 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:43.124 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:43.130 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:43.130 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:44.715 INFO:teuthology.orchestra.run.smithi078.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:44.745 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/189 2023-06-09T12:43:44.745 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/189 2023-06-09T12:43:44.745 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:44.759 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:44.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:44.877 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-06-09T12:43:45.561 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:45.582 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:45.585 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:45.590 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:45.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:47.143 INFO:teuthology.orchestra.run.smithi078.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:47.164 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/190 2023-06-09T12:43:47.164 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/190 2023-06-09T12:43:47.164 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:47.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:47.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:47.364 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-06-09T12:43:48.078 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:48.099 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:48.102 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:48.107 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:48.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:49.552 INFO:teuthology.orchestra.run.smithi078.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:49.664 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/191 2023-06-09T12:43:49.665 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/191 2023-06-09T12:43:49.665 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:49.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:49.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:49.852 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-06-09T12:43:50.554 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:50.582 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:51.573 INFO:teuthology.orchestra.run.smithi078.stdout:generic/192 [not run] atime not maintained by ceph 2023-06-09T12:43:51.593 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/192 2023-06-09T12:43:51.593 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/192 2023-06-09T12:43:51.594 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:51.605 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:51.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:51.713 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-06-09T12:43:52.435 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:52.459 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:52.462 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:52.467 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:52.468 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:55.436 INFO:teuthology.orchestra.run.smithi078.stdout:generic/193 3s 2023-06-09T12:43:55.461 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/193 2023-06-09T12:43:55.461 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:55.475 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:55.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:55.823 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-06-09T12:43:56.550 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:56.574 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:56.577 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:56.582 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:56.582 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:58.098 INFO:teuthology.orchestra.run.smithi078.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:43:58.126 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/194 2023-06-09T12:43:58.126 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/194 2023-06-09T12:43:58.126 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:43:58.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:43:58.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:43:58.293 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-06-09T12:43:59.009 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:43:59.031 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:43:59.034 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:43:59.040 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:43:59.040 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:00.445 INFO:teuthology.orchestra.run.smithi078.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:00.486 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/195 2023-06-09T12:44:00.488 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/195 2023-06-09T12:44:00.488 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:00.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:00.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:00.808 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-06-09T12:44:01.514 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:01.536 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:01.538 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:01.544 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:01.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:02.996 INFO:teuthology.orchestra.run.smithi078.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:03.097 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/196 2023-06-09T12:44:03.097 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/196 2023-06-09T12:44:03.097 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:03.145 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:03.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:03.316 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-06-09T12:44:04.011 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:04.031 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:04.034 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:04.041 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:04.041 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:05.654 INFO:teuthology.orchestra.run.smithi078.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:05.711 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/197 2023-06-09T12:44:05.711 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/197 2023-06-09T12:44:05.711 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:05.728 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:05.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:05.821 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-06-09T12:44:06.526 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:06.548 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:06.551 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:06.557 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:06.557 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:08.560 INFO:teuthology.orchestra.run.smithi078.stdout:generic/198 2s 2023-06-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/198 2023-06-09T12:44:08.588 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:08.602 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:08.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:08.878 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-06-09T12:44:09.642 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:09.663 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:09.667 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:09.673 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:09.673 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:11.182 INFO:teuthology.orchestra.run.smithi078.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:11.319 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/199 2023-06-09T12:44:11.319 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/199 2023-06-09T12:44:11.320 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:11.331 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:11.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:11.421 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-06-09T12:44:12.143 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:12.165 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:12.168 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:12.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:13.802 INFO:teuthology.orchestra.run.smithi078.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:13.879 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/200 2023-06-09T12:44:13.879 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/200 2023-06-09T12:44:13.879 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:13.890 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:13.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:13.971 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-06-09T12:44:14.643 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:14.665 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:14.668 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:14.673 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:14.673 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:16.318 INFO:teuthology.orchestra.run.smithi078.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:16.391 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/201 2023-06-09T12:44:16.391 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/201 2023-06-09T12:44:16.391 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:16.416 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:16.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:16.494 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-06-09T12:44:17.207 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:17.229 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:17.232 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:17.238 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:17.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:18.781 INFO:teuthology.orchestra.run.smithi078.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:18.901 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/202 2023-06-09T12:44:18.902 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/202 2023-06-09T12:44:18.902 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:18.915 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:19.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:19.013 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-06-09T12:44:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:19.764 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:19.767 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:19.773 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:19.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:21.362 INFO:teuthology.orchestra.run.smithi078.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:21.452 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/203 2023-06-09T12:44:21.452 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/203 2023-06-09T12:44:21.453 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:21.481 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:21.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:21.592 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-06-09T12:44:22.282 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:22.303 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:22.305 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:22.312 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:22.312 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:23.946 INFO:teuthology.orchestra.run.smithi078.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:44:23.966 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/204 2023-06-09T12:44:23.966 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/204 2023-06-09T12:44:23.966 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:23.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:24.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:24.081 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-06-09T12:44:24.837 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:24.857 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:24.860 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:24.865 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:24.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:26.427 INFO:teuthology.orchestra.run.smithi078.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:26.476 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/205 2023-06-09T12:44:26.477 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/205 2023-06-09T12:44:26.477 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:26.493 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:26.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:26.602 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-06-09T12:44:27.312 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:27.332 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:27.335 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:27.341 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:27.341 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:28.781 INFO:teuthology.orchestra.run.smithi078.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:44:28.829 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/206 2023-06-09T12:44:28.829 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/206 2023-06-09T12:44:28.829 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:28.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:29.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:29.097 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-06-09T12:44:29.803 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:29.823 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:29.825 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:29.831 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:29.831 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:40.093 INFO:teuthology.orchestra.run.smithi078.stdout:generic/207 10s 2023-06-09T12:44:40.119 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/207 2023-06-09T12:44:40.120 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:44:40.136 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:44:40.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:44:40.517 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-06-09T12:44:41.217 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:44:41.238 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:44:41.241 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:44:41.246 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:44:41.246 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:45:49.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:49.335 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:19.435 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:19.442 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:49.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:49.530 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:19.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:19.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:49.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:49.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:02.498 INFO:teuthology.orchestra.run.smithi078.stdout:generic/208 201s 2023-06-09T12:48:02.522 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/208 2023-06-09T12:48:02.522 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:02.536 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:02.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:02.874 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-06-09T12:48:03.555 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:03.577 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:03.580 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:03.585 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:03.586 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:19.960 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:19.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:36.659 INFO:teuthology.orchestra.run.smithi078.stdout:generic/209 33s 2023-06-09T12:48:36.685 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/209 2023-06-09T12:48:36.685 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:36.696 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:36.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:36.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-06-09T12:48:37.723 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:37.747 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:37.749 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:37.754 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:37.755 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:38.963 INFO:teuthology.orchestra.run.smithi078.stdout:generic/210 0s 2023-06-09T12:48:38.994 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/210 2023-06-09T12:48:38.994 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:39.006 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:39.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:39.300 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-06-09T12:48:40.037 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:40.057 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:40.059 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:40.065 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:40.065 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:41.788 INFO:teuthology.orchestra.run.smithi078.stdout:generic/211 1s 2023-06-09T12:48:41.815 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/211 2023-06-09T12:48:41.815 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:41.827 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:41.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:41.937 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-06-09T12:48:42.675 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:42.695 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:42.697 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:42.703 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:42.704 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:43.900 INFO:teuthology.orchestra.run.smithi078.stdout:generic/212 0s 2023-06-09T12:48:43.925 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/212 2023-06-09T12:48:43.925 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:43.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:44.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:44.044 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-06-09T12:48:44.792 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:44.816 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:44.819 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:44.825 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:44.825 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:45.813 INFO:teuthology.orchestra.run.smithi078.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T12:48:45.835 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/213 2023-06-09T12:48:45.836 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/213 2023-06-09T12:48:45.836 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:45.850 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:45.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:45.929 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-06-09T12:48:46.683 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:46.707 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:46.709 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:46.715 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:46.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:47.711 INFO:teuthology.orchestra.run.smithi078.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T12:48:47.732 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/214 2023-06-09T12:48:47.732 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/214 2023-06-09T12:48:47.732 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:47.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:47.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:47.854 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-06-09T12:48:48.595 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:48.617 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:48.621 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:48.626 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:48.626 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:50.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:50.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:51.784 INFO:teuthology.orchestra.run.smithi078.stdout:generic/215 2s 2023-06-09T12:48:51.809 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/215 2023-06-09T12:48:51.809 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:51.823 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:51.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:51.982 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-06-09T12:48:52.731 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:52.753 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:52.756 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:52.763 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:52.764 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:54.340 INFO:teuthology.orchestra.run.smithi078.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:48:54.408 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/216 2023-06-09T12:48:54.409 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/216 2023-06-09T12:48:54.409 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:54.430 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:54.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:54.538 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-06-09T12:48:55.279 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:55.301 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:55.303 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:55.309 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:55.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:56.822 INFO:teuthology.orchestra.run.smithi078.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:48:56.913 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/217 2023-06-09T12:48:56.913 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/217 2023-06-09T12:48:56.914 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:56.944 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:57.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:57.060 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-06-09T12:48:57.748 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:48:57.768 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:48:57.771 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:48:57.778 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:48:57.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:59.331 INFO:teuthology.orchestra.run.smithi078.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:48:59.371 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/218 2023-06-09T12:48:59.372 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/218 2023-06-09T12:48:59.372 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:48:59.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:48:59.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:48:59.513 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-06-09T12:49:00.210 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:00.230 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:00.233 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:00.239 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:00.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:01.192 INFO:teuthology.orchestra.run.smithi078.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:49:01.209 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/219 2023-06-09T12:49:01.210 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/219 2023-06-09T12:49:01.210 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:01.220 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:01.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:01.321 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-06-09T12:49:02.063 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:02.085 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:02.089 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:02.096 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:02.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:03.679 INFO:teuthology.orchestra.run.smithi078.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:49:03.785 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/220 2023-06-09T12:49:03.785 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/220 2023-06-09T12:49:03.785 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:03.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:03.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:03.909 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-06-09T12:49:04.631 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:04.649 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:04.653 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:04.657 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:04.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:06.689 INFO:teuthology.orchestra.run.smithi078.stdout:generic/221 1s 2023-06-09T12:49:06.716 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/221 2023-06-09T12:49:06.716 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:06.729 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:06.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:06.846 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-06-09T12:49:07.594 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:07.618 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:07.621 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:07.627 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:07.627 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:09.199 INFO:teuthology.orchestra.run.smithi078.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:49:09.227 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/222 2023-06-09T12:49:09.227 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/222 2023-06-09T12:49:09.227 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:09.243 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:09.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:09.393 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-06-09T12:49:10.072 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:10.092 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:10.095 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:10.100 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:10.100 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:11.114 INFO:teuthology.orchestra.run.smithi078.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T12:49:11.135 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/223 2023-06-09T12:49:11.136 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/223 2023-06-09T12:49:11.136 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:11.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:11.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:11.267 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-06-09T12:49:12.011 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:12.034 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:12.037 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:12.043 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:12.043 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:12.970 INFO:teuthology.orchestra.run.smithi078.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:49:12.990 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/224 2023-06-09T12:49:12.991 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/224 2023-06-09T12:49:12.991 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:13.002 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:13.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:13.096 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-06-09T12:49:13.819 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:13.840 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:13.843 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:13.848 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:13.848 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:14.924 INFO:teuthology.orchestra.run.smithi078.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T12:49:14.944 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/225 2023-06-09T12:49:14.944 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/225 2023-06-09T12:49:14.944 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:14.956 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:15.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:15.322 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-06-09T12:49:16.033 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:16.054 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:16.057 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:16.062 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:16.063 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:17.095 INFO:teuthology.orchestra.run.smithi078.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:49:17.115 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/226 2023-06-09T12:49:17.116 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/226 2023-06-09T12:49:17.116 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:17.128 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:17.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:17.231 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-06-09T12:49:17.974 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:17.997 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:17.999 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:18.005 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:18.005 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:19.479 INFO:teuthology.orchestra.run.smithi078.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:49:19.523 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/227 2023-06-09T12:49:19.530 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/227 2023-06-09T12:49:19.530 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:19.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:19.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:19.721 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-06-09T12:49:20.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:20.123 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:20.411 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:20.433 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:20.436 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:20.442 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:21.728 INFO:teuthology.orchestra.run.smithi078.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T12:49:21.747 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/228 2023-06-09T12:49:21.748 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/228 2023-06-09T12:49:21.748 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:21.759 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:21.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:21.855 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-06-09T12:49:22.600 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:22.621 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:22.624 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:22.629 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:22.630 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:24.180 INFO:teuthology.orchestra.run.smithi078.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:49:24.282 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/229 2023-06-09T12:49:24.283 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/229 2023-06-09T12:49:24.283 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:24.306 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:24.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:24.404 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-06-09T12:49:25.119 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:25.140 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:25.143 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:25.149 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:25.149 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:26.113 INFO:teuthology.orchestra.run.smithi078.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:49:26.131 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/230 2023-06-09T12:49:26.131 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/230 2023-06-09T12:49:26.131 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:26.143 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:26.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:26.237 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-06-09T12:49:26.962 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:26.985 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:26.989 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:26.995 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:26.996 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:27.960 INFO:teuthology.orchestra.run.smithi078.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:49:27.979 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/231 2023-06-09T12:49:27.980 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/231 2023-06-09T12:49:27.980 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:27.993 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:28.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:28.081 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-06-09T12:49:28.820 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:28.842 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:28.845 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:28.851 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:28.851 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:29.779 INFO:teuthology.orchestra.run.smithi078.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:49:29.796 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/232 2023-06-09T12:49:29.796 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/232 2023-06-09T12:49:29.796 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:29.808 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:29.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:29.903 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-06-09T12:49:30.650 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:30.673 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:30.675 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:30.681 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:30.681 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:31.620 INFO:teuthology.orchestra.run.smithi078.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:49:31.641 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/233 2023-06-09T12:49:31.641 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/233 2023-06-09T12:49:31.641 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:31.652 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:31.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:31.741 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-06-09T12:49:32.466 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:32.488 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:32.491 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:32.495 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:33.439 INFO:teuthology.orchestra.run.smithi078.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:49:33.459 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/234 2023-06-09T12:49:33.460 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/234 2023-06-09T12:49:33.460 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:33.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:33.568 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-06-09T12:49:34.327 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:34.351 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:34.354 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:34.360 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:34.360 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:35.341 INFO:teuthology.orchestra.run.smithi078.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:49:35.363 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/235 2023-06-09T12:49:35.363 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/235 2023-06-09T12:49:35.363 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:35.375 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:35.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:35.467 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-06-09T12:49:36.178 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:36.202 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:36.205 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:36.210 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:36.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:38.586 INFO:teuthology.orchestra.run.smithi078.stdout:generic/236 2s 2023-06-09T12:49:38.613 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/236 2023-06-09T12:49:38.614 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:38.627 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:38.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:38.972 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-06-09T12:49:39.694 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:39.717 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:39.720 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:39.725 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:39.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:40.974 INFO:teuthology.orchestra.run.smithi078.stdout:generic/237 0s 2023-06-09T12:49:41.001 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/237 2023-06-09T12:49:41.001 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:41.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:41.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:41.344 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-06-09T12:49:42.068 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:42.090 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:42.093 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:42.098 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:42.099 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:43.758 INFO:teuthology.orchestra.run.smithi078.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:49:43.813 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/238 2023-06-09T12:49:43.814 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/238 2023-06-09T12:49:43.814 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:49:43.835 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:43.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:49:43.932 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-06-09T12:49:44.675 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:49:44.697 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:49:44.700 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:49:44.705 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:49:44.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:49:50.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:50.268 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:20.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:20.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:50.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:50.596 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:20.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:20.745 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:52.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:52.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:52.225 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T12:51:52.217+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41103) UID: 0 2023-06-09T12:51:52.225 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T12:51:52.217+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41103) UID: 0 2023-06-09T12:51:52.225 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T12:51:52.217+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41103) UID: 0 2023-06-09T12:51:52.226 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T12:51:52.217+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41103) UID: 0 2023-06-09T12:52:05.800 INFO:teuthology.orchestra.run.smithi078.stdout:generic/239 140s 2023-06-09T12:52:05.827 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/239 2023-06-09T12:52:05.827 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:52:05.839 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:52:06.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:52:06.024 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-06-09T12:52:06.802 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:52:06.826 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:52:06.830 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:52:06.835 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:52:06.835 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:52:08.562 INFO:teuthology.orchestra.run.smithi078.stdout:generic/240 1s 2023-06-09T12:52:08.587 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/240 2023-06-09T12:52:08.588 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:52:08.598 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:52:08.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:52:08.906 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-06-09T12:52:09.673 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:52:09.693 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:52:09.696 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:52:09.700 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:52:09.700 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:23.736 INFO:teuthology.orchestra.run.smithi078.stdout:generic/241 73s 2023-06-09T12:53:23.753 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/241 2023-06-09T12:53:23.753 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:23.769 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:26.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:26.181 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-06-09T12:53:27.175 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:27.191 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:27.192 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:27.196 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:27.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:28.843 INFO:teuthology.orchestra.run.smithi078.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:53:28.872 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/242 2023-06-09T12:53:28.872 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/242 2023-06-09T12:53:28.872 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:28.894 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:29.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:29.019 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-06-09T12:53:29.714 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:29.733 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:29.736 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:29.741 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:29.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:31.277 INFO:teuthology.orchestra.run.smithi078.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:53:31.300 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/243 2023-06-09T12:53:31.301 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/243 2023-06-09T12:53:31.301 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:31.344 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:31.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:31.473 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-06-09T12:53:32.171 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:32.191 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:32.194 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:32.199 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:32.200 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:33.115 INFO:teuthology.orchestra.run.smithi078.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:53:33.138 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/244 2023-06-09T12:53:33.138 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/244 2023-06-09T12:53:33.138 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:33.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:33.237 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-06-09T12:53:33.973 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:33.997 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:34.000 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:34.006 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:34.006 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:35.113 INFO:teuthology.orchestra.run.smithi078.stdout:generic/245 1s 2023-06-09T12:53:35.139 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/245 2023-06-09T12:53:35.139 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:35.153 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:35.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:35.467 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-06-09T12:53:36.211 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:36.234 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:36.237 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:36.242 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:36.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:37.332 INFO:teuthology.orchestra.run.smithi078.stdout:generic/246 1s 2023-06-09T12:53:37.364 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/246 2023-06-09T12:53:37.364 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:37.375 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:37.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:37.715 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-06-09T12:53:38.438 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:38.460 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:38.463 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:38.469 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:38.470 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:51.060 INFO:teuthology.orchestra.run.smithi078.stdout:generic/247 13s 2023-06-09T12:53:51.085 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/247 2023-06-09T12:53:51.086 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:51.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:51.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:51.133 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-06-09T12:53:51.870 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:51.891 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:51.893 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:51.898 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:51.898 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:52.924 INFO:teuthology.orchestra.run.smithi078.stdout:generic/248 0s 2023-06-09T12:53:52.950 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/248 2023-06-09T12:53:52.951 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:52.963 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:53.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:53.066 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-06-09T12:53:53.787 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:53.809 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:53.812 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:53.817 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:53.817 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:55.219 INFO:teuthology.orchestra.run.smithi078.stdout:generic/249 1s 2023-06-09T12:53:55.247 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/249 2023-06-09T12:53:55.247 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:55.259 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:55.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:55.637 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-06-09T12:53:56.353 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:56.373 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:56.375 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:56.380 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:56.380 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:57.410 INFO:teuthology.orchestra.run.smithi078.stdout:generic/250 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T12:53:57.430 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/250 2023-06-09T12:53:57.431 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/250 2023-06-09T12:53:57.431 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:57.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:57.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:57.540 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-06-09T12:53:58.279 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:53:58.301 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:53:58.304 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:58.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:59.527 INFO:teuthology.orchestra.run.smithi078.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:53:59.600 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/251 2023-06-09T12:53:59.600 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/251 2023-06-09T12:53:59.600 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:53:59.612 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:53:59.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:53:59.677 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-06-09T12:54:00.410 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:00.433 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:00.436 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:00.442 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:00.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:01.442 INFO:teuthology.orchestra.run.smithi078.stdout:generic/252 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T12:54:01.462 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/252 2023-06-09T12:54:01.462 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/252 2023-06-09T12:54:01.462 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:01.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:01.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:01.574 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-06-09T12:54:02.300 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:02.319 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:02.322 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:02.327 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:02.328 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:03.739 INFO:teuthology.orchestra.run.smithi078.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:54:03.915 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/253 2023-06-09T12:54:03.916 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/253 2023-06-09T12:54:03.916 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:03.946 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:04.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:04.049 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-06-09T12:54:04.785 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:04.808 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:04.811 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:04.816 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:04.816 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:06.338 INFO:teuthology.orchestra.run.smithi078.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:54:06.364 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/254 2023-06-09T12:54:06.364 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/254 2023-06-09T12:54:06.364 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:06.434 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:06.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:06.636 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-06-09T12:54:07.356 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:07.377 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:07.380 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:07.385 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:07.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:08.608 INFO:teuthology.orchestra.run.smithi078.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T12:54:08.629 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/255 2023-06-09T12:54:08.629 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/255 2023-06-09T12:54:08.630 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:08.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:08.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:08.928 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-06-09T12:54:09.634 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:09.656 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:09.659 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:09.664 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:09.664 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:11.159 INFO:teuthology.orchestra.run.smithi078.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:54:11.182 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/256 2023-06-09T12:54:11.182 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/256 2023-06-09T12:54:11.182 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:11.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:11.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:11.290 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-06-09T12:54:12.009 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:12.030 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:12.033 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:12.038 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:12.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:14.066 INFO:teuthology.orchestra.run.smithi078.stdout:generic/257 2s 2023-06-09T12:54:14.097 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/257 2023-06-09T12:54:14.097 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:14.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:14.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:14.447 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-06-09T12:54:15.166 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:15.185 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:15.189 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:15.194 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:15.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:16.105 INFO:teuthology.orchestra.run.smithi078.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-06-09T12:54:16.122 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/258 2023-06-09T12:54:16.122 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/258 2023-06-09T12:54:16.122 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:16.135 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:16.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:16.227 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-06-09T12:54:16.959 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:16.982 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:16.985 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:16.992 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:16.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:18.535 INFO:teuthology.orchestra.run.smithi078.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:54:18.588 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/259 2023-06-09T12:54:18.588 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/259 2023-06-09T12:54:18.588 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:18.616 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:18.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:18.791 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-06-09T12:54:19.514 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:19.534 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:19.538 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:19.544 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:19.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:20.693 INFO:teuthology.orchestra.run.smithi078.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:20.773 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/260 2023-06-09T12:54:20.773 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/260 2023-06-09T12:54:20.773 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:20.784 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:20.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:20.870 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-06-09T12:54:21.602 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:21.625 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:21.628 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:21.634 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:21.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:23.175 INFO:teuthology.orchestra.run.smithi078.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:54:23.227 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/261 2023-06-09T12:54:23.227 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/261 2023-06-09T12:54:23.228 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:23.254 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:23.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:23.420 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-06-09T12:54:24.135 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:24.159 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:24.161 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:24.168 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:24.168 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:25.710 INFO:teuthology.orchestra.run.smithi078.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:54:25.746 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/262 2023-06-09T12:54:25.747 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/262 2023-06-09T12:54:25.747 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:54:25.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:54:25.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:54:25.986 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-06-09T12:54:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:54:26.726 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:54:26.729 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:54:26.734 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:54:26.735 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:06.197 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:06.201 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:36.268 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:36.274 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:41.125 INFO:teuthology.orchestra.run.smithi078.stdout:generic/263 74s 2023-06-09T12:55:41.153 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/263 2023-06-09T12:55:41.153 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:41.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:41.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:41.538 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-06-09T12:55:42.203 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:42.225 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:42.228 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:42.233 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:42.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:43.822 INFO:teuthology.orchestra.run.smithi078.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:55:43.878 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/264 2023-06-09T12:55:43.878 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/264 2023-06-09T12:55:43.879 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:43.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:43.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:43.986 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-06-09T12:55:44.692 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:44.713 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:44.716 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:44.722 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:44.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:46.421 INFO:teuthology.orchestra.run.smithi078.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:55:46.453 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/265 2023-06-09T12:55:46.454 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/265 2023-06-09T12:55:46.454 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:46.466 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:46.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:46.557 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-06-09T12:55:47.255 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:47.278 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:47.280 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:47.286 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:47.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:48.864 INFO:teuthology.orchestra.run.smithi078.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:55:48.955 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/266 2023-06-09T12:55:48.955 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/266 2023-06-09T12:55:48.955 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:48.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:49.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:49.061 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-06-09T12:55:49.783 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:49.803 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:49.807 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:49.811 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:49.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:51.325 INFO:teuthology.orchestra.run.smithi078.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:55:51.424 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/267 2023-06-09T12:55:51.424 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/267 2023-06-09T12:55:51.425 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:51.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:51.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:51.569 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-06-09T12:55:52.257 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:52.278 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:52.280 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:52.286 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:52.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:53.838 INFO:teuthology.orchestra.run.smithi078.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:55:53.909 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/268 2023-06-09T12:55:53.910 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/268 2023-06-09T12:55:53.910 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:53.928 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:54.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:54.039 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-06-09T12:55:54.744 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:54.765 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:54.768 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:54.774 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:54.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:55.735 INFO:teuthology.orchestra.run.smithi078.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:55:55.754 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/269 2023-06-09T12:55:55.754 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/269 2023-06-09T12:55:55.755 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:55.768 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:55.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:55.861 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-06-09T12:55:56.613 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:56.633 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:56.637 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:56.643 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:56.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:57.630 INFO:teuthology.orchestra.run.smithi078.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:55:57.652 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/270 2023-06-09T12:55:57.652 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/270 2023-06-09T12:55:57.652 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:55:57.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:55:57.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:55:57.769 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-06-09T12:55:58.496 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:55:58.518 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:55:58.521 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:55:58.526 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:55:58.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:00.141 INFO:teuthology.orchestra.run.smithi078.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:00.198 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/271 2023-06-09T12:56:00.198 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/271 2023-06-09T12:56:00.198 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:00.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:00.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:00.321 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-06-09T12:56:01.030 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:01.054 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:01.057 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:01.062 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:01.062 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:02.550 INFO:teuthology.orchestra.run.smithi078.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:02.612 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/272 2023-06-09T12:56:02.612 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/272 2023-06-09T12:56:02.612 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:02.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:02.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:02.782 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-06-09T12:56:03.490 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:03.511 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:03.514 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:03.519 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:03.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:04.464 INFO:teuthology.orchestra.run.smithi078.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:56:04.482 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/273 2023-06-09T12:56:04.483 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/273 2023-06-09T12:56:04.483 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:04.495 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:04.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:04.621 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-06-09T12:56:05.360 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:05.383 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:05.386 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:05.393 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:05.393 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:06.431 INFO:teuthology.orchestra.run.smithi078.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T12:56:06.451 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/274 2023-06-09T12:56:06.451 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/274 2023-06-09T12:56:06.451 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:06.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:06.458 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:06.462 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:06.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:06.555 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-06-09T12:56:07.346 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:07.369 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:07.372 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:07.377 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:07.377 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:08.336 INFO:teuthology.orchestra.run.smithi078.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:56:08.357 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/275 2023-06-09T12:56:08.357 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/275 2023-06-09T12:56:08.357 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:08.367 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:08.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:08.449 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-06-09T12:56:09.166 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:09.186 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:09.189 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:09.194 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:09.194 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:10.740 INFO:teuthology.orchestra.run.smithi078.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:10.837 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/276 2023-06-09T12:56:10.837 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/276 2023-06-09T12:56:10.838 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:10.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:10.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:10.945 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-06-09T12:56:11.650 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:11.670 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:11.673 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:11.678 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:11.679 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:12.780 INFO:teuthology.orchestra.run.smithi078.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-06-09T12:56:12.799 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/277 2023-06-09T12:56:12.799 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/277 2023-06-09T12:56:12.800 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:12.814 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:12.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:12.930 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-06-09T12:56:13.669 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:13.691 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:13.694 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:13.701 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:13.701 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:15.240 INFO:teuthology.orchestra.run.smithi078.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:15.274 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/278 2023-06-09T12:56:15.274 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/278 2023-06-09T12:56:15.274 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:15.312 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:15.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:15.448 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-06-09T12:56:16.169 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:16.192 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:16.195 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:16.201 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:16.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:17.771 INFO:teuthology.orchestra.run.smithi078.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:17.844 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/279 2023-06-09T12:56:17.844 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/279 2023-06-09T12:56:17.844 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:17.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:17.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:17.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-06-09T12:56:18.679 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:18.701 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:18.705 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:18.710 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:18.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:19.778 INFO:teuthology.orchestra.run.smithi078.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T12:56:19.794 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/280 2023-06-09T12:56:19.794 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/280 2023-06-09T12:56:19.794 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:19.806 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:19.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:19.905 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-06-09T12:56:20.663 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:20.684 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:20.687 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:20.692 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:20.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:22.304 INFO:teuthology.orchestra.run.smithi078.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:22.333 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/281 2023-06-09T12:56:22.333 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/281 2023-06-09T12:56:22.333 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:22.388 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:22.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:22.486 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-06-09T12:56:23.198 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:23.216 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:23.218 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:23.223 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:23.223 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:24.883 INFO:teuthology.orchestra.run.smithi078.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:24.918 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/282 2023-06-09T12:56:24.918 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/282 2023-06-09T12:56:24.918 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:24.943 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:25.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:25.018 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-06-09T12:56:25.736 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:25.757 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:25.760 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:25.766 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:27.256 INFO:teuthology.orchestra.run.smithi078.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:27.367 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/283 2023-06-09T12:56:27.367 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/283 2023-06-09T12:56:27.367 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:27.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:27.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:27.526 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-06-09T12:56:28.223 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:28.245 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:28.248 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:28.254 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:28.254 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:29.876 INFO:teuthology.orchestra.run.smithi078.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:29.913 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/284 2023-06-09T12:56:29.914 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/284 2023-06-09T12:56:29.914 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:29.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:30.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:30.059 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-06-09T12:56:30.791 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:30.813 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:30.817 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:30.822 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:30.822 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:33.877 INFO:teuthology.orchestra.run.smithi078.stdout:generic/285 2s 2023-06-09T12:56:33.901 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/285 2023-06-09T12:56:33.901 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:33.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:34.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:34.581 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-06-09T12:56:35.397 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:35.415 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:35.416 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:35.420 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:35.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:36.221 INFO:teuthology.orchestra.run.smithi078.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T12:56:36.236 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/286 2023-06-09T12:56:36.236 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/286 2023-06-09T12:56:36.237 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:36.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:36.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:36.336 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-06-09T12:56:36.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:36.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:36.928 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:36.943 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:36.945 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:36.948 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:36.948 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:38.207 INFO:teuthology.orchestra.run.smithi078.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:38.268 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/287 2023-06-09T12:56:38.268 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/287 2023-06-09T12:56:38.268 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:38.315 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:38.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:38.457 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-06-09T12:56:39.044 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:39.057 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:39.060 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:39.063 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:39.064 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:40.018 INFO:teuthology.orchestra.run.smithi078.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:40.083 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/288 2023-06-09T12:56:40.083 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/288 2023-06-09T12:56:40.083 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:40.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:40.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:40.186 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-06-09T12:56:40.906 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:40.929 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:40.932 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:40.937 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:40.938 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:42.393 INFO:teuthology.orchestra.run.smithi078.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:42.444 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/289 2023-06-09T12:56:42.445 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/289 2023-06-09T12:56:42.445 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:42.481 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:42.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:42.576 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-06-09T12:56:43.254 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:43.275 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:43.278 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:43.284 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:43.284 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:44.823 INFO:teuthology.orchestra.run.smithi078.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:44.845 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/290 2023-06-09T12:56:44.845 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/290 2023-06-09T12:56:44.845 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:44.863 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:44.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:44.965 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-06-09T12:56:45.648 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:45.669 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:45.672 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:45.678 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:45.678 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:47.194 INFO:teuthology.orchestra.run.smithi078.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:47.219 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/291 2023-06-09T12:56:47.219 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/291 2023-06-09T12:56:47.219 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:47.276 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:47.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:47.373 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-06-09T12:56:48.074 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:48.098 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:48.101 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:48.106 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:48.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:49.592 INFO:teuthology.orchestra.run.smithi078.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:49.671 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/292 2023-06-09T12:56:49.671 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/292 2023-06-09T12:56:49.671 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:49.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:49.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:49.805 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-06-09T12:56:50.479 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:50.501 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:50.503 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:50.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:52.038 INFO:teuthology.orchestra.run.smithi078.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:52.130 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/293 2023-06-09T12:56:52.130 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/293 2023-06-09T12:56:52.130 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:52.152 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:52.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:52.232 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-06-09T12:56:52.939 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:52.961 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:52.964 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:52.969 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:52.969 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:54.737 INFO:teuthology.orchestra.run.smithi078.stdout:generic/294 1s 2023-06-09T12:56:54.813 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/294 2023-06-09T12:56:54.813 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:54.838 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:54.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:54.887 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-06-09T12:56:55.595 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:55.617 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:55.620 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:55.626 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:55.627 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:57.157 INFO:teuthology.orchestra.run.smithi078.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:57.182 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/295 2023-06-09T12:56:57.182 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/295 2023-06-09T12:56:57.182 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:57.225 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:57.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:57.314 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-06-09T12:56:58.007 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:56:58.029 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:56:58.033 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:56:58.039 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:56:58.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:59.581 INFO:teuthology.orchestra.run.smithi078.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:56:59.648 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/296 2023-06-09T12:56:59.649 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/296 2023-06-09T12:56:59.649 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:56:59.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:56:59.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:56:59.755 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-06-09T12:57:00.475 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:00.497 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:00.500 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:00.506 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:00.506 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:01.928 INFO:teuthology.orchestra.run.smithi078.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:57:01.947 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/297 2023-06-09T12:57:01.948 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/297 2023-06-09T12:57:01.948 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:01.981 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:02.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:02.140 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-06-09T12:57:02.820 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:02.841 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:02.844 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:02.850 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:02.850 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:04.341 INFO:teuthology.orchestra.run.smithi078.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:57:04.442 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/298 2023-06-09T12:57:04.443 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/298 2023-06-09T12:57:04.444 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:04.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:04.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:04.573 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-06-09T12:57:05.271 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:05.294 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:05.297 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:05.303 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:05.303 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:06.416 INFO:teuthology.orchestra.run.smithi078.stdout:generic/299 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T12:57:06.437 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/299 2023-06-09T12:57:06.438 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/299 2023-06-09T12:57:06.438 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:06.450 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:06.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:06.540 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-06-09T12:57:07.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:07.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:07.259 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:07.281 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:07.285 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:07.291 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:07.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:08.345 INFO:teuthology.orchestra.run.smithi078.stdout:generic/300 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T12:57:08.366 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/300 2023-06-09T12:57:08.366 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/300 2023-06-09T12:57:08.366 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:08.378 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:08.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:08.465 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-06-09T12:57:09.205 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:09.226 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:09.229 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:09.235 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:09.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:10.708 INFO:teuthology.orchestra.run.smithi078.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:57:10.728 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/301 2023-06-09T12:57:10.729 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/301 2023-06-09T12:57:10.729 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:10.801 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:10.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:10.910 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-06-09T12:57:11.632 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:11.653 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:11.656 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:11.661 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:11.661 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:13.091 INFO:teuthology.orchestra.run.smithi078.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:57:13.228 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/302 2023-06-09T12:57:13.229 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/302 2023-06-09T12:57:13.229 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:13.277 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:13.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:13.361 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-06-09T12:57:14.073 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:14.094 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:14.097 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:14.102 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:14.103 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:15.179 INFO:teuthology.orchestra.run.smithi078.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T12:57:15.198 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/303 2023-06-09T12:57:15.198 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/303 2023-06-09T12:57:15.199 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:15.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:15.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:15.490 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-06-09T12:57:16.258 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:16.281 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:16.285 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:16.290 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:16.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:17.356 INFO:teuthology.orchestra.run.smithi078.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T12:57:17.374 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/304 2023-06-09T12:57:17.374 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/304 2023-06-09T12:57:17.374 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:17.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:17.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:17.710 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-06-09T12:57:18.426 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:18.450 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:18.453 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:18.459 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:18.459 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:19.971 INFO:teuthology.orchestra.run.smithi078.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T12:57:20.041 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/305 2023-06-09T12:57:20.042 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/305 2023-06-09T12:57:20.042 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:20.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:20.162 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-06-09T12:57:20.852 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:20.872 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:20.875 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:20.881 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:20.882 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:22.906 INFO:teuthology.orchestra.run.smithi078.stdout:generic/306 1s 2023-06-09T12:57:22.928 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/306 2023-06-09T12:57:22.928 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:22.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:23.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:23.183 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-06-09T12:57:23.972 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:23.992 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:23.996 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:24.001 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:24.002 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:26.801 INFO:teuthology.orchestra.run.smithi078.stdout:generic/307 2s 2023-06-09T12:57:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/307 2023-06-09T12:57:26.825 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:26.836 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:26.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:26.875 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-06-09T12:57:27.612 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:27.633 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:27.635 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:27.641 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:27.641 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:28.669 INFO:teuthology.orchestra.run.smithi078.stdout:generic/308 1s 2023-06-09T12:57:28.698 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/308 2023-06-09T12:57:28.699 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:28.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:28.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:28.815 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-06-09T12:57:29.533 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:29.553 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:29.557 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:29.562 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:29.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:31.685 INFO:teuthology.orchestra.run.smithi078.stdout:generic/309 2s 2023-06-09T12:57:31.714 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/309 2023-06-09T12:57:31.714 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:57:31.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:32.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:57:32.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-06-09T12:57:32.780 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:57:32.799 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:57:32.802 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:57:32.808 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:57:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:57:37.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:37.207 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:07.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:07.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:37.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:37.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:04.918 INFO:teuthology.orchestra.run.smithi078.stdout:generic/310 91s 2023-06-09T12:59:04.947 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/310 2023-06-09T12:59:04.947 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:04.960 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:05.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:05.361 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-06-09T12:59:06.168 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:06.190 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:06.193 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:06.199 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:06.199 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:07.247 INFO:teuthology.orchestra.run.smithi078.stdout:generic/311 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T12:59:07.267 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/311 2023-06-09T12:59:07.268 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/311 2023-06-09T12:59:07.268 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:07.280 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:07.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:07.393 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-06-09T12:59:07.576 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:07.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:08.106 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:08.126 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:08.129 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:08.135 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:08.135 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:09.072 INFO:teuthology.orchestra.run.smithi078.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T12:59:09.094 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/312 2023-06-09T12:59:09.094 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/312 2023-06-09T12:59:09.095 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:09.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:09.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:09.207 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-06-09T12:59:09.927 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:09.949 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:09.952 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:09.957 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:09.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:15.044 INFO:teuthology.orchestra.run.smithi078.stdout:generic/313 5s 2023-06-09T12:59:15.066 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/313 2023-06-09T12:59:15.066 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:15.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:15.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:15.194 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-06-09T12:59:15.936 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:15.957 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:15.961 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:15.966 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:15.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:17.459 INFO:teuthology.orchestra.run.smithi078.stdout:generic/314 1s 2023-06-09T12:59:17.485 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/314 2023-06-09T12:59:17.486 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:17.498 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:17.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:17.607 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-06-09T12:59:18.357 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:18.377 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:18.380 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:18.386 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:18.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:19.366 INFO:teuthology.orchestra.run.smithi078.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T12:59:19.386 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/315 2023-06-09T12:59:19.386 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/315 2023-06-09T12:59:19.386 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:19.401 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:19.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:19.498 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-06-09T12:59:20.195 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:20.217 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:20.220 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:20.225 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:21.498 INFO:teuthology.orchestra.run.smithi078.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T12:59:21.517 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/316 2023-06-09T12:59:21.517 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/316 2023-06-09T12:59:21.517 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:21.528 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:21.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:21.894 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-06-09T12:59:22.650 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:22.672 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:22.675 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:22.680 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:22.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:25.341 INFO:teuthology.orchestra.run.smithi078.stdout:generic/317 2s 2023-06-09T12:59:25.367 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/317 2023-06-09T12:59:25.367 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:25.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:25.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:25.421 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-06-09T12:59:26.164 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:26.184 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:26.187 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:26.193 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:26.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:28.242 INFO:teuthology.orchestra.run.smithi078.stdout:generic/318 2s 2023-06-09T12:59:28.268 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/318 2023-06-09T12:59:28.268 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:28.280 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:28.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:28.323 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-06-09T12:59:29.071 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:29.093 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:29.095 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:29.100 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:29.100 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:30.569 INFO:teuthology.orchestra.run.smithi078.stdout:generic/319 1s 2023-06-09T12:59:30.593 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/319 2023-06-09T12:59:30.593 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:30.603 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:30.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:30.645 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-06-09T12:59:31.381 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:31.402 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:31.405 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:31.410 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:31.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:32.392 INFO:teuthology.orchestra.run.smithi078.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T12:59:32.410 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/320 2023-06-09T12:59:32.410 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/320 2023-06-09T12:59:32.410 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:32.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:32.550 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-06-09T12:59:33.283 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:33.308 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:33.311 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:33.316 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:34.280 INFO:teuthology.orchestra.run.smithi078.stdout:generic/321 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T12:59:34.299 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/321 2023-06-09T12:59:34.300 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/321 2023-06-09T12:59:34.300 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:34.312 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:34.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:34.408 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-06-09T12:59:35.148 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:35.172 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:35.175 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:35.180 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:35.180 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:36.153 INFO:teuthology.orchestra.run.smithi078.stdout:generic/322 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T12:59:36.173 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/322 2023-06-09T12:59:36.173 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/322 2023-06-09T12:59:36.174 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T12:59:36.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:36.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T12:59:36.281 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-06-09T12:59:37.009 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T12:59:37.031 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T12:59:37.033 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T12:59:37.039 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T12:59:37.040 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T12:59:37.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:37.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:07.868 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:07.876 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:38.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:38.020 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:08.160 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:08.166 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:39.009 INFO:teuthology.orchestra.run.smithi078.stdout:generic/323 121s 2023-06-09T13:01:39.039 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/323 2023-06-09T13:01:39.039 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:39.054 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:39.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:39.352 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-06-09T13:01:39.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:39.502 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:40.071 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:40.094 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:40.097 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:40.104 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:40.104 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:41.077 INFO:teuthology.orchestra.run.smithi078.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-06-09T13:01:41.094 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/324 2023-06-09T13:01:41.094 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/324 2023-06-09T13:01:41.094 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:41.104 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:41.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:41.203 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-06-09T13:01:41.956 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:41.979 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:41.983 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:41.990 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:41.990 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:43.001 INFO:teuthology.orchestra.run.smithi078.stdout:generic/325 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:01:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/325 2023-06-09T13:01:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/325 2023-06-09T13:01:43.024 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:43.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:43.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:43.136 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-06-09T13:01:43.871 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:43.893 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:43.897 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:43.903 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:43.903 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:45.364 INFO:teuthology.orchestra.run.smithi078.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:01:45.470 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/326 2023-06-09T13:01:45.470 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/326 2023-06-09T13:01:45.471 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:45.515 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:45.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:45.641 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-06-09T13:01:46.387 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:46.410 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:46.413 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:46.420 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:46.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:47.927 INFO:teuthology.orchestra.run.smithi078.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:01:47.953 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/327 2023-06-09T13:01:47.953 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/327 2023-06-09T13:01:47.953 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:47.993 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:48.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:48.146 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-06-09T13:01:48.880 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:48.901 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:48.905 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:48.910 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:48.910 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:50.485 INFO:teuthology.orchestra.run.smithi078.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:01:50.534 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/328 2023-06-09T13:01:50.534 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/328 2023-06-09T13:01:50.534 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:50.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:50.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:50.677 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-06-09T13:01:51.395 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:51.416 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:51.419 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:51.425 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:51.425 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:53.092 INFO:teuthology.orchestra.run.smithi078.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:01:53.129 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/329 2023-06-09T13:01:53.129 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/329 2023-06-09T13:01:53.129 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:53.155 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:53.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:53.265 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-06-09T13:01:54.011 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:54.033 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:54.036 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:54.042 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:54.042 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:55.617 INFO:teuthology.orchestra.run.smithi078.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:01:55.640 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/330 2023-06-09T13:01:55.640 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/330 2023-06-09T13:01:55.640 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:55.655 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:55.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:55.791 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-06-09T13:01:56.521 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:56.543 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:56.546 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:56.552 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:56.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:58.137 INFO:teuthology.orchestra.run.smithi078.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:01:58.211 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/331 2023-06-09T13:01:58.211 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/331 2023-06-09T13:01:58.211 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:01:58.249 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:01:58.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:01:58.364 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-06-09T13:01:59.099 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:01:59.121 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:01:59.123 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:01:59.128 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:01:59.128 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:00.789 INFO:teuthology.orchestra.run.smithi078.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:02:00.857 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/332 2023-06-09T13:02:00.858 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/332 2023-06-09T13:02:00.858 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:02:00.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:00.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:02:00.969 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-06-09T13:02:01.699 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:02:01.716 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:02:01.718 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:02:01.723 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:02:01.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:03.296 INFO:teuthology.orchestra.run.smithi078.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:02:03.350 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/333 2023-06-09T13:02:03.350 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/333 2023-06-09T13:02:03.350 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:02:03.376 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:03.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:02:03.464 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-06-09T13:02:04.179 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:02:04.202 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:02:04.205 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:02:04.210 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:02:04.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:05.803 INFO:teuthology.orchestra.run.smithi078.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:02:05.860 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/334 2023-06-09T13:02:05.861 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/334 2023-06-09T13:02:05.861 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:02:05.901 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:06.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:02:06.019 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-06-09T13:02:06.743 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:02:06.766 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:02:06.769 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:02:06.776 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:02:06.776 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:07.746 INFO:teuthology.orchestra.run.smithi078.stdout:generic/335 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:02:07.766 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/335 2023-06-09T13:02:07.766 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/335 2023-06-09T13:02:07.767 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:02:07.781 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:07.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:02:07.877 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-06-09T13:02:08.612 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:02:08.635 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:02:08.638 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:02:08.642 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:02:08.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:09.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:09.590 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:09.663 INFO:teuthology.orchestra.run.smithi078.stdout:generic/336 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:02:09.684 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/336 2023-06-09T13:02:09.684 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/336 2023-06-09T13:02:09.684 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:02:09.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:09.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:02:09.790 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-06-09T13:02:10.512 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:02:10.532 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:02:10.535 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:02:10.541 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:02:10.542 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:12.122 INFO:teuthology.orchestra.run.smithi078.stdout:generic/337 2s 2023-06-09T13:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/337 2023-06-09T13:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:02:12.159 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:12.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:02:12.202 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-06-09T13:02:12.922 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:02:12.944 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:02:12.946 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:02:12.951 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:02:12.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:13.936 INFO:teuthology.orchestra.run.smithi078.stdout:generic/338 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:02:13.954 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/338 2023-06-09T13:02:13.955 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/338 2023-06-09T13:02:13.955 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:02:13.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:14.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:02:14.084 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-06-09T13:02:14.835 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:02:14.855 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:02:14.858 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:02:14.863 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:02:14.864 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:02:39.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:39.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:10.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:10.860 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:33.056 INFO:teuthology.orchestra.run.smithi078.stdout:generic/339 78s 2023-06-09T13:03:33.082 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/339 2023-06-09T13:03:33.083 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:03:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:33.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:03:33.137 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-06-09T13:03:33.915 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:03:33.933 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:03:33.936 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:03:33.941 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:03:33.942 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:40.227 INFO:teuthology.orchestra.run.smithi078.stdout:generic/340 6s 2023-06-09T13:03:40.260 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/340 2023-06-09T13:03:40.260 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:03:40.267 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:40.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:03:40.294 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-06-09T13:03:40.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:40.936 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:41.009 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:03:41.024 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:03:41.026 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:03:41.029 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:03:41.029 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:41.112 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T13:03:41.102+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42020) UID: 0 2023-06-09T13:03:41.113 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T13:03:41.102+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42020) UID: 0 2023-06-09T13:03:41.978 INFO:teuthology.orchestra.run.smithi078.stdout:generic/341 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:03:42.002 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/341 2023-06-09T13:03:42.002 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/341 2023-06-09T13:03:42.002 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:03:42.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:42.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:03:42.099 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-06-09T13:03:42.861 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:03:42.882 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:03:42.885 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:03:42.890 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:03:42.890 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:43.835 INFO:teuthology.orchestra.run.smithi078.stdout:generic/342 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:03:43.856 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/342 2023-06-09T13:03:43.856 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/342 2023-06-09T13:03:43.857 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:03:43.871 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:43.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:03:43.961 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-06-09T13:03:44.701 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:03:44.725 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:03:44.728 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:03:44.733 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:03:44.733 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:45.754 INFO:teuthology.orchestra.run.smithi078.stdout:generic/343 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:03:45.775 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/343 2023-06-09T13:03:45.775 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/343 2023-06-09T13:03:45.775 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:03:45.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:45.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:03:45.891 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-06-09T13:03:46.616 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:03:46.634 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:03:46.636 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:03:46.643 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:03:46.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:57.278 INFO:teuthology.orchestra.run.smithi078.stdout:generic/344 10s 2023-06-09T13:03:57.344 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/344 2023-06-09T13:03:57.344 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:03:57.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:03:57.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:03:57.392 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-06-09T13:03:58.078 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:03:58.092 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:03:58.094 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:03:58.098 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:03:58.099 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:10.154 INFO:teuthology.orchestra.run.smithi078.stdout:generic/345 12s 2023-06-09T13:04:10.217 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/345 2023-06-09T13:04:10.218 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:10.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:10.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:10.256 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-06-09T13:04:11.001 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:11.019 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:11.021 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:11.023 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:11.024 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:17.051 INFO:teuthology.orchestra.run.smithi078.stdout:generic/346 6s 2023-06-09T13:04:17.105 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/346 2023-06-09T13:04:17.105 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:17.125 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:17.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:17.156 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-06-09T13:04:17.794 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:17.808 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:17.810 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:17.815 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:17.815 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:18.887 INFO:teuthology.orchestra.run.smithi078.stdout:generic/347 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:04:18.909 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/347 2023-06-09T13:04:18.909 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/347 2023-06-09T13:04:18.910 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:18.920 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:18.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:18.997 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-06-09T13:04:19.743 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:19.766 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:19.772 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:19.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:20.814 INFO:teuthology.orchestra.run.smithi078.stdout:generic/348 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:04:20.834 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/348 2023-06-09T13:04:20.834 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/348 2023-06-09T13:04:20.835 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:20.845 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:20.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:20.936 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-06-09T13:04:21.667 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:21.691 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:21.692 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:21.695 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:21.696 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:22.829 INFO:teuthology.orchestra.run.smithi078.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T13:04:22.847 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/349 2023-06-09T13:04:22.848 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/349 2023-06-09T13:04:22.848 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:22.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:22.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:22.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-06-09T13:04:23.728 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:23.750 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:23.753 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:23.761 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:23.761 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:25.995 INFO:teuthology.orchestra.run.smithi078.stdout:generic/350 1s 2023-06-09T13:04:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/350 2023-06-09T13:04:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:26.035 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:26.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:26.071 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-06-09T13:04:26.809 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:26.829 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:26.832 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:26.836 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:26.836 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:27.809 INFO:teuthology.orchestra.run.smithi078.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T13:04:27.829 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/351 2023-06-09T13:04:27.830 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/351 2023-06-09T13:04:27.830 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:27.843 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:27.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:27.954 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-06-09T13:04:28.715 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:28.734 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:28.738 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:28.743 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:28.744 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:30.300 INFO:teuthology.orchestra.run.smithi078.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:04:30.357 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/352 2023-06-09T13:04:30.357 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/352 2023-06-09T13:04:30.357 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:30.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:30.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:30.511 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-06-09T13:04:31.225 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:31.245 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:31.248 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:31.253 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:31.253 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:32.786 INFO:teuthology.orchestra.run.smithi078.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:04:32.807 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/353 2023-06-09T13:04:32.808 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/353 2023-06-09T13:04:32.808 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:33.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:33.056 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-06-09T13:04:33.790 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:33.811 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:33.814 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:33.819 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:33.820 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:45.054 INFO:teuthology.orchestra.run.smithi078.stdout:generic/354 11s 2023-06-09T13:04:45.105 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/354 2023-06-09T13:04:45.105 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:45.125 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:45.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:45.154 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-06-09T13:04:45.812 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:45.839 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:45.841 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:45.845 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:45.845 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:47.683 INFO:teuthology.orchestra.run.smithi078.stdout:generic/355 1s 2023-06-09T13:04:47.717 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/355 2023-06-09T13:04:47.717 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:47.729 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:48.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:48.117 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-06-09T13:04:48.847 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:48.868 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:48.871 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:48.876 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:48.876 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:50.348 INFO:teuthology.orchestra.run.smithi078.stdout:generic/356 [not run] swapfiles are not supported 2023-06-09T13:04:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/356 2023-06-09T13:04:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/356 2023-06-09T13:04:50.366 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:50.377 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:50.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:50.468 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-06-09T13:04:51.191 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:51.214 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:51.217 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:51.222 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:51.222 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:52.578 INFO:teuthology.orchestra.run.smithi078.stdout:generic/357 [not run] swapfiles are not supported 2023-06-09T13:04:52.596 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/357 2023-06-09T13:04:52.597 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/357 2023-06-09T13:04:52.597 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:52.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:52.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:52.723 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-06-09T13:04:53.485 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:53.504 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:53.507 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:53.514 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:53.514 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:54.991 INFO:teuthology.orchestra.run.smithi078.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:04:55.123 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/358 2023-06-09T13:04:55.123 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/358 2023-06-09T13:04:55.123 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:55.164 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:55.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:55.300 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-06-09T13:04:56.050 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:56.071 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:56.074 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:56.080 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:56.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:57.634 INFO:teuthology.orchestra.run.smithi078.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:04:57.726 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/359 2023-06-09T13:04:57.726 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/359 2023-06-09T13:04:57.727 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:57.738 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:57.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:57.849 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-06-09T13:04:58.579 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:04:58.600 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:04:58.603 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:04:58.609 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:04:58.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:59.685 INFO:teuthology.orchestra.run.smithi078.stdout:generic/360 0s 2023-06-09T13:04:59.714 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/360 2023-06-09T13:04:59.714 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:04:59.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:04:59.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:04:59.836 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-06-09T13:05:00.570 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:00.592 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:00.595 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:00.601 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:00.601 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:01.584 INFO:teuthology.orchestra.run.smithi078.stdout:generic/361 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:05:01.604 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/361 2023-06-09T13:05:01.604 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/361 2023-06-09T13:05:01.604 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:01.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:01.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:01.724 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-06-09T13:05:02.475 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:02.499 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:02.502 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:02.508 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:02.508 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:03.432 INFO:teuthology.orchestra.run.smithi078.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:03.453 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/362 2023-06-09T13:05:03.453 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/362 2023-06-09T13:05:03.453 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:03.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:03.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:03.562 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-06-09T13:05:04.296 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:04.317 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:04.320 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:04.326 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:04.326 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:05.228 INFO:teuthology.orchestra.run.smithi078.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:05.246 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/363 2023-06-09T13:05:05.246 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/363 2023-06-09T13:05:05.246 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:05.259 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:05.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:05.354 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-06-09T13:05:06.082 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:06.101 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:06.105 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:06.111 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:06.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:07.051 INFO:teuthology.orchestra.run.smithi078.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:07.073 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/364 2023-06-09T13:05:07.074 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/364 2023-06-09T13:05:07.074 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:07.087 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:07.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:07.169 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-06-09T13:05:07.895 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:07.917 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:07.920 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:07.926 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:07.926 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:08.864 INFO:teuthology.orchestra.run.smithi078.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:08.883 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/365 2023-06-09T13:05:08.883 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/365 2023-06-09T13:05:08.883 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:08.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:08.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:08.986 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-06-09T13:05:09.726 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:09.752 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:09.754 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:09.758 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:09.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:10.707 INFO:teuthology.orchestra.run.smithi078.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/366 2023-06-09T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/366 2023-06-09T13:05:10.730 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:10.743 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:10.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:10.829 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-06-09T13:05:11.574 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:11.597 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:11.600 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:11.604 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:11.604 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:12.528 INFO:teuthology.orchestra.run.smithi078.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:12.550 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/367 2023-06-09T13:05:12.550 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/367 2023-06-09T13:05:12.550 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:12.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:12.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:12.662 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-06-09T13:05:13.421 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:13.447 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:13.453 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:13.453 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:14.372 INFO:teuthology.orchestra.run.smithi078.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:14.392 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/368 2023-06-09T13:05:14.392 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/368 2023-06-09T13:05:14.392 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:14.403 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:14.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:14.525 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-06-09T13:05:15.229 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:15.250 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:15.253 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:15.259 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:15.259 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:16.183 INFO:teuthology.orchestra.run.smithi078.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:16.204 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/369 2023-06-09T13:05:16.204 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/369 2023-06-09T13:05:16.204 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:16.217 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:16.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:16.318 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-06-09T13:05:17.054 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:17.075 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:17.079 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:17.085 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:17.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:17.994 INFO:teuthology.orchestra.run.smithi078.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T13:05:18.011 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/370 2023-06-09T13:05:18.011 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/370 2023-06-09T13:05:18.011 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:18.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:18.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:18.119 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-06-09T13:05:18.831 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:18.853 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:18.856 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:18.862 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:18.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:19.816 INFO:teuthology.orchestra.run.smithi078.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T13:05:19.834 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/371 2023-06-09T13:05:19.834 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/371 2023-06-09T13:05:19.835 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:19.846 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:19.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:19.959 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-06-09T13:05:20.686 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:20.709 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:20.712 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:20.718 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:20.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:22.234 INFO:teuthology.orchestra.run.smithi078.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:05:22.349 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/372 2023-06-09T13:05:22.349 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/372 2023-06-09T13:05:22.349 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:22.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:22.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:22.495 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-06-09T13:05:23.243 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:23.262 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:23.265 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:23.271 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:23.271 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:24.839 INFO:teuthology.orchestra.run.smithi078.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:05:24.883 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/373 2023-06-09T13:05:24.883 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/373 2023-06-09T13:05:24.883 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:24.906 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:25.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:25.048 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-06-09T13:05:25.745 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:25.768 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:25.771 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:25.776 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:25.776 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:27.086 INFO:teuthology.orchestra.run.smithi078.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T13:05:27.322 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/374 2023-06-09T13:05:27.322 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/374 2023-06-09T13:05:27.322 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:27.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:27.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:27.580 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-06-09T13:05:28.281 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:28.301 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:28.304 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:28.310 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:28.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:29.575 INFO:teuthology.orchestra.run.smithi078.stdout:generic/375 1s 2023-06-09T13:05:29.600 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/375 2023-06-09T13:05:29.600 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:29.612 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:30.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:30.024 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-06-09T13:05:30.788 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:30.810 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:30.814 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:30.820 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:30.820 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:31.816 INFO:teuthology.orchestra.run.smithi078.stdout:generic/376 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:05:31.836 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/376 2023-06-09T13:05:31.836 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/376 2023-06-09T13:05:31.836 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:31.847 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:31.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:31.941 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-06-09T13:05:32.671 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:32.694 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:32.697 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:32.704 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:34.191 INFO:teuthology.orchestra.run.smithi078.stdout:generic/377 1s 2023-06-09T13:05:34.217 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/377 2023-06-09T13:05:34.218 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:34.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:34.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:34.272 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-06-09T13:05:35.004 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:35.021 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:35.025 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:35.029 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:35.029 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:36.548 INFO:teuthology.orchestra.run.smithi078.stdout:generic/378 1s 2023-06-09T13:05:36.573 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/378 2023-06-09T13:05:36.573 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:36.588 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:37.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:37.027 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-06-09T13:05:37.750 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:37.771 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:37.774 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:37.780 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:37.780 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:38.818 INFO:teuthology.orchestra.run.smithi078.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:38.839 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/379 2023-06-09T13:05:38.839 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/379 2023-06-09T13:05:38.840 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:38.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:38.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:38.952 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-06-09T13:05:39.637 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:39.661 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:39.664 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:39.670 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:39.670 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:40.610 INFO:teuthology.orchestra.run.smithi078.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:40.631 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/380 2023-06-09T13:05:40.631 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/380 2023-06-09T13:05:40.631 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:40.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:40.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:40.748 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-06-09T13:05:41.482 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:41.503 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:41.506 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:41.511 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:41.511 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:42.446 INFO:teuthology.orchestra.run.smithi078.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:42.466 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/381 2023-06-09T13:05:42.466 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/381 2023-06-09T13:05:42.466 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:42.479 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:42.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:42.567 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-06-09T13:05:43.315 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:43.337 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:43.341 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:43.345 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:43.345 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:44.274 INFO:teuthology.orchestra.run.smithi078.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:44.294 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/382 2023-06-09T13:05:44.295 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/382 2023-06-09T13:05:44.295 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:44.308 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:44.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:44.417 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-06-09T13:05:45.156 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:45.179 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:45.181 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:45.186 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:45.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:46.116 INFO:teuthology.orchestra.run.smithi078.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:46.136 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/383 2023-06-09T13:05:46.136 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/383 2023-06-09T13:05:46.136 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:46.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:46.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:46.237 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-06-09T13:05:46.975 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:46.999 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:47.002 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:47.007 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:47.008 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:47.971 INFO:teuthology.orchestra.run.smithi078.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:47.993 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/384 2023-06-09T13:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/384 2023-06-09T13:05:47.994 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:48.005 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:48.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:48.093 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-06-09T13:05:48.843 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:48.865 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:48.868 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:48.875 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:48.875 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:49.836 INFO:teuthology.orchestra.run.smithi078.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:49.855 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/385 2023-06-09T13:05:49.856 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/385 2023-06-09T13:05:49.856 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:49.868 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:49.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:49.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-06-09T13:05:50.698 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:50.719 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:50.721 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:50.728 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:51.647 INFO:teuthology.orchestra.run.smithi078.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:05:51.668 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/386 2023-06-09T13:05:51.668 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/386 2023-06-09T13:05:51.668 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:51.682 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:51.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:51.788 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-06-09T13:05:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:52.526 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:52.528 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:52.534 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:52.534 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:54.026 INFO:teuthology.orchestra.run.smithi078.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:05:54.092 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/387 2023-06-09T13:05:54.093 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/387 2023-06-09T13:05:54.094 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:54.130 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:54.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:54.294 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-06-09T13:05:55.033 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:55.054 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:55.057 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:55.063 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:55.063 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:56.046 INFO:teuthology.orchestra.run.smithi078.stdout:generic/388 [not run] require 172.21.15.78:6789:/scratch to be local device 2023-06-09T13:05:56.067 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/388 2023-06-09T13:05:56.067 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/388 2023-06-09T13:05:56.068 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:56.084 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:56.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:56.175 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-06-09T13:05:56.904 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:56.926 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:56.929 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:56.936 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:56.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:57.943 INFO:teuthology.orchestra.run.smithi078.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-06-09T13:05:57.964 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/389 2023-06-09T13:05:57.964 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/389 2023-06-09T13:05:57.964 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:57.978 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:58.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:58.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-06-09T13:05:58.826 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:05:58.846 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:05:58.849 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:05:58.855 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:05:58.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:59.846 INFO:teuthology.orchestra.run.smithi078.stdout:generic/390 [not run] ceph does not support freezing 2023-06-09T13:05:59.866 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/390 2023-06-09T13:05:59.866 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/390 2023-06-09T13:05:59.867 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:05:59.879 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:05:59.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:05:59.969 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-06-09T13:06:00.693 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:00.715 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:00.718 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:00.723 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:00.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:01.733 INFO:teuthology.orchestra.run.smithi078.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T13:06:01.754 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/391 2023-06-09T13:06:01.754 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/391 2023-06-09T13:06:01.754 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:01.768 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:01.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:01.873 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-06-09T13:06:02.618 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:02.639 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:02.642 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:02.648 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:02.648 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:03.835 INFO:teuthology.orchestra.run.smithi078.stdout:generic/392 [not run] ceph does not support shutdown 2023-06-09T13:06:03.925 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/392 2023-06-09T13:06:03.926 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/392 2023-06-09T13:06:03.926 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:03.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:04.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:04.025 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-06-09T13:06:04.756 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:04.778 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:04.781 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:04.786 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:04.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:07.201 INFO:teuthology.orchestra.run.smithi078.stdout:generic/393 2s 2023-06-09T13:06:07.224 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/393 2023-06-09T13:06:07.224 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:07.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:07.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:07.281 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-06-09T13:06:08.019 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:08.038 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:08.040 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:08.045 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:08.046 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:09.128 INFO:teuthology.orchestra.run.smithi078.stdout:generic/394 1s 2023-06-09T13:06:09.154 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/394 2023-06-09T13:06:09.154 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:09.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:09.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:09.595 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-06-09T13:06:10.322 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:10.335 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:10.337 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:10.341 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:10.341 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:13.198 INFO:teuthology.orchestra.run.smithi078.stdout:generic/395 3s 2023-06-09T13:06:13.227 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/395 2023-06-09T13:06:13.227 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:13.238 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:13.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:13.266 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-06-09T13:06:14.008 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:14.030 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:14.033 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:14.038 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:14.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:16.141 INFO:teuthology.orchestra.run.smithi078.stdout:generic/396 2s 2023-06-09T13:06:16.165 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/396 2023-06-09T13:06:16.166 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:16.180 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:16.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:16.217 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-06-09T13:06:16.974 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:16.994 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:16.997 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:17.002 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:17.002 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:20.684 INFO:teuthology.orchestra.run.smithi078.stdout:generic/397 3s 2023-06-09T13:06:20.712 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/397 2023-06-09T13:06:20.712 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:20.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:20.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:20.766 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-06-09T13:06:21.499 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:21.522 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:21.525 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:21.531 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:21.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:23.214 INFO:teuthology.orchestra.run.smithi078.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-06-09T13:06:23.235 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/398 2023-06-09T13:06:23.235 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/398 2023-06-09T13:06:23.236 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:23.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:23.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:23.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:23.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:23.537 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-06-09T13:06:23.701 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T13:06:23.693+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304957) UID: 0 2023-06-09T13:06:23.701 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T13:06:23.693+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304957) UID: 0 2023-06-09T13:06:23.702 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T13:06:23.693+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304957) UID: 0 2023-06-09T13:06:23.707 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T13:06:23.693+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 304957) UID: 0 2023-06-09T13:06:24.318 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:24.337 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:24.339 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:24.344 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:24.344 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:25.820 INFO:teuthology.orchestra.run.smithi078.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-06-09T13:06:25.840 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/399 2023-06-09T13:06:25.840 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/399 2023-06-09T13:06:25.840 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:25.852 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:25.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:25.942 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-06-09T13:06:26.617 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:26.635 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:26.638 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:26.642 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:26.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:27.454 INFO:teuthology.orchestra.run.smithi078.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T13:06:27.470 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/400 2023-06-09T13:06:27.471 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/400 2023-06-09T13:06:27.471 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:27.483 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:27.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:27.576 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-06-09T13:06:28.237 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:28.259 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:28.261 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:28.265 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:28.265 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:29.990 INFO:teuthology.orchestra.run.smithi078.stdout:generic/401 1s 2023-06-09T13:06:30.017 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/401 2023-06-09T13:06:30.018 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:30.027 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:30.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:30.058 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-06-09T13:06:30.704 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:30.722 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:30.724 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:30.730 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:30.730 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:31.940 INFO:teuthology.orchestra.run.smithi078.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-06-09T13:06:32.008 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/402 2023-06-09T13:06:32.008 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/402 2023-06-09T13:06:32.009 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:32.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:32.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:32.113 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-06-09T13:06:32.785 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:32.802 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:32.804 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:32.808 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:34.647 INFO:teuthology.orchestra.run.smithi078.stdout:generic/403 1s 2023-06-09T13:06:34.670 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/403 2023-06-09T13:06:34.670 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:34.683 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:34.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:34.715 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-06-09T13:06:35.384 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:35.406 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:35.408 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:35.413 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:35.413 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:36.313 INFO:teuthology.orchestra.run.smithi078.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T13:06:36.332 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/404 2023-06-09T13:06:36.333 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/404 2023-06-09T13:06:36.333 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:36.345 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:36.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:36.439 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-06-09T13:06:37.105 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:37.123 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:37.126 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:37.132 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:37.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:38.164 INFO:teuthology.orchestra.run.smithi078.stdout:generic/405 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:06:38.185 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/405 2023-06-09T13:06:38.185 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/405 2023-06-09T13:06:38.185 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:38.196 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:38.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:38.292 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-06-09T13:06:38.966 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:38.983 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:38.985 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:38.989 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:38.989 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:42.300 INFO:teuthology.orchestra.run.smithi078.stdout:generic/406 3s 2023-06-09T13:06:42.324 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/406 2023-06-09T13:06:42.324 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:42.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:42.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:42.370 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-06-09T13:06:43.001 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:43.029 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:43.029 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:44.053 INFO:teuthology.orchestra.run.smithi078.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T13:06:44.072 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/407 2023-06-09T13:06:44.072 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/407 2023-06-09T13:06:44.072 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:44.083 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:44.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:44.442 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-06-09T13:06:45.149 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:45.168 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:45.171 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:45.176 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:45.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:46.194 INFO:teuthology.orchestra.run.smithi078.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T13:06:46.212 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/408 2023-06-09T13:06:46.213 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/408 2023-06-09T13:06:46.213 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:46.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:46.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:46.521 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-06-09T13:06:47.285 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:47.306 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:47.307 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:47.312 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:47.312 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:48.195 INFO:teuthology.orchestra.run.smithi078.stdout:generic/409 [not run] require 172.21.15.78:6789:/scratch to be local device 2023-06-09T13:06:48.213 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/409 2023-06-09T13:06:48.214 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/409 2023-06-09T13:06:48.214 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:48.225 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:48.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:48.316 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-06-09T13:06:49.001 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:49.020 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:49.023 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:49.028 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:49.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:49.926 INFO:teuthology.orchestra.run.smithi078.stdout:generic/410 [not run] require 172.21.15.78:6789:/scratch to be local device 2023-06-09T13:06:49.945 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/410 2023-06-09T13:06:49.945 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/410 2023-06-09T13:06:49.945 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:49.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:50.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:50.041 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-06-09T13:06:50.682 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:50.701 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:50.704 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:50.709 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:50.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:51.614 INFO:teuthology.orchestra.run.smithi078.stdout:generic/411 [not run] require 172.21.15.78:6789:/scratch to be local device 2023-06-09T13:06:51.632 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/411 2023-06-09T13:06:51.632 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/411 2023-06-09T13:06:51.632 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:51.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:51.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:51.713 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-06-09T13:06:52.394 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:52.414 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:52.416 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:52.420 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:52.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:54.058 INFO:teuthology.orchestra.run.smithi078.stdout:generic/412 2s 2023-06-09T13:06:54.079 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/412 2023-06-09T13:06:54.079 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:54.088 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:54.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:54.123 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-06-09T13:06:54.795 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:54.813 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:54.814 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:54.819 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:54.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:55.940 INFO:teuthology.orchestra.run.smithi078.stdout:generic/413 [not run] mount 172.21.15.78:6789:/scratch with dax failed 2023-06-09T13:06:55.959 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/413 2023-06-09T13:06:55.960 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/413 2023-06-09T13:06:55.960 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:55.971 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:56.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:56.075 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-06-09T13:06:56.743 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:56.763 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:56.766 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:56.771 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:56.771 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:58.387 INFO:teuthology.orchestra.run.smithi078.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:06:58.526 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/414 2023-06-09T13:06:58.527 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/414 2023-06-09T13:06:58.527 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:06:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:06:58.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:06:58.672 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-06-09T13:06:59.355 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:06:59.371 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:06:59.372 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:06:59.376 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:06:59.376 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:00.793 INFO:teuthology.orchestra.run.smithi078.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:07:00.877 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/415 2023-06-09T13:07:00.877 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/415 2023-06-09T13:07:00.877 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:00.938 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:01.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:01.085 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-06-09T13:07:01.731 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:01.750 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:01.752 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:01.758 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:01.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:02.719 INFO:teuthology.orchestra.run.smithi078.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T13:07:02.741 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/416 2023-06-09T13:07:02.741 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/416 2023-06-09T13:07:02.742 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:02.750 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:02.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:02.851 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-06-09T13:07:03.498 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:03.517 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:03.519 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:03.524 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:03.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:04.631 INFO:teuthology.orchestra.run.smithi078.stdout:generic/417 [not run] ceph does not support shutdown 2023-06-09T13:07:04.693 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/417 2023-06-09T13:07:04.693 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/417 2023-06-09T13:07:04.693 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:04.704 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:04.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:04.798 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-06-09T13:07:05.443 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:05.461 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:05.464 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:05.470 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:05.470 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:06.406 INFO:teuthology.orchestra.run.smithi078.stdout:generic/418 [not run] require 172.21.15.78:6789:/test to be valid block disk 2023-06-09T13:07:06.426 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/418 2023-06-09T13:07:06.427 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/418 2023-06-09T13:07:06.427 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:06.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:06.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:06.536 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-06-09T13:07:07.214 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:07.232 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:07.234 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:07.239 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:07.240 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:08.738 INFO:teuthology.orchestra.run.smithi078.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-06-09T13:07:08.757 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/419 2023-06-09T13:07:08.757 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/419 2023-06-09T13:07:08.757 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:08.768 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:09.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:09.065 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-06-09T13:07:09.782 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:09.802 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:09.804 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:09.809 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:09.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:11.033 INFO:teuthology.orchestra.run.smithi078.stdout:generic/420 1s 2023-06-09T13:07:11.055 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/420 2023-06-09T13:07:11.055 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:11.067 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:11.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:11.408 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-06-09T13:07:12.141 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:12.160 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:12.162 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:12.166 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:12.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:21.280 INFO:teuthology.orchestra.run.smithi078.stdout:generic/421 9s 2023-06-09T13:07:21.316 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/421 2023-06-09T13:07:21.316 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:21.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:21.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:21.379 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-06-09T13:07:22.064 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:22.084 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:22.087 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:22.092 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:22.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:22.969 INFO:teuthology.orchestra.run.smithi078.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T13:07:22.986 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/422 2023-06-09T13:07:22.986 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/422 2023-06-09T13:07:22.987 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:22.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:23.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:23.093 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-06-09T13:07:23.773 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:23.793 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:23.795 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:23.800 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:23.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:25.002 INFO:teuthology.orchestra.run.smithi078.stdout:generic/423 0s 2023-06-09T13:07:25.027 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/423 2023-06-09T13:07:25.027 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:25.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:25.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:25.391 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-06-09T13:07:26.097 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:26.113 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:26.115 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:26.120 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:26.120 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:27.095 INFO:teuthology.orchestra.run.smithi078.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-06-09T13:07:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/424 2023-06-09T13:07:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/424 2023-06-09T13:07:27.113 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:27.125 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:27.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:27.223 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-06-09T13:07:27.899 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:27.920 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:27.922 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:27.927 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:27.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:28.926 INFO:teuthology.orchestra.run.smithi078.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-06-09T13:07:28.946 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/425 2023-06-09T13:07:28.947 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/425 2023-06-09T13:07:28.947 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:07:28.958 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:07:29.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:07:29.282 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-06-09T13:07:30.012 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:07:30.030 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:07:30.032 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:07:30.037 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:07:30.038 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:17.717 INFO:teuthology.orchestra.run.smithi078.stdout:generic/426 47s 2023-06-09T13:08:18.100 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/426 2023-06-09T13:08:18.101 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:18.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:18.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:18.407 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-06-09T13:08:22.194 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:22.214 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:22.216 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:22.220 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:22.221 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:23.410 INFO:teuthology.orchestra.run.smithi078.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T13:08:23.432 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/427 2023-06-09T13:08:23.432 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/427 2023-06-09T13:08:23.433 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:23.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:23.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:23.556 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-06-09T13:08:24.250 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:24.270 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:24.272 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:24.278 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:24.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:25.226 INFO:teuthology.orchestra.run.smithi078.stdout:generic/428 1s 2023-06-09T13:08:25.253 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/428 2023-06-09T13:08:25.253 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:25.264 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:25.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:25.364 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-06-09T13:08:26.021 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:26.042 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:26.044 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:26.048 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:26.049 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:39.332 INFO:teuthology.orchestra.run.smithi078.stdout:generic/429 13s 2023-06-09T13:08:39.353 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/429 2023-06-09T13:08:39.353 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:39.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:39.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:39.397 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-06-09T13:08:40.315 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:40.358 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:40.359 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:40.363 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:40.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:41.696 INFO:teuthology.orchestra.run.smithi078.stdout:generic/430 1s 2023-06-09T13:08:41.721 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/430 2023-06-09T13:08:41.721 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:41.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:42.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:42.097 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-06-09T13:08:42.927 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:42.951 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:42.957 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:42.957 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:44.138 INFO:teuthology.orchestra.run.smithi078.stdout:generic/431 1s 2023-06-09T13:08:44.169 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/431 2023-06-09T13:08:44.169 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:44.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:44.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:44.502 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-06-09T13:08:45.217 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:45.241 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:45.244 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:45.250 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:45.250 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:46.657 INFO:teuthology.orchestra.run.smithi078.stdout:generic/432 1s 2023-06-09T13:08:46.809 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/432 2023-06-09T13:08:46.809 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:46.820 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:47.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:47.183 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-06-09T13:08:47.832 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:47.854 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:47.857 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:47.862 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:47.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:49.077 INFO:teuthology.orchestra.run.smithi078.stdout:generic/433 1s 2023-06-09T13:08:49.101 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/433 2023-06-09T13:08:49.101 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:49.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:49.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:49.409 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-06-09T13:08:50.129 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:50.149 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:50.151 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:50.157 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:50.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:51.371 INFO:teuthology.orchestra.run.smithi078.stdout:generic/434 1s 2023-06-09T13:08:51.397 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/434 2023-06-09T13:08:51.397 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:08:51.413 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:08:51.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:08:51.738 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-06-09T13:08:52.411 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:08:52.430 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:08:52.433 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:08:52.438 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:08:52.438 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:09:13.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:13.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:43.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:43.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:13.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:13.720 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:43.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:43.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:13.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:13.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:43.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:43.944 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:14.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:14.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:44.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:44.083 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:14.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:14.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:45.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:45.296 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:15.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:15.396 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:15.449 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T13:14:15.445+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42325) UID: 0 2023-06-09T13:14:15.450 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T13:14:15.445+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42325) UID: 0 2023-06-09T13:14:57.032 INFO:tasks.ceph.mon.b.smithi187.stderr:2023-06-09T13:14:57.024+0000 7efd39ff4700 -1 mon.b@1(peon).paxos(paxos updating c 8535..9087) lease_expire from mon.0 v2:172.21.15.78:3300/0 is 1.082462072s seconds in the past; mons are probably laggy (or possibly clocks are too skewed) 2023-06-09T13:14:57.420 INFO:tasks.ceph.mon.c.smithi187.stderr:2023-06-09T13:14:57.408+0000 7f2da8df4700 -1 mon.c@2(peon).paxos(paxos updating c 8535..9087) lease_expire from mon.0 v2:172.21.15.78:3300/0 is 1.464761853s seconds in the past; mons are probably laggy (or possibly clocks are too skewed) 2023-06-09T13:17:47.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:47.098 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:47.530 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T13:17:47.518+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324156) UID: 0 2023-06-09T13:17:47.530 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T13:17:47.518+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324156) UID: 0 2023-06-09T13:17:47.531 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T13:17:47.518+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324156) UID: 0 2023-06-09T13:17:47.531 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T13:17:47.518+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 324156) UID: 0 2023-06-09T13:20:50.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:50.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:50.620 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T13:20:50.610+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42349) UID: 0 2023-06-09T13:20:50.621 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T13:20:50.610+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42349) UID: 0 2023-06-09T13:22:24.852 INFO:teuthology.orchestra.run.smithi078.stdout:generic/435 812s 2023-06-09T13:22:24.891 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/435 2023-06-09T13:22:24.891 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:22:24.903 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:22:24.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:22:24.953 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-06-09T13:22:25.686 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:22:25.708 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:22:25.711 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:22:25.716 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:22:25.717 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:22:27.337 INFO:teuthology.orchestra.run.smithi078.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T13:22:27.356 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/436 2023-06-09T13:22:27.357 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/436 2023-06-09T13:22:27.357 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:22:27.370 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:22:27.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:22:27.717 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-06-09T13:22:28.446 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:22:28.468 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:22:28.471 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:22:28.476 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:22:28.477 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:22:30.529 INFO:teuthology.orchestra.run.smithi078.stdout:generic/437 2s 2023-06-09T13:22:30.560 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/437 2023-06-09T13:22:30.560 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:22:30.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:22:30.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:22:30.671 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-06-09T13:22:31.427 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:22:31.446 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:22:31.449 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:22:31.455 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:22:31.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:07.342 INFO:teuthology.orchestra.run.smithi078.stdout:generic/438 96s 2023-06-09T13:24:07.369 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/438 2023-06-09T13:24:07.369 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:07.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:07.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:07.480 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-06-09T13:24:08.206 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:08.230 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:08.233 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:08.239 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:08.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:10.489 INFO:teuthology.orchestra.run.smithi078.stdout:generic/439 2s 2023-06-09T13:24:10.512 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/439 2023-06-09T13:24:10.512 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:10.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:10.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:10.631 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-06-09T13:24:11.334 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:11.355 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:11.358 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:11.364 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:11.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:14.433 INFO:teuthology.orchestra.run.smithi078.stdout:generic/440 3s 2023-06-09T13:24:14.461 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/440 2023-06-09T13:24:14.461 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:14.471 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:14.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:14.513 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-06-09T13:24:15.239 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:15.261 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:15.264 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:15.269 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:15.269 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:16.324 INFO:teuthology.orchestra.run.smithi078.stdout:generic/441 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:24:16.344 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/441 2023-06-09T13:24:16.344 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/441 2023-06-09T13:24:16.345 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:16.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:16.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:16.457 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-06-09T13:24:17.197 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:17.218 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:17.221 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:17.226 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:17.227 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:18.208 INFO:teuthology.orchestra.run.smithi078.stdout:generic/442 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:24:18.229 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/442 2023-06-09T13:24:18.229 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/442 2023-06-09T13:24:18.230 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:18.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:18.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:18.328 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-06-09T13:24:19.050 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:19.070 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:19.072 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:19.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:19.078 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:19.079 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:19.083 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:19.125 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T13:24:19.115+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 341859) UID: 0 2023-06-09T13:24:19.125 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T13:24:19.115+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 341859) UID: 0 2023-06-09T13:24:19.126 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T13:24:19.115+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 341859) UID: 0 2023-06-09T13:24:19.126 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T13:24:19.115+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 341859) UID: 0 2023-06-09T13:24:20.037 INFO:teuthology.orchestra.run.smithi078.stdout:generic/443 1s 2023-06-09T13:24:20.065 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/443 2023-06-09T13:24:20.065 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:20.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:20.184 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-06-09T13:24:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:20.909 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:20.911 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:20.916 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:20.917 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:21.986 INFO:teuthology.orchestra.run.smithi078.stdout:generic/444 0s 2023-06-09T13:24:22.011 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/444 2023-06-09T13:24:22.012 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:22.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:22.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:22.129 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-06-09T13:24:22.814 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:22.832 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:22.835 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:22.839 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:22.840 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:24.198 INFO:teuthology.orchestra.run.smithi078.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T13:24:24.217 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/445 2023-06-09T13:24:24.217 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/445 2023-06-09T13:24:24.218 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:24.228 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:24.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:24.590 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-06-09T13:24:25.286 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:25.306 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:25.308 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:25.312 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:25.313 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:52.315 INFO:teuthology.orchestra.run.smithi078.stdout:generic/446 27s 2023-06-09T13:24:52.360 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/446 2023-06-09T13:24:52.360 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:52.383 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:52.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:52.436 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-06-09T13:24:53.072 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:53.094 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:53.097 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:53.102 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:53.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:54.526 INFO:teuthology.orchestra.run.smithi078.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:24:54.604 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/447 2023-06-09T13:24:54.604 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/447 2023-06-09T13:24:54.604 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:54.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:54.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:54.736 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-06-09T13:24:55.381 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:55.402 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:55.404 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:55.408 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:57.391 INFO:teuthology.orchestra.run.smithi078.stdout:generic/448 2s 2023-06-09T13:24:57.413 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/448 2023-06-09T13:24:57.413 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:57.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:57.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:57.709 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-06-09T13:24:58.450 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:24:58.470 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:24:58.472 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:24:58.477 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:24:58.477 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:59.423 INFO:teuthology.orchestra.run.smithi078.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T13:24:59.440 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/449 2023-06-09T13:24:59.441 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/449 2023-06-09T13:24:59.441 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:24:59.452 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:24:59.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:24:59.803 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-06-09T13:25:00.509 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:00.528 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:00.530 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:00.534 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:00.534 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:02.134 INFO:teuthology.orchestra.run.smithi078.stdout:generic/450 2s 2023-06-09T13:25:02.156 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/450 2023-06-09T13:25:02.157 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:02.168 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:02.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:02.481 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-06-09T13:25:03.203 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:03.222 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:03.224 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:03.229 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:03.229 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:34.372 INFO:teuthology.orchestra.run.smithi078.stdout:generic/451 31s 2023-06-09T13:25:34.393 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/451 2023-06-09T13:25:34.394 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:34.407 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:34.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:34.745 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-06-09T13:25:35.468 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:35.486 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:35.490 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:35.495 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:35.495 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:36.895 INFO:teuthology.orchestra.run.smithi078.stdout:generic/452 1s 2023-06-09T13:25:36.918 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/452 2023-06-09T13:25:36.918 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:36.930 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:36.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:36.967 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-06-09T13:25:37.635 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:37.655 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:37.659 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:37.664 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:37.664 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:38.544 INFO:teuthology.orchestra.run.smithi078.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-06-09T13:25:38.564 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/453 2023-06-09T13:25:38.565 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/453 2023-06-09T13:25:38.565 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:38.578 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:38.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:38.659 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-06-09T13:25:39.346 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:39.365 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:39.367 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:39.372 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:39.372 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:40.263 INFO:teuthology.orchestra.run.smithi078.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-06-09T13:25:40.280 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/454 2023-06-09T13:25:40.280 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/454 2023-06-09T13:25:40.280 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:40.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:40.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:40.390 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-06-09T13:25:41.067 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:41.086 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:41.089 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:41.093 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:41.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:42.128 INFO:teuthology.orchestra.run.smithi078.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T13:25:42.148 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/455 2023-06-09T13:25:42.148 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/455 2023-06-09T13:25:42.148 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:42.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:42.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:42.249 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-06-09T13:25:42.945 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:42.964 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:42.967 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:42.972 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:42.972 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:43.885 INFO:teuthology.orchestra.run.smithi078.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T13:25:43.905 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/456 2023-06-09T13:25:43.905 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/456 2023-06-09T13:25:43.906 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:43.917 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:43.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:44.000 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-06-09T13:25:44.678 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:44.696 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:44.699 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:44.703 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:44.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:46.166 INFO:teuthology.orchestra.run.smithi078.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:25:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/457 2023-06-09T13:25:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/457 2023-06-09T13:25:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:46.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:46.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:46.389 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-06-09T13:25:47.056 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:47.076 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:47.079 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:47.084 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:47.084 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:48.420 INFO:teuthology.orchestra.run.smithi078.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T13:25:48.440 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/458 2023-06-09T13:25:48.440 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/458 2023-06-09T13:25:48.441 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:48.452 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:48.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:48.709 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-06-09T13:25:49.372 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:49.390 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:49.392 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:49.397 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:49.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:50.949 INFO:teuthology.orchestra.run.smithi078.stdout:generic/459 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:25:50.968 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/459 2023-06-09T13:25:50.969 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/459 2023-06-09T13:25:50.969 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:51.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:51.062 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-06-09T13:25:51.732 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:51.751 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:51.753 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:51.757 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:51.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:55.808 INFO:teuthology.orchestra.run.smithi078.stdout:generic/460 3s 2023-06-09T13:25:55.830 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/460 2023-06-09T13:25:55.830 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:55.841 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:55.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:55.875 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-06-09T13:25:56.526 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:56.550 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:56.553 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:56.558 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:56.558 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:57.735 INFO:teuthology.orchestra.run.smithi078.stdout:generic/461 [not run] ceph does not support shutdown 2023-06-09T13:25:57.754 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/461 2023-06-09T13:25:57.754 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/461 2023-06-09T13:25:57.754 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:57.766 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:57.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:57.847 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-06-09T13:25:58.526 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:25:58.545 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:25:58.547 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:25:58.552 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:25:58.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:59.631 INFO:teuthology.orchestra.run.smithi078.stdout:generic/462 [not run] mount 172.21.15.78:6789:/scratch with dax failed 2023-06-09T13:25:59.649 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/462 2023-06-09T13:25:59.650 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/462 2023-06-09T13:25:59.650 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:25:59.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:25:59.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:25:59.740 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-06-09T13:26:00.405 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:26:00.426 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:26:00.428 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:26:00.433 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:26:00.433 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:26:01.400 INFO:teuthology.orchestra.run.smithi078.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T13:26:01.418 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/463 2023-06-09T13:26:01.418 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/463 2023-06-09T13:26:01.419 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:26:01.430 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:26:01.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:26:01.794 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-06-09T13:26:02.537 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:26:02.557 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:26:02.561 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:26:02.566 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:26:02.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:03.421 INFO:teuthology.orchestra.run.smithi078.stdout:generic/464 61s 2023-06-09T13:27:03.445 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/464 2023-06-09T13:27:03.445 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:03.456 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:03.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:03.490 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-06-09T13:27:04.138 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:04.156 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:04.159 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:04.165 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:04.165 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:12.275 INFO:teuthology.orchestra.run.smithi078.stdout:generic/465 7s 2023-06-09T13:27:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/465 2023-06-09T13:27:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:12.369 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:12.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:12.395 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-06-09T13:27:13.087 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:13.110 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:13.113 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:13.118 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:13.118 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:14.051 INFO:teuthology.orchestra.run.smithi078.stdout:generic/466 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:27:14.072 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/466 2023-06-09T13:27:14.073 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/466 2023-06-09T13:27:14.073 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:14.084 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:14.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:14.191 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-06-09T13:27:14.917 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:14.937 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:14.939 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:14.945 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:14.945 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:24.580 INFO:teuthology.orchestra.run.smithi078.stdout:generic/467 9s 2023-06-09T13:27:24.771 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/467 2023-06-09T13:27:24.771 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:24.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:25.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:25.090 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-06-09T13:27:27.048 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:27.070 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:27.073 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:27.079 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:27.079 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:28.341 INFO:teuthology.orchestra.run.smithi078.stdout:generic/468 [not run] ceph does not support shutdown 2023-06-09T13:27:28.408 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/468 2023-06-09T13:27:28.408 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/468 2023-06-09T13:27:28.408 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:28.421 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:28.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:28.516 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-06-09T13:27:29.263 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:29.286 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:29.290 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:29.295 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:29.295 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:30.310 INFO:teuthology.orchestra.run.smithi078.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T13:27:30.333 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/469 2023-06-09T13:27:30.333 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/469 2023-06-09T13:27:30.334 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:30.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:30.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:30.455 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-06-09T13:27:31.205 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:31.230 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:31.233 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:31.238 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:31.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:32.266 INFO:teuthology.orchestra.run.smithi078.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T13:27:32.285 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/470 2023-06-09T13:27:32.285 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/470 2023-06-09T13:27:32.286 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:32.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:32.390 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-06-09T13:27:33.120 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:33.142 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:33.146 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:33.152 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:34.246 INFO:teuthology.orchestra.run.smithi078.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-06-09T13:27:34.265 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/471 2023-06-09T13:27:34.266 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/471 2023-06-09T13:27:34.266 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:34.280 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:34.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:34.527 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-06-09T13:27:35.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:35.122 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:35.386 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:35.410 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:35.413 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:35.419 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:35.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:36.862 INFO:teuthology.orchestra.run.smithi078.stdout:generic/472 [not run] swapfiles are not supported 2023-06-09T13:27:36.884 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/472 2023-06-09T13:27:36.884 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/472 2023-06-09T13:27:36.884 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:36.897 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:36.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:36.993 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-06-09T13:27:37.730 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:37.750 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:37.752 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:37.758 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:37.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:38.847 INFO:teuthology.orchestra.run.smithi078.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T13:27:38.868 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/473 2023-06-09T13:27:38.868 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/473 2023-06-09T13:27:38.868 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:38.882 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:38.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:38.986 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-06-09T13:27:39.718 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:39.743 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:39.746 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:39.752 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:39.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:40.967 INFO:teuthology.orchestra.run.smithi078.stdout:generic/474 [not run] ceph does not support shutdown 2023-06-09T13:27:41.052 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/474 2023-06-09T13:27:41.052 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/474 2023-06-09T13:27:41.053 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:41.065 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:41.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:41.156 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-06-09T13:27:41.877 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:41.898 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:41.901 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:41.906 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:41.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:42.908 INFO:teuthology.orchestra.run.smithi078.stdout:generic/475 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T13:27:42.928 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/475 2023-06-09T13:27:42.928 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/475 2023-06-09T13:27:42.929 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T13:27:42.943 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:27:43.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T13:27:43.028 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-06-09T13:27:43.759 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T13:27:43.781 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T13:27:43.783 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T13:27:43.789 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T13:27:43.789 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T13:28:05.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:05.272 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:35.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:35.370 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:05.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:05.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:36.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:36.138 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:36.195 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T13:29:36.186+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42511) UID: 0 2023-06-09T13:29:36.196 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T13:29:36.186+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42511) UID: 0 2023-06-09T13:29:36.196 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T13:29:36.186+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42511) UID: 0 2023-06-09T13:29:36.197 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T13:29:36.186+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42511) UID: 0 2023-06-09T13:35:36.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:36.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:37.094 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T13:35:37.088+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42673) UID: 0 2023-06-09T13:35:37.095 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T13:35:37.088+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42673) UID: 0 2023-06-09T13:35:37.097 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T13:35:37.088+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42673) UID: 0 2023-06-09T13:35:37.106 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T13:35:37.088+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42673) UID: 0 2023-06-09T13:41:12.348 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:12.354 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:12.398 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T13:41:12.386+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42704) UID: 0 2023-06-09T13:41:12.398 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T13:41:12.386+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42704) UID: 0 2023-06-09T13:46:51.627 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T13:46:51.613+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42730) UID: 0 2023-06-09T13:46:51.634 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T13:46:51.621+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42730) UID: 0 2023-06-09T13:46:51.635 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T13:46:51.621+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42730) UID: 0 2023-06-09T13:46:51.640 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T13:46:51.625+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42730) UID: 0 2023-06-09T13:52:50.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:50.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:21.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:21.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:51.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:51.832 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:51.934 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T13:53:51.923+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442596) UID: 0 2023-06-09T13:53:51.940 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T13:53:51.931+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442596) UID: 0 2023-06-09T13:53:51.941 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T13:53:51.927+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442596) UID: 0 2023-06-09T13:53:51.962 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T13:53:51.931+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442596) UID: 0 2023-06-09T13:58:59.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:59.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:59.785 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T13:58:59.774+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42801) UID: 0 2023-06-09T13:58:59.785 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T13:58:59.774+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42801) UID: 0 2023-06-09T14:05:19.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:19.010 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:49.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:49.279 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:20.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:20.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:52.169 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:52.174 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:22.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:22.305 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:52.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:52.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:22.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:22.578 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:52.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:52.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:22.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:22.845 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:53.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:53.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:23.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:23.184 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:53.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:53.343 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:23.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:23.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:53.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:53.623 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:24.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:24.834 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:55.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:55.094 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:25.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:25.513 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:25.578 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T14:13:25.569+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42900) UID: 0 2023-06-09T14:13:25.579 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T14:13:25.569+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42900) UID: 0 2023-06-09T14:17:29.260 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T14:17:29.249+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42923) UID: 0 2023-06-09T14:17:29.261 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T14:17:29.249+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42923) UID: 0 2023-06-09T14:17:29.262 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T14:17:29.249+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42923) UID: 0 2023-06-09T14:17:29.262 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T14:17:29.249+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42923) UID: 0 2023-06-09T14:22:48.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:48.802 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:48.943 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T14:22:48.933+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442831) UID: 0 2023-06-09T14:22:48.943 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T14:22:48.937+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442831) UID: 0 2023-06-09T14:22:48.947 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T14:22:48.937+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442831) UID: 0 2023-06-09T14:22:48.952 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T14:22:48.937+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442831) UID: 0 2023-06-09T14:22:49.224 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T14:22:49.216+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42964) UID: 0 2023-06-09T14:22:49.224 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T14:22:49.208+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42964) UID: 0 2023-06-09T14:22:49.224 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T14:22:49.216+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42964) UID: 0 2023-06-09T14:22:49.226 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T14:22:49.208+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42964) UID: 0 2023-06-09T14:33:01.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:01.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:01.559 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T14:33:01.547+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43018) UID: 0 2023-06-09T14:33:01.559 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T14:33:01.547+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43018) UID: 0 2023-06-09T14:33:01.677 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T14:33:01.668+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442902) UID: 0 2023-06-09T14:33:01.677 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T14:33:01.668+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442902) UID: 0 2023-06-09T14:33:01.677 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T14:33:01.668+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442902) UID: 0 2023-06-09T14:33:01.678 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T14:33:01.668+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442902) UID: 0 2023-06-09T14:35:37.517 INFO:teuthology.orchestra.run.smithi078.stdout:generic/476 4073s 2023-06-09T14:35:37.742 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/476 2023-06-09T14:35:37.742 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:35:37.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:35:37.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:35:37.790 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-06-09T14:35:50.330 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:35:50.345 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:35:50.346 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:35:50.349 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:35:50.349 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:39:40.406 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T14:39:40.397+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43034) UID: 0 2023-06-09T14:39:40.407 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T14:39:40.397+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43034) UID: 0 2023-06-09T14:39:40.407 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T14:39:40.397+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43034) UID: 0 2023-06-09T14:39:40.411 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T14:39:40.405+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43034) UID: 0 2023-06-09T14:43:50.011 INFO:teuthology.orchestra.run.smithi078.stdout:generic/477 21s 2023-06-09T14:43:50.233 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/477 2023-06-09T14:43:50.234 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:43:50.255 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:43:50.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:43:50.381 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-06-09T14:43:52.428 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:43:52.444 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:43:52.447 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:43:52.451 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:43:52.451 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:01.247 INFO:teuthology.orchestra.run.smithi078.stdout:generic/478 9s 2023-06-09T14:44:01.269 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/478 2023-06-09T14:44:01.270 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:01.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:01.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:01.377 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-06-09T14:44:02.019 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:02.040 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:02.041 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:02.041 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:02.041 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:02.942 INFO:teuthology.orchestra.run.smithi078.stdout:generic/479 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:02.956 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/479 2023-06-09T14:44:02.957 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/479 2023-06-09T14:44:02.957 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:02.966 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:03.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:03.058 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-06-09T14:44:03.704 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:03.722 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:03.724 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:03.727 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:03.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:04.624 INFO:teuthology.orchestra.run.smithi078.stdout:generic/480 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:04.638 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/480 2023-06-09T14:44:04.638 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/480 2023-06-09T14:44:04.639 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:04.647 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:04.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:04.742 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-06-09T14:44:05.348 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:05.365 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:05.367 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:05.390 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:05.390 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:06.236 INFO:teuthology.orchestra.run.smithi078.stdout:generic/481 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:06.257 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/481 2023-06-09T14:44:06.258 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/481 2023-06-09T14:44:06.258 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:06.267 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:06.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:06.342 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-06-09T14:44:06.982 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:06.997 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:06.999 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:07.002 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:07.002 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:07.912 INFO:teuthology.orchestra.run.smithi078.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T14:44:07.926 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/482 2023-06-09T14:44:07.927 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/482 2023-06-09T14:44:07.927 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:07.938 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:08.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:08.033 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-06-09T14:44:08.665 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:08.683 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:08.686 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:08.691 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:08.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:09.496 INFO:teuthology.orchestra.run.smithi078.stdout:generic/483 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:09.511 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/483 2023-06-09T14:44:09.512 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/483 2023-06-09T14:44:09.512 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:09.521 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:09.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:09.625 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-06-09T14:44:10.241 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:10.256 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:10.258 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:10.262 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:10.262 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:11.081 INFO:teuthology.orchestra.run.smithi078.stdout:generic/484 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:11.098 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/484 2023-06-09T14:44:11.098 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/484 2023-06-09T14:44:11.098 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:11.110 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:11.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:11.201 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-06-09T14:44:11.858 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:11.876 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:11.879 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:11.883 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:11.883 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:12.741 INFO:teuthology.orchestra.run.smithi078.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T14:44:12.753 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/485 2023-06-09T14:44:12.753 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/485 2023-06-09T14:44:12.753 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:12.763 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:12.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:12.857 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-06-09T14:44:13.496 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:13.512 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:13.515 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:13.520 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:13.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:14.820 INFO:teuthology.orchestra.run.smithi078.stdout:generic/486 1s 2023-06-09T14:44:14.840 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/486 2023-06-09T14:44:14.840 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:14.849 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:14.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:14.882 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-06-09T14:44:15.616 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:15.631 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:15.633 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:15.638 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:15.638 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:16.473 INFO:teuthology.orchestra.run.smithi078.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-06-09T14:44:16.491 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/487 2023-06-09T14:44:16.492 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/487 2023-06-09T14:44:16.492 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:16.500 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:16.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:16.605 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-06-09T14:44:17.248 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:17.264 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:17.273 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:17.273 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:17.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:18.078 INFO:teuthology.orchestra.run.smithi078.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T14:44:18.091 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/488 2023-06-09T14:44:18.091 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/488 2023-06-09T14:44:18.091 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:18.101 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:18.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:18.172 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-06-09T14:44:18.812 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:18.827 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:18.829 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:18.833 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:18.833 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:19.662 INFO:teuthology.orchestra.run.smithi078.stdout:generic/489 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:19.676 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/489 2023-06-09T14:44:19.676 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/489 2023-06-09T14:44:19.676 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:19.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:19.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:19.757 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-06-09T14:44:20.386 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:20.404 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:20.405 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:20.408 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:23.340 INFO:teuthology.orchestra.run.smithi078.stdout:generic/490 3s 2023-06-09T14:44:23.365 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/490 2023-06-09T14:44:23.365 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:23.374 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:23.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:23.642 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-06-09T14:44:24.485 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:24.502 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:24.503 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:24.508 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:24.508 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:25.356 INFO:teuthology.orchestra.run.smithi078.stdout:generic/491 [not run] ceph does not support freezing 2023-06-09T14:44:25.374 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/491 2023-06-09T14:44:25.374 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/491 2023-06-09T14:44:25.374 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:25.384 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:25.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:25.483 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-06-09T14:44:26.146 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:26.160 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:26.161 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:26.162 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:26.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-06-09T14:44:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/492 2023-06-09T14:44:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/492 2023-06-09T14:44:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:27.012 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:27.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:27.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-06-09T14:44:27.713 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:27.728 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:27.732 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:27.736 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:27.737 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:28.958 INFO:teuthology.orchestra.run.smithi078.stdout:generic/493 [not run] swapfiles are not supported 2023-06-09T14:44:28.977 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/493 2023-06-09T14:44:28.977 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/493 2023-06-09T14:44:28.977 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:28.988 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:29.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:29.073 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-06-09T14:44:29.687 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:29.701 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:29.702 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:29.709 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:29.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:30.932 INFO:teuthology.orchestra.run.smithi078.stdout:generic/494 [not run] swapfiles are not supported 2023-06-09T14:44:30.950 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/494 2023-06-09T14:44:30.951 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/494 2023-06-09T14:44:30.951 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:30.962 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:31.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:31.045 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-06-09T14:44:31.657 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:31.673 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:31.674 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:31.677 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:31.678 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:32.887 INFO:teuthology.orchestra.run.smithi078.stdout:generic/495 [not run] swapfiles are not supported 2023-06-09T14:44:32.907 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/495 2023-06-09T14:44:32.908 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/495 2023-06-09T14:44:32.908 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:32.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:33.000 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-06-09T14:44:33.610 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:33.628 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:33.629 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:33.633 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:34.823 INFO:teuthology.orchestra.run.smithi078.stdout:generic/496 [not run] swapfiles are not supported 2023-06-09T14:44:34.841 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/496 2023-06-09T14:44:34.841 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/496 2023-06-09T14:44:34.841 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:34.848 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:34.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:34.944 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-06-09T14:44:35.587 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:35.602 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:35.605 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:35.608 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:35.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:36.812 INFO:teuthology.orchestra.run.smithi078.stdout:generic/497 [not run] swapfiles are not supported 2023-06-09T14:44:36.831 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/497 2023-06-09T14:44:36.831 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/497 2023-06-09T14:44:36.831 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:36.840 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:36.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:36.917 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-06-09T14:44:37.563 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:37.578 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:37.580 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:37.585 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:37.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:38.450 INFO:teuthology.orchestra.run.smithi078.stdout:generic/498 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:38.467 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/498 2023-06-09T14:44:38.467 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/498 2023-06-09T14:44:38.468 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:38.476 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:38.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:38.574 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-06-09T14:44:39.208 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:39.223 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:39.224 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:39.227 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:39.227 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:40.101 INFO:teuthology.orchestra.run.smithi078.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T14:44:40.117 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/499 2023-06-09T14:44:40.118 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/499 2023-06-09T14:44:40.118 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:40.126 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:40.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:40.210 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-06-09T14:44:40.858 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:40.874 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:40.875 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:40.880 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:40.880 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:41.752 INFO:teuthology.orchestra.run.smithi078.stdout:generic/500 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:41.762 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/500 2023-06-09T14:44:41.767 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/500 2023-06-09T14:44:41.767 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:41.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:41.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:41.855 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-06-09T14:44:42.467 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:42.484 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:42.484 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:42.488 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:42.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:43.797 INFO:teuthology.orchestra.run.smithi078.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T14:44:43.818 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/501 2023-06-09T14:44:43.825 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/501 2023-06-09T14:44:43.825 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:43.839 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:44.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:44.194 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-06-09T14:44:44.828 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:44.844 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:44.845 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:44.847 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:44.847 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:45.695 INFO:teuthology.orchestra.run.smithi078.stdout:generic/502 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:44:45.708 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/502 2023-06-09T14:44:45.708 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/502 2023-06-09T14:44:45.709 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:45.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:45.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:45.828 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-06-09T14:44:46.477 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:46.493 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:46.495 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:46.498 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:46.498 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:47.346 INFO:teuthology.orchestra.run.smithi078.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T14:44:47.362 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/503 2023-06-09T14:44:47.363 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/503 2023-06-09T14:44:47.363 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:47.372 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:47.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:47.470 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-06-09T14:44:48.114 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:48.133 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:48.136 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:48.138 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:48.138 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:50.128 INFO:teuthology.orchestra.run.smithi078.stdout:generic/504 1s 2023-06-09T14:44:50.158 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/504 2023-06-09T14:44:50.159 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:50.168 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:50.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:50.272 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-06-09T14:44:50.884 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:50.899 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:50.901 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:50.908 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:50.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:51.959 INFO:teuthology.orchestra.run.smithi078.stdout:generic/505 [not run] ceph does not support shutdown 2023-06-09T14:44:52.032 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/505 2023-06-09T14:44:52.032 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/505 2023-06-09T14:44:52.032 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:52.041 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:52.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:52.117 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-06-09T14:44:52.787 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:52.806 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:52.808 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:52.811 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:52.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:53.620 INFO:teuthology.orchestra.run.smithi078.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T14:44:53.636 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/506 2023-06-09T14:44:53.636 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/506 2023-06-09T14:44:53.636 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:53.644 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:53.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:53.753 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-06-09T14:44:54.395 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:54.416 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:54.416 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:54.420 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:54.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:55.292 INFO:teuthology.orchestra.run.smithi078.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-06-09T14:44:55.305 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/507 2023-06-09T14:44:55.306 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/507 2023-06-09T14:44:55.306 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:55.318 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:55.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:55.445 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-06-09T14:44:56.084 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:56.099 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:56.104 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:56.106 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:56.106 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:56.885 INFO:teuthology.orchestra.run.smithi078.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-06-09T14:44:56.912 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/508 2023-06-09T14:44:56.912 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/508 2023-06-09T14:44:56.912 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:56.917 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:57.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:57.030 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-06-09T14:44:57.662 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:57.678 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:57.681 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:57.684 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:57.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:58.518 INFO:teuthology.orchestra.run.smithi078.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-06-09T14:44:58.531 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/509 2023-06-09T14:44:58.532 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/509 2023-06-09T14:44:58.532 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:44:58.543 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:44:58.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:44:58.642 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-06-09T14:44:59.280 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:44:59.296 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:44:59.298 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:44:59.302 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:44:59.302 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:00.139 INFO:teuthology.orchestra.run.smithi078.stdout:generic/510 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:45:00.153 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/510 2023-06-09T14:45:00.154 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/510 2023-06-09T14:45:00.154 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:00.165 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:00.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:00.262 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-06-09T14:45:00.907 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:00.922 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:00.925 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:00.929 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:00.929 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:01.764 INFO:teuthology.orchestra.run.smithi078.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T14:45:01.780 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/511 2023-06-09T14:45:01.780 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/511 2023-06-09T14:45:01.781 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:01.790 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:01.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:01.885 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-06-09T14:45:02.531 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:02.545 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:02.548 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:02.551 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:02.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:03.418 INFO:teuthology.orchestra.run.smithi078.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T14:45:03.434 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/512 2023-06-09T14:45:03.435 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/512 2023-06-09T14:45:03.435 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:03.444 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:03.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:03.525 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-06-09T14:45:04.166 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:04.178 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:04.184 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:04.188 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:04.189 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:05.498 INFO:teuthology.orchestra.run.smithi078.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T14:45:05.586 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/513 2023-06-09T14:45:05.587 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/513 2023-06-09T14:45:05.587 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:05.662 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:05.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:05.837 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-06-09T14:45:06.457 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:06.478 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:06.478 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:06.485 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:06.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:07.858 INFO:teuthology.orchestra.run.smithi078.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T14:45:07.941 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/514 2023-06-09T14:45:07.941 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/514 2023-06-09T14:45:07.941 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:07.984 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:08.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:08.120 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-06-09T14:45:08.781 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:08.793 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:08.794 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:08.798 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:08.799 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:10.216 INFO:teuthology.orchestra.run.smithi078.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T14:45:10.305 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/515 2023-06-09T14:45:10.306 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/515 2023-06-09T14:45:10.306 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:10.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:10.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:10.470 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-06-09T14:45:11.129 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:11.146 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:11.151 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:11.153 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:11.154 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T14:45:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/516 2023-06-09T14:45:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/516 2023-06-09T14:45:12.126 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:12.134 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:12.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:12.459 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-06-09T14:45:13.202 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:13.225 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:13.225 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:13.225 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:13.225 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:14.342 INFO:teuthology.orchestra.run.smithi078.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T14:45:14.584 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/517 2023-06-09T14:45:14.584 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/517 2023-06-09T14:45:14.584 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:14.645 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:14.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:14.853 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-06-09T14:45:15.500 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:15.515 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:15.518 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:15.521 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:15.522 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:16.971 INFO:teuthology.orchestra.run.smithi078.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T14:45:17.007 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/518 2023-06-09T14:45:17.008 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/518 2023-06-09T14:45:17.008 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:17.035 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:17.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:17.178 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-06-09T14:45:17.813 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:17.830 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:17.832 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:17.834 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:17.835 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:18.679 INFO:teuthology.orchestra.run.smithi078.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-06-09T14:45:18.696 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/519 2023-06-09T14:45:18.696 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/519 2023-06-09T14:45:18.696 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:18.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:18.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:18.942 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-06-09T14:45:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:19.777 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:19.779 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:19.784 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:19.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:20.613 INFO:teuthology.orchestra.run.smithi078.stdout:generic/520 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T14:45:20.631 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/520 2023-06-09T14:45:20.631 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/520 2023-06-09T14:45:20.631 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T14:45:20.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:45:20.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T14:45:20.728 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-06-09T14:45:21.383 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T14:45:21.400 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T14:45:21.402 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T14:45:21.406 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T14:45:21.407 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T14:48:32.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:32.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:32.846 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T14:48:32.839+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463407) UID: 0 2023-06-09T14:48:32.846 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T14:48:32.839+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463407) UID: 0 2023-06-09T14:48:32.847 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T14:48:32.839+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463407) UID: 0 2023-06-09T14:48:32.848 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T14:48:32.843+0000 7f9d08780700 -1 received signal: Hangup from (PID: 463407) UID: 0 2023-06-09T14:48:33.010 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T14:48:33.001+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43056) UID: 0 2023-06-09T14:48:33.011 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T14:48:33.001+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43056) UID: 0 2023-06-09T14:54:28.151 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:28.157 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:58.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:58.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:28.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:28.317 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:58.381 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:58.386 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:28.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:28.454 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:58.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:58.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:28.581 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:28.587 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:58.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:58.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:28.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:28.782 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:58.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:58.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:29.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:29.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:59.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:59.860 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:30.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:30.791 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:00.853 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:00.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:31.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:31.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:01.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:01.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:31.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:31.567 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:01.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:01.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:31.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:31.763 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:01.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:01.862 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:31.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:31.978 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:02.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:02.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:32.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:32.248 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:02.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:02.321 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:32.410 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:32.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:02.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:02.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:32.621 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:32.627 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:02.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:02.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:32.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:32.823 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:02.908 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:02.913 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:32.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:33.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:33.050 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T15:09:33.042+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463511) UID: 0 2023-06-09T15:09:33.051 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T15:09:33.046+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463511) UID: 0 2023-06-09T15:09:33.052 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T15:09:33.046+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463511) UID: 0 2023-06-09T15:09:33.052 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T15:09:33.046+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463511) UID: 0 2023-06-09T15:12:52.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:52.346 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:22.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:22.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:52.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:52.699 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:22.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:22.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:53.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:53.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:23.197 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:23.208 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:53.286 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:53.291 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:23.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:23.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:53.499 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:53.504 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:23.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:23.636 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:53.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:53.878 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:23.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:23.999 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:54.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:54.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:54.236 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T15:18:54.225+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43216) UID: 0 2023-06-09T15:18:54.236 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T15:18:54.225+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43216) UID: 0 2023-06-09T15:18:54.237 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T15:18:54.225+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43216) UID: 0 2023-06-09T15:18:54.237 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T15:18:54.225+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43216) UID: 0 2023-06-09T15:22:21.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:21.120 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:51.262 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:51.268 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:21.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:21.465 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:51.543 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:51.548 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:22.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:22.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:52.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:52.309 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:22.419 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:22.424 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:52.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:52.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:22.673 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:22.678 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:52.764 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:52.768 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:22.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:22.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:53.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:53.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:53.100 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T15:27:53.089+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43263) UID: 0 2023-06-09T15:27:53.100 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T15:27:53.089+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43263) UID: 0 2023-06-09T15:27:53.100 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T15:27:53.089+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43263) UID: 0 2023-06-09T15:27:53.101 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T15:27:53.089+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43263) UID: 0 2023-06-09T15:31:25.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:25.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:25.513 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T15:31:25.502+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43272) UID: 0 2023-06-09T15:31:25.513 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T15:31:25.502+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43272) UID: 0 2023-06-09T15:31:25.513 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T15:31:25.502+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43272) UID: 0 2023-06-09T15:31:25.514 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T15:31:25.502+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43272) UID: 0 2023-06-09T15:34:48.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:48.724 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:48.776 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T15:34:48.770+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463617) UID: 0 2023-06-09T15:34:48.777 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T15:34:48.770+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463617) UID: 0 2023-06-09T15:34:48.777 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T15:34:48.770+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463617) UID: 0 2023-06-09T15:34:48.778 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T15:34:48.770+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463617) UID: 0 2023-06-09T15:38:37.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:37.514 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:07.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:07.594 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:37.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:37.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:07.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:07.804 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:37.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:37.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:07.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:07.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:38.073 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:38.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:08.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:08.154 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:08.198 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T15:42:08.191+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463653) UID: 0 2023-06-09T15:42:08.198 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T15:42:08.191+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463653) UID: 0 2023-06-09T15:42:08.199 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T15:42:08.191+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463653) UID: 0 2023-06-09T15:42:08.199 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T15:42:08.191+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463653) UID: 0 2023-06-09T15:45:42.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:42.651 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:42.695 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T15:45:42.688+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463667) UID: 0 2023-06-09T15:45:42.695 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T15:45:42.688+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463667) UID: 0 2023-06-09T15:45:42.696 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T15:45:42.688+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463667) UID: 0 2023-06-09T15:45:42.696 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T15:45:42.688+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463667) UID: 0 2023-06-09T15:52:10.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:10.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:41.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:41.207 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:11.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:11.272 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:41.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:41.411 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:11.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:11.529 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:41.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:41.610 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:11.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:11.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:42.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:42.063 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:12.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:12.138 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:43.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:43.126 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:13.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:13.280 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:13.327 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T15:57:13.314+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43377) UID: 0 2023-06-09T15:57:13.328 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T15:57:13.314+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43377) UID: 0 2023-06-09T15:57:13.328 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T15:57:13.314+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43377) UID: 0 2023-06-09T15:57:13.328 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T15:57:13.314+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43377) UID: 0 2023-06-09T16:00:45.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:45.015 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:15.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:15.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:45.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:45.223 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:15.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:15.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:45.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:45.500 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:15.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:15.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:46.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:46.687 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:16.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:16.754 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:46.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:46.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:16.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:16.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:47.898 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:47.904 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:17.976 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:17.981 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:48.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:48.057 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:18.214 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:18.220 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:48.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:48.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:18.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:18.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:48.527 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:48.533 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:18.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:18.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:48.770 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:48.851 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:18.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:18.933 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:49.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:49.008 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:19.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:19.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:49.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:49.174 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:19.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:19.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:50.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:50.059 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:20.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:20.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:50.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:50.503 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:20.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:20.605 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:50.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:50.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:20.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:20.818 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:50.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:50.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:50.951 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T16:15:50.937+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43482) UID: 0 2023-06-09T16:15:50.952 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T16:15:50.937+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43482) UID: 0 2023-06-09T16:15:50.952 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T16:15:50.937+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43482) UID: 0 2023-06-09T16:15:50.952 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T16:15:50.937+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43482) UID: 0 2023-06-09T16:18:22.936 INFO:teuthology.orchestra.run.smithi078.stdout:generic/521 5581s 2023-06-09T16:18:23.079 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/521 2023-06-09T16:18:23.079 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T16:18:23.089 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T16:18:23.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T16:18:23.343 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-06-09T16:18:25.655 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T16:18:25.671 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T16:18:25.673 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T16:18:25.676 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T16:18:25.676 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T16:19:22.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:22.034 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:22.180 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T16:19:22.166+0000 7fabc5382700 -1 Fail to open '/proc/43495/cmdline' error = (2) No such file or directory 2023-06-09T16:19:22.180 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T16:19:22.166+0000 7fabc5382700 -1 received signal: Hangup from (PID: 43495) UID: 0 2023-06-09T16:19:22.181 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T16:19:22.166+0000 7f852cb5d700 -1 Fail to open '/proc/43495/cmdline' error = (2) No such file or directory 2023-06-09T16:19:22.181 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T16:19:22.166+0000 7f852cb5d700 -1 received signal: Hangup from (PID: 43495) UID: 0 2023-06-09T16:22:58.153 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T16:22:58.139+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43506) UID: 0 2023-06-09T16:22:58.153 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T16:22:58.139+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43506) UID: 0 2023-06-09T16:22:58.154 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T16:22:58.139+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43506) UID: 0 2023-06-09T16:22:58.154 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T16:22:58.139+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43506) UID: 0 2023-06-09T16:26:33.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:26:33.713 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:26:33.757 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T16:26:33.748+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464324) UID: 0 2023-06-09T16:26:33.758 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T16:26:33.748+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464324) UID: 0 2023-06-09T16:26:33.758 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T16:26:33.748+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464324) UID: 0 2023-06-09T16:26:33.758 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T16:26:33.748+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464324) UID: 0 2023-06-09T16:29:47.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:29:47.711 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:30:19.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:30:19.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:30:49.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:30:49.855 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:31:19.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:31:19.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:31:50.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:31:50.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:32:20.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:32:20.772 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:32:50.847 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:32:50.852 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:33:20.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:33:20.930 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:33:50.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:33:51.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:34:21.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:34:21.068 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:34:51.177 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:34:51.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:35:21.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:35:21.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:35:52.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:35:52.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:36:22.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:36:22.191 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:36:52.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:36:52.262 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:37:22.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:37:22.456 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:37:52.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:37:52.944 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:38:23.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:38:23.010 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:38:53.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:38:53.876 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:39:23.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:39:23.940 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:39:54.001 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:39:54.020 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:40:24.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:40:24.086 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:40:54.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:40:54.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:41:24.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:41:24.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:41:24.282 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T16:41:24.270+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464402) UID: 0 2023-06-09T16:41:24.283 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T16:41:24.270+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464402) UID: 0 2023-06-09T16:41:24.284 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T16:41:24.270+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464402) UID: 0 2023-06-09T16:41:24.285 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T16:41:24.270+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464402) UID: 0 2023-06-09T16:41:24.301 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T16:41:24.286+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43617) UID: 0 2023-06-09T16:41:24.302 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T16:41:24.286+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43617) UID: 0 2023-06-09T16:41:24.302 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T16:41:24.286+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43617) UID: 0 2023-06-09T16:41:24.304 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T16:41:24.286+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43617) UID: 0 2023-06-09T16:45:10.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:45:10.069 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:45:40.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:45:40.448 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:46:10.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:46:10.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:46:41.353 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:46:41.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:47:11.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:47:11.440 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:47:11.481 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T16:47:11.472+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464427) UID: 0 2023-06-09T16:47:11.482 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T16:47:11.472+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464427) UID: 0 2023-06-09T16:47:11.482 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T16:47:11.472+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464427) UID: 0 2023-06-09T16:47:11.483 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T16:47:11.472+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464427) UID: 0 2023-06-09T16:50:23.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:50:23.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:50:54.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:50:54.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:51:24.214 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:51:24.219 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:51:54.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:51:54.300 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:52:25.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:52:25.802 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:52:55.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:52:55.869 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:53:25.937 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:53:25.942 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:53:25.992 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T16:53:25.978+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464453) UID: 0 2023-06-09T16:53:25.992 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T16:53:25.978+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464453) UID: 0 2023-06-09T16:53:25.993 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T16:53:25.978+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464453) UID: 0 2023-06-09T16:53:25.993 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T16:53:25.978+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 464453) UID: 0 2023-06-09T16:56:37.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:56:38.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:56:38.057 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T16:56:38.041+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43681) UID: 0 2023-06-09T16:56:38.058 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T16:56:38.041+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43681) UID: 0 2023-06-09T16:56:38.058 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T16:56:38.041+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43681) UID: 0 2023-06-09T16:56:38.058 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T16:56:38.041+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43681) UID: 0 2023-06-09T17:00:30.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:00:30.514 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:01:00.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:01:00.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:01:30.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:01:30.715 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:02:00.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:02:00.853 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:02:30.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:02:30.958 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:03:01.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:03:01.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:03:31.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:03:31.837 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:04:01.898 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:04:01.905 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:04:32.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:04:32.446 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:05:02.513 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:05:02.520 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:05:32.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:05:32.585 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:05:32.637 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T17:05:32.621+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43724) UID: 0 2023-06-09T17:05:32.637 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T17:05:32.621+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43724) UID: 0 2023-06-09T17:05:32.637 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T17:05:32.621+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43724) UID: 0 2023-06-09T17:05:32.638 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T17:05:32.625+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43724) UID: 0 2023-06-09T17:09:19.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:09:19.189 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:09:49.348 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:09:49.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:10:19.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:10:19.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:10:49.481 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:10:49.486 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:11:19.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:11:19.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:11:49.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:11:49.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:12:19.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:12:19.814 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:12:49.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:12:49.928 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:13:20.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:13:20.034 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:13:50.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:13:50.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:14:20.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:14:20.306 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:14:50.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:14:50.373 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:14:50.419 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T17:14:50.405+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43766) UID: 0 2023-06-09T17:14:50.420 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T17:14:50.405+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43766) UID: 0 2023-06-09T17:14:50.420 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T17:14:50.405+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43766) UID: 0 2023-06-09T17:14:50.420 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T17:14:50.405+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43766) UID: 0 2023-06-09T17:18:35.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:18:35.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:19:05.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:19:05.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:19:36.137 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:19:36.143 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:20:06.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:20:06.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:20:36.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:20:36.372 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:21:06.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:21:06.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:21:37.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:21:37.208 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:22:07.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:22:07.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:22:37.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:22:37.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:23:07.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:23:07.480 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:23:37.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:23:37.600 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:24:01.783 INFO:teuthology.orchestra.run.smithi078.stdout:generic/522 3935s 2023-06-09T17:24:01.897 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/522 2023-06-09T17:24:01.898 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:01.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:02.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:02.096 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-06-09T17:24:03.708 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:03.727 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:03.729 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:03.733 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:03.733 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:05.389 INFO:teuthology.orchestra.run.smithi078.stdout:generic/523 1s 2023-06-09T17:24:05.413 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/523 2023-06-09T17:24:05.413 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:05.425 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:05.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:05.456 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-06-09T17:24:06.090 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:06.105 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:06.107 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:06.111 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:06.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:07.661 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:24:07.666 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:24:14.123 INFO:teuthology.orchestra.run.smithi078.stdout:generic/524 8s 2023-06-09T17:24:14.148 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/524 2023-06-09T17:24:14.148 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:14.156 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:14.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:14.192 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-06-09T17:24:14.780 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:14.799 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:14.800 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:14.805 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:14.805 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:15.855 INFO:teuthology.orchestra.run.smithi078.stdout:generic/525 [not run] filesystem does not support huge file size 2023-06-09T17:24:15.914 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/525 2023-06-09T17:24:15.915 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/525 2023-06-09T17:24:15.915 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:15.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:15.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:16.000 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-06-09T17:24:16.639 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:16.659 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:16.660 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:16.663 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:16.663 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:17.583 INFO:teuthology.orchestra.run.smithi078.stdout:generic/526 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:24:17.597 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/526 2023-06-09T17:24:17.597 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/526 2023-06-09T17:24:17.598 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:17.608 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:17.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:17.721 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-06-09T17:24:18.340 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:18.355 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:18.357 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:18.362 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:18.362 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:19.209 INFO:teuthology.orchestra.run.smithi078.stdout:generic/527 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:24:19.225 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/527 2023-06-09T17:24:19.225 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/527 2023-06-09T17:24:19.226 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:19.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:19.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:19.329 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-06-09T17:24:19.965 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:19.981 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:19.984 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:19.988 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:19.989 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:20.997 INFO:teuthology.orchestra.run.smithi078.stdout:generic/528 0s 2023-06-09T17:24:21.019 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/528 2023-06-09T17:24:21.019 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:21.027 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:21.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:21.208 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-06-09T17:24:22.089 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:22.107 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:22.109 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:22.113 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:22.113 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:24.123 INFO:teuthology.orchestra.run.smithi078.stdout:generic/529 2s 2023-06-09T17:24:24.148 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/529 2023-06-09T17:24:24.149 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:24.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:24.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:24.190 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-06-09T17:24:24.811 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:24.826 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:24.828 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:24.832 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:24.832 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:25.904 INFO:teuthology.orchestra.run.smithi078.stdout:generic/530 [not run] ceph does not support shutdown 2023-06-09T17:24:25.975 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/530 2023-06-09T17:24:25.976 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/530 2023-06-09T17:24:25.976 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:25.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:26.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:26.070 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-06-09T17:24:26.702 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:26.720 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:26.722 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:26.727 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:26.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:27.491 INFO:teuthology.orchestra.run.smithi078.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-06-09T17:24:27.507 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/531 2023-06-09T17:24:27.507 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/531 2023-06-09T17:24:27.507 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:27.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:27.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:27.605 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-06-09T17:24:28.248 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:28.263 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:28.265 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:28.268 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:28.269 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:29.266 INFO:teuthology.orchestra.run.smithi078.stdout:generic/532 1s 2023-06-09T17:24:29.286 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/532 2023-06-09T17:24:29.286 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:29.299 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:29.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:29.387 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-06-09T17:24:30.018 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:30.033 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:30.035 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:30.038 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:30.038 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:31.777 INFO:teuthology.orchestra.run.smithi078.stdout:generic/533 1s 2023-06-09T17:24:31.798 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/533 2023-06-09T17:24:31.798 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:31.807 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:31.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:31.887 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-06-09T17:24:32.505 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:32.520 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:32.523 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:32.529 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:33.374 INFO:teuthology.orchestra.run.smithi078.stdout:generic/534 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:24:33.389 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/534 2023-06-09T17:24:33.390 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/534 2023-06-09T17:24:33.390 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:33.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:33.475 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-06-09T17:24:34.119 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:34.139 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:34.141 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:34.144 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:34.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:34.957 INFO:teuthology.orchestra.run.smithi078.stdout:generic/535 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:24:34.977 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/535 2023-06-09T17:24:34.977 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/535 2023-06-09T17:24:34.978 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:34.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:35.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:35.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-06-09T17:24:35.698 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:35.715 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:35.717 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:35.721 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:35.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:36.778 INFO:teuthology.orchestra.run.smithi078.stdout:generic/536 [not run] ceph does not support shutdown 2023-06-09T17:24:36.874 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/536 2023-06-09T17:24:36.875 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/536 2023-06-09T17:24:36.875 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:36.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:36.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:36.951 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-06-09T17:24:37.573 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:37.589 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:37.590 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:37.594 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:37.594 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:37.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:24:37.928 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:24:38.872 INFO:teuthology.orchestra.run.smithi078.stdout:generic/537 [not run] FSTRIM not supported 2023-06-09T17:24:38.934 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/537 2023-06-09T17:24:38.934 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/537 2023-06-09T17:24:38.935 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:24:38.944 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:24:39.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:24:39.045 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-06-09T17:24:39.689 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:24:39.705 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:24:39.706 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:24:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:24:39.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:25:07.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:25:07.997 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:25:38.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:25:38.497 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:26:08.597 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:26:08.605 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:26:39.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:26:39.334 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:27:09.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:27:09.405 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:27:39.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:27:39.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:27:39.597 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T17:27:39.587+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43848) UID: 0 2023-06-09T17:27:39.597 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T17:27:39.587+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43848) UID: 0 2023-06-09T17:31:23.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:31:23.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:31:53.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:31:53.988 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:32:24.047 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:32:24.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:32:54.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:32:54.118 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:33:24.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:33:24.183 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:33:54.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:33:54.258 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:34:24.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:34:24.526 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:34:24.575 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T17:34:24.565+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477029) UID: 0 2023-06-09T17:34:24.576 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T17:34:24.565+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477029) UID: 0 2023-06-09T17:34:24.576 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T17:34:24.565+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477029) UID: 0 2023-06-09T17:34:24.577 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T17:34:24.565+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477029) UID: 0 2023-06-09T17:37:39.997 INFO:teuthology.orchestra.run.smithi078.stdout:generic/538 779s 2023-06-09T17:37:40.028 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/538 2023-06-09T17:37:40.029 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:40.038 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:40.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:40.382 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-06-09T17:37:40.675 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:37:40.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:37:41.279 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:41.294 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:41.295 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:41.300 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:41.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:44.200 INFO:teuthology.orchestra.run.smithi078.stdout:generic/539 3s 2023-06-09T17:37:44.220 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/539 2023-06-09T17:37:44.220 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:44.231 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:44.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:44.580 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-06-09T17:37:45.316 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:45.332 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:45.334 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:45.337 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:45.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:46.653 INFO:teuthology.orchestra.run.smithi078.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T17:37:46.706 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/540 2023-06-09T17:37:46.706 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/540 2023-06-09T17:37:46.707 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:46.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:46.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:46.891 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-06-09T17:37:47.500 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:47.515 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:47.517 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:47.521 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:47.521 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:48.830 INFO:teuthology.orchestra.run.smithi078.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T17:37:48.901 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/541 2023-06-09T17:37:48.901 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/541 2023-06-09T17:37:48.901 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:48.965 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:49.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:49.112 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-06-09T17:37:49.754 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:49.768 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:49.770 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:49.773 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:49.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:51.192 INFO:teuthology.orchestra.run.smithi078.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T17:37:51.278 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/542 2023-06-09T17:37:51.278 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/542 2023-06-09T17:37:51.278 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:51.354 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:51.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:51.455 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-06-09T17:37:52.108 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:52.124 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:52.126 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:52.130 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:52.130 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:53.564 INFO:teuthology.orchestra.run.smithi078.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T17:37:53.595 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/543 2023-06-09T17:37:53.595 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/543 2023-06-09T17:37:53.595 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:53.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:53.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:53.770 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-06-09T17:37:54.403 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:54.424 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:54.425 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:54.429 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:54.429 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:55.771 INFO:teuthology.orchestra.run.smithi078.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T17:37:55.860 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/544 2023-06-09T17:37:55.860 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/544 2023-06-09T17:37:55.860 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:56.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:56.043 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-06-09T17:37:56.660 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:56.675 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:56.678 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:56.682 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:56.682 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:57.612 INFO:teuthology.orchestra.run.smithi078.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-06-09T17:37:57.628 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/545 2023-06-09T17:37:57.628 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/545 2023-06-09T17:37:57.629 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:37:57.645 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:37:57.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:37:57.730 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-06-09T17:37:58.386 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:37:58.407 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:37:58.410 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:37:58.415 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:37:58.415 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:00.068 INFO:teuthology.orchestra.run.smithi078.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T17:38:00.082 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/546 2023-06-09T17:38:00.082 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/546 2023-06-09T17:38:00.083 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:38:00.095 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:00.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:38:00.188 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-06-09T17:38:00.801 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:38:00.816 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:38:00.818 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:38:00.824 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:38:00.824 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:01.666 INFO:teuthology.orchestra.run.smithi078.stdout:generic/547 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:38:01.682 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/547 2023-06-09T17:38:01.683 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/547 2023-06-09T17:38:01.683 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:38:01.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:01.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:38:01.785 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-06-09T17:38:02.420 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:38:02.436 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:38:02.439 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:38:02.442 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:38:02.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:04.371 INFO:teuthology.orchestra.run.smithi078.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T17:38:04.403 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/548 2023-06-09T17:38:04.403 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/548 2023-06-09T17:38:04.403 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:38:04.426 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:04.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:38:04.533 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-06-09T17:38:05.172 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:38:05.190 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:38:05.193 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:38:05.197 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:38:05.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:07.216 INFO:teuthology.orchestra.run.smithi078.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T17:38:07.235 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/549 2023-06-09T17:38:07.236 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/549 2023-06-09T17:38:07.236 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:38:07.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:07.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:38:07.347 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-06-09T17:38:07.965 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:38:07.989 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:38:07.991 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:38:07.996 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:38:07.996 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:09.417 INFO:teuthology.orchestra.run.smithi078.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-06-09T17:38:09.505 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/550 2023-06-09T17:38:09.505 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/550 2023-06-09T17:38:09.505 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:38:09.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:09.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:38:09.603 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-06-09T17:38:10.219 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:38:10.236 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:38:10.239 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:38:10.242 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:38:10.243 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:38:11.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:38:11.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:38:41.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:38:41.820 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:38:41.907 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T17:38:41.897+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485196) UID: 0 2023-06-09T17:38:41.907 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T17:38:41.897+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485196) UID: 0 2023-06-09T17:38:41.907 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T17:38:41.897+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485196) UID: 0 2023-06-09T17:38:41.908 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T17:38:41.897+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485196) UID: 0 2023-06-09T17:42:22.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:42:22.012 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:42:22.058 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T17:42:22.047+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43901) UID: 0 2023-06-09T17:42:22.058 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T17:42:22.047+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43901) UID: 0 2023-06-09T17:42:22.059 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T17:42:22.047+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43901) UID: 0 2023-06-09T17:42:22.059 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T17:42:22.047+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43901) UID: 0 2023-06-09T17:46:05.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:46:05.770 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:46:35.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:46:35.924 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:47:06.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:47:06.068 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:47:36.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:47:36.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:48:06.373 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:48:06.380 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:48:36.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:48:36.620 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:49:07.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:49:07.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:49:37.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:49:37.351 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:50:07.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:50:07.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:50:37.610 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:50:37.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:51:07.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:51:07.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:51:37.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:51:37.865 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:52:07.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:52:07.944 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:52:38.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:52:38.069 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:53:08.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:53:08.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:53:38.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:53:38.713 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:54:08.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:54:08.815 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:54:38.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:54:38.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:55:09.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:55:09.048 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:55:39.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:55:39.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:55:39.435 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T17:55:39.428+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43974) UID: 0 2023-06-09T17:55:39.436 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T17:55:39.428+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43974) UID: 0 2023-06-09T17:55:39.436 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T17:55:39.428+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43974) UID: 0 2023-06-09T17:55:39.436 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T17:55:39.428+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43974) UID: 0 2023-06-09T17:58:12.577 INFO:teuthology.orchestra.run.smithi078.stdout:generic/551 1202s 2023-06-09T17:58:12.620 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/551 2023-06-09T17:58:12.621 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:12.633 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:12.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:12.666 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-06-09T17:58:13.657 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:13.674 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:13.676 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:13.679 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:13.679 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:15.388 INFO:teuthology.orchestra.run.smithi078.stdout:generic/552 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:58:15.403 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/552 2023-06-09T17:58:15.404 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/552 2023-06-09T17:58:15.404 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:15.417 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:15.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:15.521 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-06-09T17:58:16.167 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:16.184 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:16.187 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:16.191 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:16.191 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:17.157 INFO:teuthology.orchestra.run.smithi078.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-06-09T17:58:17.173 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/553 2023-06-09T17:58:17.173 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/553 2023-06-09T17:58:17.173 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:17.181 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:17.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:17.500 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-06-09T17:58:18.237 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:18.253 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:18.255 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:18.259 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:18.259 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:19.626 INFO:teuthology.orchestra.run.smithi078.stdout:generic/554 [not run] swapfiles are not supported 2023-06-09T17:58:19.642 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/554 2023-06-09T17:58:19.642 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/554 2023-06-09T17:58:19.643 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:19.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:19.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:19.985 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-06-09T17:58:20.713 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:20.737 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:20.739 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:20.743 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:20.743 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:21.687 INFO:teuthology.orchestra.run.smithi078.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-06-09T17:58:21.705 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/555 2023-06-09T17:58:21.705 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/555 2023-06-09T17:58:21.705 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:21.717 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:22.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:22.067 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-06-09T17:58:22.778 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:22.793 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:22.795 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:22.803 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:22.804 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:23.605 INFO:teuthology.orchestra.run.smithi078.stdout:generic/556 [not run] ceph does not support casefold feature 2023-06-09T17:58:23.619 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/556 2023-06-09T17:58:23.619 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/556 2023-06-09T17:58:23.619 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:23.626 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:23.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:23.719 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-06-09T17:58:24.312 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:24.327 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:24.329 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:24.333 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:24.333 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:25.167 INFO:teuthology.orchestra.run.smithi078.stdout:generic/557 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:58:25.179 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/557 2023-06-09T17:58:25.179 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/557 2023-06-09T17:58:25.180 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:25.192 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:25.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:25.284 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-06-09T17:58:25.923 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:25.939 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:25.940 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:25.944 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:25.944 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:26.735 INFO:teuthology.orchestra.run.smithi078.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T17:58:26.747 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/558 2023-06-09T17:58:26.747 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/558 2023-06-09T17:58:26.747 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:26.759 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:26.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:26.845 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-06-09T17:58:27.475 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:27.489 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:27.491 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:27.496 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:27.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:28.372 INFO:teuthology.orchestra.run.smithi078.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-06-09T17:58:28.386 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/559 2023-06-09T17:58:28.386 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/559 2023-06-09T17:58:28.386 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:28.395 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:28.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:28.480 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-06-09T17:58:29.106 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:29.125 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:29.126 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:29.132 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:29.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:29.953 INFO:teuthology.orchestra.run.smithi078.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-06-09T17:58:29.972 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/560 2023-06-09T17:58:29.973 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/560 2023-06-09T17:58:29.973 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:29.981 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:30.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:30.066 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-06-09T17:58:30.694 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:30.709 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:30.711 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:31.500 INFO:teuthology.orchestra.run.smithi078.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-06-09T17:58:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/561 2023-06-09T17:58:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/561 2023-06-09T17:58:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:31.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:31.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:31.609 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-06-09T17:58:32.253 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:32.267 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:32.270 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:32.275 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:33.577 INFO:teuthology.orchestra.run.smithi078.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T17:58:33.731 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/562 2023-06-09T17:58:33.732 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/562 2023-06-09T17:58:33.732 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:33.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:33.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:33.894 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-06-09T17:58:34.507 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:34.521 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:34.523 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:34.527 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:35.421 INFO:teuthology.orchestra.run.smithi078.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-06-09T17:58:35.436 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/563 2023-06-09T17:58:35.436 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/563 2023-06-09T17:58:35.436 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:35.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:35.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:35.531 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-06-09T17:58:36.148 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:36.168 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:36.170 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:36.172 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:36.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:37.512 INFO:teuthology.orchestra.run.smithi078.stdout:generic/564 1s 2023-06-09T17:58:37.535 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/564 2023-06-09T17:58:37.536 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:37.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:37.911 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-06-09T17:58:38.647 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:38.662 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:38.664 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:38.668 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:40.001 INFO:teuthology.orchestra.run.smithi078.stdout:generic/565 0s 2023-06-09T17:58:40.027 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/565 2023-06-09T17:58:40.027 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:40.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:40.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:40.323 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-06-09T17:58:41.084 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:41.102 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:41.104 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:41.108 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:41.108 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:41.945 INFO:teuthology.orchestra.run.smithi078.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T17:58:41.962 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/566 2023-06-09T17:58:41.962 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/566 2023-06-09T17:58:41.963 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:41.972 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:42.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:42.053 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-06-09T17:58:42.716 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:42.735 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:42.737 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:42.740 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:42.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:44.400 INFO:teuthology.orchestra.run.smithi078.stdout:generic/567 1s 2023-06-09T17:58:44.425 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/567 2023-06-09T17:58:44.425 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:44.433 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:44.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:44.463 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-06-09T17:58:45.084 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:45.102 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:45.104 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:45.107 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:45.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:45.943 INFO:teuthology.orchestra.run.smithi078.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T17:58:45.960 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/568 2023-06-09T17:58:45.960 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/568 2023-06-09T17:58:45.960 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:45.969 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:46.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:46.073 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-06-09T17:58:46.694 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:46.710 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:46.712 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:46.716 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:46.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:48.024 INFO:teuthology.orchestra.run.smithi078.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T17:58:48.040 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/569 2023-06-09T17:58:48.040 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/569 2023-06-09T17:58:48.040 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:48.050 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:48.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:48.151 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-06-09T17:58:48.776 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:48.791 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:48.793 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:48.796 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:48.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:49.619 INFO:teuthology.orchestra.run.smithi078.stdout:generic/570 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T17:58:49.635 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/570 2023-06-09T17:58:49.636 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/570 2023-06-09T17:58:49.636 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:49.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:49.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:49.713 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-06-09T17:58:50.331 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:50.347 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:50.349 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:50.354 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:50.354 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:51.175 INFO:teuthology.orchestra.run.smithi078.stdout:generic/571 [not run] Require fcntl setlease support 2023-06-09T17:58:51.189 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/571 2023-06-09T17:58:51.190 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/571 2023-06-09T17:58:51.190 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:51.199 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:51.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:51.309 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-06-09T17:58:51.930 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:51.950 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:51.951 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:51.955 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:51.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:52.792 INFO:teuthology.orchestra.run.smithi078.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-06-09T17:58:52.806 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/572 2023-06-09T17:58:52.807 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/572 2023-06-09T17:58:52.807 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:52.821 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:52.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:52.897 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-06-09T17:58:53.557 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:53.584 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:53.586 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:53.593 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:53.594 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:54.407 INFO:teuthology.orchestra.run.smithi078.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-06-09T17:58:54.425 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/573 2023-06-09T17:58:54.425 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/573 2023-06-09T17:58:54.425 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:54.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:54.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:54.507 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-06-09T17:58:55.124 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:55.140 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:55.142 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:55.146 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:55.146 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:55.939 INFO:teuthology.orchestra.run.smithi078.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-06-09T17:58:55.955 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/574 2023-06-09T17:58:55.955 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/574 2023-06-09T17:58:55.955 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:55.962 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:56.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:56.045 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-06-09T17:58:56.661 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:56.677 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:56.679 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:56.684 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:56.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:57.489 INFO:teuthology.orchestra.run.smithi078.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-06-09T17:58:57.503 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/575 2023-06-09T17:58:57.503 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/575 2023-06-09T17:58:57.504 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:57.513 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:57.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:57.602 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-06-09T17:58:58.246 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:58.260 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:58.263 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:58.267 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:58.268 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:59.184 INFO:teuthology.orchestra.run.smithi078.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-06-09T17:58:59.199 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/576 2023-06-09T17:58:59.199 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/576 2023-06-09T17:58:59.199 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:58:59.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:58:59.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:58:59.287 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-06-09T17:58:59.945 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:58:59.960 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:58:59.962 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:58:59.966 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:58:59.966 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:00.776 INFO:teuthology.orchestra.run.smithi078.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-06-09T17:59:00.793 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/577 2023-06-09T17:59:00.793 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/577 2023-06-09T17:59:00.793 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:00.801 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:00.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:00.872 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-06-09T17:59:01.484 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:01.502 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:01.504 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:01.507 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:01.507 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:02.399 INFO:teuthology.orchestra.run.smithi078.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T17:59:02.414 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/578 2023-06-09T17:59:02.414 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/578 2023-06-09T17:59:02.415 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:02.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:02.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:02.713 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-06-09T17:59:03.521 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:03.537 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:03.540 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:03.545 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:03.545 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:04.373 INFO:teuthology.orchestra.run.smithi078.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-06-09T17:59:04.387 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/579 2023-06-09T17:59:04.387 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/579 2023-06-09T17:59:04.387 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:04.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:04.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:04.484 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-06-09T17:59:05.125 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:05.139 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:05.141 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:05.145 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:05.145 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:08.844 INFO:teuthology.orchestra.run.smithi078.stdout:generic/580 3s 2023-06-09T17:59:08.865 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/580 2023-06-09T17:59:08.865 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:08.873 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:08.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:08.918 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-06-09T17:59:09.520 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:09.537 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:09.538 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:09.542 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:09.542 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:16.219 INFO:teuthology.orchestra.run.smithi078.stdout:generic/581 7s 2023-06-09T17:59:16.240 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/581 2023-06-09T17:59:16.240 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:16.249 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:16.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:16.280 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-06-09T17:59:16.925 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:16.944 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:16.946 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:16.949 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:16.950 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:18.991 INFO:teuthology.orchestra.run.smithi078.stdout:generic/582 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T17:59:19.004 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/582 2023-06-09T17:59:19.004 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/582 2023-06-09T17:59:19.005 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:19.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:19.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:19.116 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-06-09T17:59:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:19.779 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:19.780 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:19.784 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:19.784 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:20.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:59:20.740 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:59:21.835 INFO:teuthology.orchestra.run.smithi078.stdout:generic/583 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T17:59:21.852 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/583 2023-06-09T17:59:21.852 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/583 2023-06-09T17:59:21.852 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:21.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:21.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:21.983 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-06-09T17:59:22.603 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:22.621 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:22.624 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:22.628 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:22.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:24.057 INFO:teuthology.orchestra.run.smithi078.stdout:generic/584 [not run] encryption policy '-c 9 -n 9 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2023-06-09T17:59:24.124 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/584 2023-06-09T17:59:24.125 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/584 2023-06-09T17:59:24.125 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:24.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:24.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:24.209 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-06-09T17:59:24.820 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:24.837 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:24.839 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:24.845 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:24.845 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:25.715 INFO:teuthology.orchestra.run.smithi078.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-06-09T17:59:25.728 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/585 2023-06-09T17:59:25.728 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/585 2023-06-09T17:59:25.729 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:25.746 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:26.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:26.037 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-06-09T17:59:26.782 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:26.797 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:26.799 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:26.803 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:26.803 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:27.785 INFO:teuthology.orchestra.run.smithi078.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T17:59:27.798 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/586 2023-06-09T17:59:27.799 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/586 2023-06-09T17:59:27.799 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:27.808 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:28.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:28.107 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-06-09T17:59:28.821 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:28.836 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:28.838 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:28.843 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:28.843 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:29.908 INFO:teuthology.orchestra.run.smithi078.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T17:59:29.924 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/587 2023-06-09T17:59:29.924 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/587 2023-06-09T17:59:29.924 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:29.935 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:30.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:30.039 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-06-09T17:59:30.682 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:30.698 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:30.700 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:30.703 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:30.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:32.106 INFO:teuthology.orchestra.run.smithi078.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T17:59:32.183 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/588 2023-06-09T17:59:32.183 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/588 2023-06-09T17:59:32.184 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:32.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:32.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:32.297 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-06-09T17:59:32.925 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:32.944 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:32.946 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:32.950 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:32.950 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:33.766 INFO:teuthology.orchestra.run.smithi078.stdout:generic/589 [not run] require 172.21.15.78:6789:/scratch to be local device 2023-06-09T17:59:33.784 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/589 2023-06-09T17:59:33.785 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/589 2023-06-09T17:59:33.785 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:33.793 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:33.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:33.859 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-06-09T17:59:34.508 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:34.521 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:34.522 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:34.527 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:34.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:35.338 INFO:teuthology.orchestra.run.smithi078.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T17:59:35.354 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/590 2023-06-09T17:59:35.354 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/590 2023-06-09T17:59:35.354 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:35.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:35.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:35.460 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-06-09T17:59:36.073 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:36.090 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:36.093 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:36.097 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:36.097 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:37.145 INFO:teuthology.orchestra.run.smithi078.stdout:generic/591 1s 2023-06-09T17:59:37.166 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/591 2023-06-09T17:59:37.166 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:37.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:37.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:37.487 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-06-09T17:59:38.194 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:38.208 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:38.209 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:38.213 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:38.214 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:39.955 INFO:teuthology.orchestra.run.smithi078.stdout:generic/592 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 8' 2023-06-09T17:59:40.023 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/592 2023-06-09T17:59:40.024 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/592 2023-06-09T17:59:40.024 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:40.036 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:40.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:40.110 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-06-09T17:59:40.742 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:40.759 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:40.761 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:40.765 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:40.765 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:42.929 INFO:teuthology.orchestra.run.smithi078.stdout:generic/593 [not run] xfs_io add_enckey doesn't support -k 2023-06-09T17:59:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/593 2023-06-09T17:59:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/593 2023-06-09T17:59:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:42.997 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:43.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:43.083 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-06-09T17:59:43.702 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:43.720 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:43.723 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:43.730 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:43.730 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:44.520 INFO:teuthology.orchestra.run.smithi078.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T17:59:44.536 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/594 2023-06-09T17:59:44.537 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/594 2023-06-09T17:59:44.537 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:44.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:44.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:44.631 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-06-09T17:59:45.244 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:45.263 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:45.265 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:45.269 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:45.269 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:50.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:59:50.818 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T17:59:52.962 INFO:teuthology.orchestra.run.smithi078.stdout:generic/595 7s 2023-06-09T17:59:53.023 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/595 2023-06-09T17:59:53.024 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:53.035 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:53.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:53.069 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-06-09T17:59:53.920 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:53.936 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:53.938 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:53.942 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:53.943 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:54.776 INFO:teuthology.orchestra.run.smithi078.stdout:generic/596 [not run] accton utility required, skipped this test 2023-06-09T17:59:54.792 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/596 2023-06-09T17:59:54.792 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/596 2023-06-09T17:59:54.792 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:54.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:54.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:54.871 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-06-09T17:59:55.500 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:55.517 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:55.519 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:55.523 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:55.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:57.479 INFO:teuthology.orchestra.run.smithi078.stdout:generic/597 2s 2023-06-09T17:59:57.500 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/597 2023-06-09T17:59:57.501 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T17:59:57.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T17:59:57.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T17:59:57.896 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-06-09T17:59:58.569 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T17:59:58.587 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T17:59:58.589 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T17:59:58.592 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T17:59:58.592 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:00.490 INFO:teuthology.orchestra.run.smithi078.stdout:generic/598 2s 2023-06-09T18:00:00.509 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/598 2023-06-09T18:00:00.510 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:00.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:00.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:00.848 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-06-09T18:00:01.559 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:01.575 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:01.578 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:01.583 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:01.583 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:02.610 INFO:teuthology.orchestra.run.smithi078.stdout:generic/599 [not run] ceph does not support shutdown 2023-06-09T18:00:02.671 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/599 2023-06-09T18:00:02.671 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/599 2023-06-09T18:00:02.672 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:02.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:02.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:02.762 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-06-09T18:00:03.371 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:03.387 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:03.389 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:03.393 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:03.394 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:04.195 INFO:teuthology.orchestra.run.smithi078.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T18:00:04.212 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/600 2023-06-09T18:00:04.213 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/600 2023-06-09T18:00:04.213 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:04.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:04.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:04.296 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-06-09T18:00:04.930 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:04.947 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:04.948 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:04.951 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:04.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:05.735 INFO:teuthology.orchestra.run.smithi078.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T18:00:05.748 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/601 2023-06-09T18:00:05.749 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/601 2023-06-09T18:00:05.749 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:05.762 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:05.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:05.839 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-06-09T18:00:06.463 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:06.484 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:06.486 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:06.490 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:06.490 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:08.248 INFO:teuthology.orchestra.run.smithi078.stdout:generic/602 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 16' 2023-06-09T18:00:08.314 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/602 2023-06-09T18:00:08.315 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/602 2023-06-09T18:00:08.315 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:08.324 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:08.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:08.386 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-06-09T18:00:08.998 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:09.015 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:09.016 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:09.021 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:09.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:09.847 INFO:teuthology.orchestra.run.smithi078.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T18:00:09.866 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/603 2023-06-09T18:00:09.866 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/603 2023-06-09T18:00:09.866 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:09.876 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:09.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:09.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-06-09T18:00:10.604 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:10.619 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:10.621 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:10.625 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:10.625 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:17.726 INFO:teuthology.orchestra.run.smithi078.stdout:generic/604 7s 2023-06-09T18:00:17.751 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/604 2023-06-09T18:00:17.751 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:17.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:17.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:17.793 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-06-09T18:00:18.425 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:18.439 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:18.440 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:18.443 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:18.444 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:21.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:00:21.109 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:00:21.144 INFO:teuthology.orchestra.run.smithi078.stdout:generic/605 [not run] mount 172.21.15.78:6789:/scratch with dax=always failed 2023-06-09T18:00:21.163 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/605 2023-06-09T18:00:21.163 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/605 2023-06-09T18:00:21.163 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:21.164 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T18:00:21.155+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515752) UID: 0 2023-06-09T18:00:21.164 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T18:00:21.155+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515752) UID: 0 2023-06-09T18:00:21.165 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T18:00:21.155+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515752) UID: 0 2023-06-09T18:00:21.165 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T18:00:21.155+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515752) UID: 0 2023-06-09T18:00:21.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:21.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:21.249 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-06-09T18:00:22.049 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:22.068 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:22.070 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:22.074 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:22.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:23.137 INFO:teuthology.orchestra.run.smithi078.stdout:generic/606 [not run] mount 172.21.15.78:6789:/scratch with dax=always failed 2023-06-09T18:00:23.152 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/606 2023-06-09T18:00:23.153 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/606 2023-06-09T18:00:23.153 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:23.164 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:23.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:23.248 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-06-09T18:00:23.955 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:23.975 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:23.977 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:23.981 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:23.981 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:24.921 INFO:teuthology.orchestra.run.smithi078.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-06-09T18:00:24.936 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/607 2023-06-09T18:00:24.936 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/607 2023-06-09T18:00:24.936 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:24.948 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:25.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:25.242 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-06-09T18:00:25.943 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:25.960 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:25.963 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:25.967 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:25.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:27.017 INFO:teuthology.orchestra.run.smithi078.stdout:generic/608 [not run] mount 172.21.15.78:6789:/scratch with dax=always failed 2023-06-09T18:00:27.045 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/608 2023-06-09T18:00:27.046 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/608 2023-06-09T18:00:27.046 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:27.057 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:27.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:27.151 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-06-09T18:00:27.896 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:27.923 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:27.925 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:27.928 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:27.928 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:29.200 INFO:teuthology.orchestra.run.smithi078.stdout:generic/609 1s 2023-06-09T18:00:29.223 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/609 2023-06-09T18:00:29.224 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:29.234 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:29.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:29.556 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-06-09T18:00:30.315 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:30.330 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:30.333 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:30.337 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:30.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T18:00:31.447 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/610 2023-06-09T18:00:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/610 2023-06-09T18:00:31.448 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:31.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:31.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:31.559 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-06-09T18:00:32.231 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:32.249 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:32.252 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:32.256 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:33.815 INFO:teuthology.orchestra.run.smithi078.stdout:generic/611 1s 2023-06-09T18:00:33.845 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/611 2023-06-09T18:00:33.845 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:33.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:33.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:33.895 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-06-09T18:00:34.592 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:34.610 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:34.612 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:34.615 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:34.615 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:35.588 INFO:teuthology.orchestra.run.smithi078.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T18:00:35.605 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/612 2023-06-09T18:00:35.605 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/612 2023-06-09T18:00:35.605 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:35.614 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:35.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:35.795 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-06-09T18:00:36.660 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:36.676 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:36.678 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:36.683 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:36.683 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:38.426 INFO:teuthology.orchestra.run.smithi078.stdout:generic/613 [not run] _get_encryption_nonce() isn't implemented on ceph 2023-06-09T18:00:38.470 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/613 2023-06-09T18:00:38.471 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/613 2023-06-09T18:00:38.471 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:38.494 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:38.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:38.656 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-06-09T18:00:39.326 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:39.349 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:39.351 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:39.355 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:39.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:40.479 INFO:teuthology.orchestra.run.smithi078.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-06-09T18:00:40.566 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/614 2023-06-09T18:00:40.566 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/614 2023-06-09T18:00:40.566 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:00:40.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:00:40.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:00:40.670 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-06-09T18:00:41.354 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:00:41.374 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:00:41.376 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:00:41.380 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:00:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:13.419 INFO:teuthology.orchestra.run.smithi078.stdout:generic/615 92s 2023-06-09T18:02:13.497 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/615 2023-06-09T18:02:13.497 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:13.504 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:13.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:13.541 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-06-09T18:02:14.156 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:14.171 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:14.173 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:14.177 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:14.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:15.146 INFO:teuthology.orchestra.run.smithi078.stdout:generic/616 [not run] kernel does not support IO_URING 2023-06-09T18:02:15.165 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/616 2023-06-09T18:02:15.166 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/616 2023-06-09T18:02:15.166 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:15.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:15.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:15.277 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-06-09T18:02:15.908 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:15.924 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:15.926 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:15.930 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:15.930 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:17.161 INFO:teuthology.orchestra.run.smithi078.stdout:generic/617 [not run] kernel does not support IO_URING 2023-06-09T18:02:17.180 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/617 2023-06-09T18:02:17.180 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/617 2023-06-09T18:02:17.180 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:17.190 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:17.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:17.300 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-06-09T18:02:18.001 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:18.027 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:18.029 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:18.033 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:18.034 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:19.774 INFO:teuthology.orchestra.run.smithi078.stdout:generic/618 1s 2023-06-09T18:02:19.796 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/618 2023-06-09T18:02:19.797 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:19.812 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:19.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:19.846 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-06-09T18:02:20.552 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:20.567 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:20.569 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:20.573 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:20.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:21.512 INFO:teuthology.orchestra.run.smithi078.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T18:02:21.529 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/619 2023-06-09T18:02:21.529 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/619 2023-06-09T18:02:21.529 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:21.538 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:21.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:21.637 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-06-09T18:02:22.275 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:22.292 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:22.295 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:22.298 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:22.298 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:23.507 INFO:teuthology.orchestra.run.smithi078.stdout:generic/620 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T18:02:23.523 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/620 2023-06-09T18:02:23.524 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/620 2023-06-09T18:02:23.524 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:23.536 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:23.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:23.619 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-06-09T18:02:24.260 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:24.276 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:24.279 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:24.284 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:generic/621 [not run] kernel doesn't support renameat2 syscall 2023-06-09T18:02:26.423 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/621 2023-06-09T18:02:26.423 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/621 2023-06-09T18:02:26.423 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:26.441 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:26.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:26.768 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-06-09T18:02:27.630 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:27.647 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:27.649 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:27.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:29.301 INFO:teuthology.orchestra.run.smithi078.stdout:generic/622 [not run] ceph does not support shutdown 2023-06-09T18:02:29.369 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/622 2023-06-09T18:02:29.369 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/622 2023-06-09T18:02:29.370 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:29.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:29.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:29.478 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-06-09T18:02:30.165 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:30.180 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:30.182 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:30.184 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:30.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:31.229 INFO:teuthology.orchestra.run.smithi078.stdout:generic/623 [not run] ceph does not support shutdown 2023-06-09T18:02:31.298 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/623 2023-06-09T18:02:31.298 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/623 2023-06-09T18:02:31.298 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:31.307 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:31.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:31.386 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-06-09T18:02:32.036 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:32.055 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:32.056 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:32.060 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:32.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:33.313 INFO:teuthology.orchestra.run.smithi078.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-06-09T18:02:33.332 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/624 2023-06-09T18:02:33.332 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/624 2023-06-09T18:02:33.332 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:33.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:33.410 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-06-09T18:02:34.074 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:34.089 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:34.091 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:34.094 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:34.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:35.146 INFO:teuthology.orchestra.run.smithi078.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-06-09T18:02:35.167 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/625 2023-06-09T18:02:35.168 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/625 2023-06-09T18:02:35.168 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:35.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:35.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:35.260 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-06-09T18:02:35.950 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:35.965 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:35.967 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:35.974 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:35.974 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:37.187 INFO:teuthology.orchestra.run.smithi078.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-06-09T18:02:37.203 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/626 2023-06-09T18:02:37.203 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/626 2023-06-09T18:02:37.203 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:37.214 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:37.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:37.619 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-06-09T18:02:38.294 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:38.309 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:38.311 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:38.316 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:38.316 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:39.343 INFO:teuthology.orchestra.run.smithi078.stdout:generic/627 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T18:02:39.360 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/627 2023-06-09T18:02:39.361 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/627 2023-06-09T18:02:39.361 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:39.373 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:39.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:39.466 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-06-09T18:02:40.216 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:40.232 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:40.237 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:40.240 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:40.240 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:41.927 INFO:teuthology.orchestra.run.smithi078.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:02:41.948 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/628 2023-06-09T18:02:41.948 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/628 2023-06-09T18:02:41.948 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:41.964 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:42.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:42.086 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-06-09T18:02:42.802 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:42.819 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:42.822 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:42.827 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:42.827 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:44.124 INFO:teuthology.orchestra.run.smithi078.stdout:generic/629 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T18:02:44.144 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/629 2023-06-09T18:02:44.144 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/629 2023-06-09T18:02:44.145 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:44.153 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:44.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:44.233 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-06-09T18:02:44.945 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:44.960 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:44.961 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:44.965 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:44.965 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:46.091 INFO:teuthology.orchestra.run.smithi078.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T18:02:46.270 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/630 2023-06-09T18:02:46.271 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/630 2023-06-09T18:02:46.271 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:02:46.290 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:02:46.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:02:46.620 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-06-09T18:02:47.724 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:02:47.743 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:02:47.745 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:02:47.751 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:02:47.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:19.973 INFO:teuthology.orchestra.run.smithi078.stdout:generic/631 - output mismatch (see /tmp/tmp.bWnQzKjaCzxfstests-dev/results//generic/631.out.bad) 2023-06-09T18:03:20.037 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/631.out 2023-06-09 11:13:25.603003449 +0000 2023-06-09T18:03:20.037 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.bWnQzKjaCzxfstests-dev/results//generic/631.out.bad 2023-06-09 18:03:19.924624044 +0000 2023-06-09T18:03:20.037 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,2 +1,3218 @@ 2023-06-09T18:03:20.037 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 631 2023-06-09T18:03:20.038 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.038 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.038 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directorymv: 2023-06-09T18:03:20.038 INFO:teuthology.orchestra.run.smithi078.stdout: +cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.038 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.038 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.038 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.039 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.039 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.039 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.039 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.039 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.039 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.039 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.040 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.041 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.041 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.041 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.041 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.041 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.041 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.041 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.042 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.043 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.044 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.044 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.044 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.044 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.044 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.044 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.044 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.046 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.046 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.046 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.046 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.046 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.046 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.046 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.047 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.048 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.048 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.048 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.048 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.048 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.048 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.048 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.049 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.050 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.051 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.052 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.052 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.052 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.052 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.052 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.052 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.052 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.053 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf' 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.054 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.055 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.056 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.057 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.057 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.057 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.057 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.057 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.057 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.057 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.058 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.059 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.060 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.060 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.060 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.060 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.060 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.060 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.060 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.061 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.062 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.063 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.064 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.064 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.064 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.064 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.064 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.064 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.064 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.065 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.066 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.067 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.068 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.068 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.068 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.068 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.068 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.068 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.068 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.069 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted./tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.070 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.071 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.072 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.072 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.072 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.072 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.072 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.072 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.072 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.073 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.074 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.074 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.074 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.074 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.074 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.074 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.074 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.075 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.076 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.077 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.077 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.077 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.077 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.077 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.077 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.077 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.078 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.079 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.080 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.080 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-06-09T18:03:20.080 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.080 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.080 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.080 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.080 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.081 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.082 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.082 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.082 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.082 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.082 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.082 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.082 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.083 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.084 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted./tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.085 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.086 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.087 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.088 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.088 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.088 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.088 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.088 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.088 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.088 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.089 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.090 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.092 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.093 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.094 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.096 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.096 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.096 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.096 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.096 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.096 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.096 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.097 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.098 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.099 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.100 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.100 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.100 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.100 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.100 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.100 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.100 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.101 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.102 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.103 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.104 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.105 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.106 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.106 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.106 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.106 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.106 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.106 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.106 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.107 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.108 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.109 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.110 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.110 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.110 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.110 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.110 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.110 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.110 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.111 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.112 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.113 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.114 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.115 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-09T18:03:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.117 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.118 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.118 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.118 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.118 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.118 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.118 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.118 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T18:03:20.123 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.123 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.123 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.123 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.123 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.123 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.123 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.124 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.124 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.124 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.124 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.124 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.124 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.124 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directorymv: 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.125 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.126 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.127 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.128 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.128 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.128 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.128 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.128 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.128 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.128 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: mount: mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.129 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.130 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.131 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.131 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.131 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.131 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.131 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.131 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.131 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.132 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.133 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.134 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.134 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.134 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.134 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.134 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.134 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.134 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.135 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.136 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.137 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.138 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.139 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.140 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.140 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.140 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.140 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.140 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.140 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.140 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.141 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.142 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.143 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.143 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.143 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.143 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.143 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.143 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.143 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.144 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.145 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.146 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.146 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.146 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.146 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.146 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.146 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.146 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.147 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.148 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.149 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.150 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.151 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.152 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.152 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.152 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.152 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.152 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.152 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.152 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.153 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.154 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.155 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.155 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.155 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.155 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.155 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.155 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.155 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.156 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.157 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.158 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.159 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.160 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.161 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.161 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.161 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.161 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.161 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.161 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.161 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.162 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.163 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.164 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.164 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.164 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.164 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.164 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.164 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.164 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.165 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.166 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.167 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.168 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.169 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.169 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.169 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.169 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.169 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.169 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.169 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.170 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.171 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.172 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.173 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.173 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.173 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.173 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.173 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.173 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.173 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.174 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.175 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.176 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.178 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.179 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.179 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.179 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.179 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.179 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.179 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.179 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted.umount: 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.180 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.181 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.182 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.183 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.184 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.184 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.184 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.184 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.184 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.184 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.184 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.185 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.186 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.187 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.188 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.188 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.188 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.188 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.188 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.188 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.188 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.189 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.190 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.192 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.193 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.193 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.193 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.193 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.193 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.193 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.193 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.194 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.195 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.196 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.197 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf' 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.198 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.199 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.200 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.200 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.200 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.200 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.200 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.200 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.200 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.201 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.202 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.203 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.203 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.203 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.203 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.203 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.203 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.203 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.205 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.206 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.207 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.208 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.210 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.211 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.212 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.213 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.214 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.215 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.216 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.216 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.216 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.216 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.216 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.216 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.216 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.217 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.218 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.219 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.220 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.221 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.221 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.221 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.221 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.221 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.221 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.221 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.222 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.223 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.224 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.225 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf' 2023-06-09T18:03:20.226 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.227 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.228 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.229 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.230 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.231 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.232 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.233 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.233 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.233 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.233 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.233 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.233 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.233 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.234 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.235 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.236 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.237 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.238 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.238 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.238 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.238 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.238 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.238 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.238 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.239 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.240 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.241 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.242 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.243 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.244 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.244 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.244 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.244 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.244 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.244 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.244 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.245 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.246 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.247 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.248 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.249 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.250 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.251 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.252 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.252 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.252 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.252 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.252 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.252 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.252 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.253 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.254 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.255 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.256 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.257 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.258 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.259 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.261 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.262 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.263 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.264 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.264 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.264 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.264 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.264 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.264 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.264 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.265 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.266 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.267 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.267 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.267 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.267 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.267 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.267 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.267 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.268 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.268 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.268 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.268 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.268 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.268 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.268 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.269 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.270 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.271 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.272 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.273 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.273 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.273 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.273 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.273 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.273 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.273 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.274 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.275 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.276 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.277 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.278 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.279 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.280 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.281 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.282 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.283 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.284 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.284 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.284 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.284 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.284 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.284 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.284 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.285 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.286 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.287 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf' 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.288 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.289 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.289 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.289 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.289 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.289 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.289 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.289 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.290 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.291 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.292 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.293 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.293 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.293 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.293 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.293 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.293 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.293 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.294 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.295 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.296 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.296 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.296 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.296 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.296 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.296 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.296 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf' 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.297 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf'umount: : No such file or directory/tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.298 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.299 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.300 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.301 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.302 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.303 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.303 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.303 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.303 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.303 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.303 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.303 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.304 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.305 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.305 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.305 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.305 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.305 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.305 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.305 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: mount: mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.306 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.307 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf' 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.308 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.311 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.312 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.313 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.314 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.314 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.314 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.314 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.314 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.314 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.314 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.315 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.316 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.317 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.318 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.319 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.320 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.320 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.320 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.320 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.320 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.320 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.320 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.321 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.322 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.326 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.327 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.328 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.328 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.328 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.328 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.328 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.328 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.328 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.329 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.330 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.331 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.332 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.333 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.334 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.334 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.334 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.334 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.334 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.334 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.334 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf' 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.335 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.336 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.337 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.338 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.339 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.340 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.340 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.340 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.340 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.340 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.340 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.340 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf' 2023-06-09T18:03:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.342 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.343 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.344 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.344 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.344 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.344 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.344 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.344 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.344 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.345 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.346 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.348 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.349 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.350 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.351 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.352 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.352 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.352 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.352 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.352 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.352 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.352 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.353 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.355 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.355 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.355 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.355 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.355 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.355 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted./tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.355 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.umount: 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.356 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.357 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.touch: 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.358 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.359 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.360 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.360 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.360 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.360 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.360 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.360 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.360 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.361 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.362 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf' 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.365 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.366 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.366 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.366 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.366 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.366 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.366 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.366 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.367 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.368 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.369 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.371 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.372 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.373 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.374 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.374 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.374 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.374 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.374 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.374 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.374 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.375 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.376 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.377 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.378 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.380 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.381 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.382 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.382 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.382 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.382 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.382 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.382 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.382 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.383 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.384 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.385 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted./tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.386 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.387 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.388 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.388 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.388 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.388 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.388 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.388 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.388 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.390 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.392 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.393 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.393 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.393 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.393 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.393 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.393 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf' 2023-06-09T18:03:20.393 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.394 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.395 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.396 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.396 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.396 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.396 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.396 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.396 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.396 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.397 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.398 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.399 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.401 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.402 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.403 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.403 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.403 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.403 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.403 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.403 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.403 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.404 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.405 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.406 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.407 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.409 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +: No such file or directory 2023-06-09T18:03:20.410 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.411 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.412 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.413 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.413 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.413 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.413 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.413 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.413 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.413 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.414 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.415 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf'mount: : No such file or directory/tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.417 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.418 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.419 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.419 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.419 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.419 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.419 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.419 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.419 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.420 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.421 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.422 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.423 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.424 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.424 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.424 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.424 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.424 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.424 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.424 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.425 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.426 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.427 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.428 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.429 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.430 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.430 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.430 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.430 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.430 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.430 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.430 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.431 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.432 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.433 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.434 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.434 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.434 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.434 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted.umount: 2023-06-09T18:03:20.434 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.434 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.434 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.435 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.436 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.437 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.440 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.441 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.442 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.444 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.444 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.444 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.444 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.444 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.444 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.444 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: + 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.445 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.446 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.446 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.446 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.446 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.446 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.446 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.446 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted.umount: 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.447 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.448 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.449 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.450 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.450 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.450 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.450 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.450 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.450 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.450 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged3/etc/access.conf': No such file or directory 2023-06-09T18:03:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged3: not mounted. 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged5/etc/access.conf': No such file or directory 2023-06-09T18:03:20.452 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged1/etc/access.conf': No such file or directory 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged5: not mounted. 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged1: not mounted. 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged0/etc/access.conf': No such file or directory 2023-06-09T18:03:20.453 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged0: not mounted. 2023-06-09T18:03:20.454 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.454 INFO:teuthology.orchestra.run.smithi078.stdout: +mount: /tmp/tmp.cKkqOgfa4gscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-06-09T18:03:20.454 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.454 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.454 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.454 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.454 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout: +mv: cannot stat '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged4/etc/access.conf': No such file or directory 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout: +touch: cannot touch '/tmp/tmp.cKkqOgfa4gscratch/merged2/etc/access.conf': No such file or directory 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged4: not mounted. 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout: +umount: /tmp/tmp.cKkqOgfa4gscratch/merged2: not mounted. 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout: Silence is golden. 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:20.455 INFO:teuthology.orchestra.run.smithi078.stdout:HINT: You _MAY_ be missing kernel fix: 2023-06-09T18:03:20.456 INFO:teuthology.orchestra.run.smithi078.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-06-09T18:03:20.456 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:20.456 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/631 2023-06-09T18:03:20.456 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/631 2023-06-09T18:03:20.456 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-06-09T18:03:20.456 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:20.456 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-06-09T18:03:20.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-06-09T18:03:20.458 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-06-09T18:03:21.209 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:21.227 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:21.231 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:21.235 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:21.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:26.487 INFO:teuthology.orchestra.run.smithi078.stdout:generic/632 5s 2023-06-09T18:03:26.509 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/632 2023-06-09T18:03:26.510 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:26.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:26.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:26.618 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-06-09T18:03:27.287 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:27.300 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:27.301 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:27.304 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:27.305 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:28.716 INFO:teuthology.orchestra.run.smithi078.stdout:generic/633 1s 2023-06-09T18:03:28.743 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/633 2023-06-09T18:03:28.744 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:28.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:29.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:29.089 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-06-09T18:03:29.844 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:29.870 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:29.872 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:29.876 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:29.876 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:32.108 INFO:teuthology.orchestra.run.smithi078.stdout:generic/634 2s 2023-06-09T18:03:32.144 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/634 2023-06-09T18:03:32.144 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:32.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:32.188 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-06-09T18:03:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:32.894 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:32.896 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:32.901 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:34.106 INFO:teuthology.orchestra.run.smithi078.stdout:generic/635 [not run] ceph does not support shutdown 2023-06-09T18:03:34.156 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/635 2023-06-09T18:03:34.156 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/635 2023-06-09T18:03:34.156 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:34.164 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:34.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:34.250 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-06-09T18:03:35.007 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:35.036 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:35.038 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:35.041 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:35.041 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:37.350 INFO:teuthology.orchestra.run.smithi078.stdout:generic/636 [not run] swapfiles are not supported 2023-06-09T18:03:37.365 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/636 2023-06-09T18:03:37.365 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/636 2023-06-09T18:03:37.366 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:37.377 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:37.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:37.486 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-06-09T18:03:38.160 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:38.178 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:38.182 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:38.186 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:38.186 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:40.093 INFO:teuthology.orchestra.run.smithi078.stdout:generic/637 1s 2023-06-09T18:03:40.124 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/637 2023-06-09T18:03:40.125 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:40.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:40.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:40.581 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-06-09T18:03:41.398 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:41.416 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:41.419 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:41.424 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:41.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:42.444 INFO:teuthology.orchestra.run.smithi078.stdout:generic/638 1s 2023-06-09T18:03:42.478 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/638 2023-06-09T18:03:42.479 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:42.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:42.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:42.630 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-06-09T18:03:43.338 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:43.357 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:43.359 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:43.364 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:43.364 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:44.522 INFO:teuthology.orchestra.run.smithi078.stdout:generic/639 1s 2023-06-09T18:03:44.547 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/639 2023-06-09T18:03:44.548 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:44.557 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:44.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:44.695 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-06-09T18:03:45.336 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:45.353 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:45.354 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:45.357 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:45.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:46.226 INFO:teuthology.orchestra.run.smithi078.stdout:generic/640 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T18:03:46.240 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/640 2023-06-09T18:03:46.240 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/640 2023-06-09T18:03:46.240 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:46.249 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:46.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:46.331 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-06-09T18:03:46.956 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:46.974 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:46.976 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:46.980 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:46.980 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:48.204 INFO:teuthology.orchestra.run.smithi078.stdout:generic/641 [not run] swapfiles are not supported 2023-06-09T18:03:48.221 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/641 2023-06-09T18:03:48.221 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/641 2023-06-09T18:03:48.222 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:03:48.229 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:03:48.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:03:48.302 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-06-09T18:03:48.951 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:03:48.970 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:03:48.972 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:03:48.975 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:03:48.976 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:04:14.764 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:04:14.770 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:04:44.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:04:44.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:05:15.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:05:15.097 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:05:46.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:05:46.299 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:06:16.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:06:16.380 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:06:46.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:06:46.957 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:07:21.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:07:21.743 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:07:51.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:07:51.826 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:07:51.989 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T18:07:51.982+0000 7fabc5382700 -1 Fail to open '/proc/44022/cmdline' error = (2) No such file or directory 2023-06-09T18:07:51.989 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T18:07:51.982+0000 7fabc5382700 -1 received signal: Hangup from (PID: 44022) UID: 0 2023-06-09T18:07:51.989 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T18:07:51.982+0000 7f852cb5d700 -1 Fail to open '/proc/44022/cmdline' error = (2) No such file or directory 2023-06-09T18:07:51.990 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T18:07:51.982+0000 7f852cb5d700 -1 received signal: Hangup from (PID: 44022) UID: 0 2023-06-09T18:11:09.856 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T18:11:09.848+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44031) UID: 0 2023-06-09T18:11:09.857 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T18:11:09.848+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44031) UID: 0 2023-06-09T18:11:09.858 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T18:11:09.852+0000 7f2dd17e0700 -1 Fail to open '/proc/44031/cmdline' error = (2) No such file or directory 2023-06-09T18:11:09.858 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T18:11:09.852+0000 7f2dd17e0700 -1 received signal: Hangup from (PID: 44031) UID: 0 2023-06-09T18:11:09.859 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T18:11:09.852+0000 7f4a4484a700 -1 Fail to open '/proc/44031/cmdline' error = (2) No such file or directory 2023-06-09T18:11:09.859 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T18:11:09.852+0000 7f4a4484a700 -1 received signal: Hangup from (PID: 44031) UID: 0 2023-06-09T18:15:49.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:15:49.034 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:15:49.113 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T18:15:49.108+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44045) UID: 0 2023-06-09T18:15:49.113 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T18:15:49.108+0000 7f852cb5d700 -1 received signal: Hangup from (PID: 44045) UID: 0 2023-06-09T18:16:29.216 INFO:teuthology.orchestra.run.smithi078.stdout:generic/642 760s 2023-06-09T18:16:29.241 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/642 2023-06-09T18:16:29.241 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:16:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:16:29.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:16:29.285 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-06-09T18:16:33.399 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:16:33.416 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:16:33.418 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:16:33.422 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:16:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:21:32.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:21:32.465 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:21:32.531 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T18:21:32.524+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565586) UID: 0 2023-06-09T18:21:32.532 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T18:21:32.524+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565586) UID: 0 2023-06-09T18:21:32.532 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T18:21:32.524+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565586) UID: 0 2023-06-09T18:21:32.533 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T18:21:32.524+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565586) UID: 0 2023-06-09T18:22:54.924 INFO:teuthology.orchestra.run.smithi078.stdout:generic/643 [not run] swapfiles are not supported 2023-06-09T18:22:54.941 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/643 2023-06-09T18:22:54.942 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/643 2023-06-09T18:22:54.942 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:22:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:22:55.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:22:55.058 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-06-09T18:22:55.763 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:22:55.786 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:22:55.788 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:22:55.793 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:22:55.793 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:22:57.279 INFO:teuthology.orchestra.run.smithi078.stdout:generic/644 [not run] vfstest not support by ceph 2023-06-09T18:22:57.297 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/644 2023-06-09T18:22:57.298 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/644 2023-06-09T18:22:57.298 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:22:57.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:22:57.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:22:57.398 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-06-09T18:22:58.120 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:22:58.139 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:22:58.142 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:22:58.146 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:22:58.147 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:22:59.140 INFO:teuthology.orchestra.run.smithi078.stdout:generic/645 [not run] vfstest not support by ceph 2023-06-09T18:22:59.159 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/645 2023-06-09T18:22:59.159 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/645 2023-06-09T18:22:59.159 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:22:59.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:22:59.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:22:59.262 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-06-09T18:22:59.923 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:22:59.943 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:22:59.945 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:22:59.951 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:22:59.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:01.082 INFO:teuthology.orchestra.run.smithi078.stdout:generic/646 [not run] ceph does not support shutdown 2023-06-09T18:23:01.175 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/646 2023-06-09T18:23:01.175 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/646 2023-06-09T18:23:01.175 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:23:01.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:01.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:23:01.280 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-06-09T18:23:01.925 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:23:01.943 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:23:01.946 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:23:01.951 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:23:01.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:03.334 INFO:teuthology.orchestra.run.smithi078.stdout:generic/647 1s 2023-06-09T18:23:03.358 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/647 2023-06-09T18:23:03.359 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:23:03.369 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:03.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:23:03.713 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-06-09T18:23:04.448 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:23:04.466 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:23:04.469 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:23:04.474 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:23:04.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:06.026 INFO:teuthology.orchestra.run.smithi078.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:23:06.082 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/648 2023-06-09T18:23:06.083 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/648 2023-06-09T18:23:06.083 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:23:06.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:06.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:23:06.214 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-06-09T18:23:06.863 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:23:06.882 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:23:06.885 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:23:06.889 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:23:06.889 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:08.073 INFO:teuthology.orchestra.run.smithi078.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T18:23:08.089 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/649 2023-06-09T18:23:08.089 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/649 2023-06-09T18:23:08.089 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:23:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:23:08.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:23:08.428 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-06-09T18:23:09.141 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:23:09.162 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:23:09.165 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:23:09.170 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:23:09.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:27:36.970 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:27:36.977 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:27:37.848 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T18:27:37.842+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44079) UID: 0 2023-06-09T18:27:37.849 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T18:27:37.842+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44079) UID: 0 2023-06-09T18:27:37.849 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T18:27:37.842+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44079) UID: 0 2023-06-09T18:27:37.850 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T18:27:37.842+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44079) UID: 0 2023-06-09T18:32:24.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:32:24.349 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:32:25.248 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T18:32:25.242+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44092) UID: 0 2023-06-09T18:32:25.248 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T18:32:25.242+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44092) UID: 0 2023-06-09T18:37:08.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:37:08.265 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:37:38.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:37:38.695 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:38:09.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:38:09.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:38:39.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:38:39.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:39:09.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:39:09.767 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:39:39.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:39:39.949 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:40:10.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:40:10.021 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:40:40.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:40:40.938 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:41:11.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:41:11.137 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:41:41.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:41:41.249 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:42:11.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:42:11.543 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:42:41.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:42:41.782 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:42:41.907 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T18:42:41.897+0000 7f53f7409700 -1 Fail to open '/proc/571229/cmdline' error = (2) No such file or directory 2023-06-09T18:42:41.907 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T18:42:41.897+0000 7f53f7409700 -1 received signal: Hangup from (PID: 571229) UID: 0 2023-06-09T18:42:41.907 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T18:42:41.897+0000 7f9d08780700 -1 Fail to open '/proc/571229/cmdline' error = (2) No such file or directory 2023-06-09T18:42:41.908 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T18:42:41.897+0000 7f9d08780700 -1 received signal: Hangup from (PID: 571229) UID: 0 2023-06-09T18:42:41.915 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T18:42:41.905+0000 7f2ccb0b8700 -1 Fail to open '/proc/571229/cmdline' error = (2) No such file or directory 2023-06-09T18:42:41.915 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T18:42:41.905+0000 7f2ccb0b8700 -1 received signal: Hangup from (PID: 571229) UID: 0 2023-06-09T18:42:41.920 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T18:42:41.905+0000 7f904e1b2700 -1 Fail to open '/proc/571229/cmdline' error = (2) No such file or directory 2023-06-09T18:42:41.921 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T18:42:41.905+0000 7f904e1b2700 -1 received signal: Hangup from (PID: 571229) UID: 0 2023-06-09T18:51:14.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:51:14.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:51:14.711 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T18:51:14.706+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44226) UID: 0 2023-06-09T18:51:14.713 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T18:51:14.706+0000 7fbd0d438700 -1 Fail to open '/proc/44226/cmdline' error = (2) No such file or directory 2023-06-09T18:51:14.713 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T18:51:14.706+0000 7fbd0d438700 -1 received signal: Hangup from (PID: 44226) UID: 0 2023-06-09T18:51:14.714 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T18:51:14.706+0000 7f4a4484a700 -1 Fail to open '/proc/44226/cmdline' error = (3) No such process 2023-06-09T18:51:14.714 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T18:51:14.706+0000 7f4a4484a700 -1 received signal: Hangup from (PID: 44226) UID: 0 2023-06-09T18:51:14.716 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T18:51:14.706+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44226) UID: 0 2023-06-09T18:51:15.002 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T18:51:14.993+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572218) UID: 0 2023-06-09T18:51:15.002 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T18:51:14.993+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572218) UID: 0 2023-06-09T18:51:15.003 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T18:51:14.993+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572218) UID: 0 2023-06-09T18:51:15.005 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T18:51:14.993+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 572218) UID: 0 2023-06-09T18:57:54.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:57:54.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T18:57:55.097 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T18:57:55.093+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44245) UID: 0 2023-06-09T18:57:55.098 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T18:57:55.093+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44245) UID: 0 2023-06-09T18:59:15.181 INFO:teuthology.orchestra.run.smithi078.stdout:generic/650 2166s 2023-06-09T18:59:15.329 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/650 2023-06-09T18:59:15.329 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:15.343 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:15.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:15.585 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-06-09T18:59:17.257 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:17.278 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:17.280 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:17.284 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:17.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:18.753 INFO:teuthology.orchestra.run.smithi078.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:18.815 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/651 2023-06-09T18:59:18.815 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/651 2023-06-09T18:59:18.816 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:18.878 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:18.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:18.992 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-06-09T18:59:19.622 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:19.638 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:19.640 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:19.644 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:19.645 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:21.156 INFO:teuthology.orchestra.run.smithi078.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:21.209 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/652 2023-06-09T18:59:21.211 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/652 2023-06-09T18:59:21.211 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:21.236 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:21.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:21.362 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-06-09T18:59:21.983 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:21.999 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:22.000 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:22.005 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:22.005 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:23.364 INFO:teuthology.orchestra.run.smithi078.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:23.516 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/653 2023-06-09T18:59:23.517 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/653 2023-06-09T18:59:23.517 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:23.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:23.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:23.664 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-06-09T18:59:24.344 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:24.365 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:24.366 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:24.369 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:24.369 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:25.732 INFO:teuthology.orchestra.run.smithi078.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:25.877 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/654 2023-06-09T18:59:25.877 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/654 2023-06-09T18:59:25.878 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:25.905 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:26.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:26.046 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-06-09T18:59:26.677 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:26.694 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:26.696 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:26.699 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:26.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:28.082 INFO:teuthology.orchestra.run.smithi078.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:28.210 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/655 2023-06-09T18:59:28.210 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/655 2023-06-09T18:59:28.210 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:28.248 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:28.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:28.382 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-06-09T18:59:28.995 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:29.011 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:29.012 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:29.015 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:29.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:29.829 INFO:teuthology.orchestra.run.smithi078.stdout:generic/656 [not run] vfstest not support by ceph 2023-06-09T18:59:29.847 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/656 2023-06-09T18:59:29.847 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/656 2023-06-09T18:59:29.848 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:29.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:29.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:29.936 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-06-09T18:59:30.560 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:30.576 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:30.578 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:30.581 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:30.581 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:31.982 INFO:teuthology.orchestra.run.smithi078.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:32.051 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/657 2023-06-09T18:59:32.053 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/657 2023-06-09T18:59:32.053 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:32.083 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:32.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:32.240 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-06-09T18:59:32.843 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:32.859 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:32.862 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:32.866 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:34.242 INFO:teuthology.orchestra.run.smithi078.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:34.358 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/658 2023-06-09T18:59:34.358 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/658 2023-06-09T18:59:34.359 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:34.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:34.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:34.553 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-06-09T18:59:35.170 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:35.188 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:35.189 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:35.193 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:35.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:36.575 INFO:teuthology.orchestra.run.smithi078.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:36.705 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/659 2023-06-09T18:59:36.705 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/659 2023-06-09T18:59:36.706 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:36.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:36.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:36.835 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-06-09T18:59:37.465 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:37.483 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:37.485 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:37.488 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:37.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:38.774 INFO:teuthology.orchestra.run.smithi078.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:38.880 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/660 2023-06-09T18:59:38.881 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/660 2023-06-09T18:59:38.881 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:38.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:39.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:39.157 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-06-09T18:59:39.765 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:39.786 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:39.788 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:39.792 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:39.792 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:41.134 INFO:teuthology.orchestra.run.smithi078.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:41.193 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/661 2023-06-09T18:59:41.193 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/661 2023-06-09T18:59:41.194 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:41.264 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:41.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:41.436 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-06-09T18:59:42.060 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:42.078 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:42.080 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:42.084 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:42.084 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:43.359 INFO:teuthology.orchestra.run.smithi078.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:43.499 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/662 2023-06-09T18:59:43.499 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/662 2023-06-09T18:59:43.499 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:43.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:43.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:43.776 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-06-09T18:59:44.393 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:44.410 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:44.412 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:44.416 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:44.416 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:45.797 INFO:teuthology.orchestra.run.smithi078.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:45.890 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/663 2023-06-09T18:59:45.891 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/663 2023-06-09T18:59:45.891 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:46.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:46.044 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-06-09T18:59:46.653 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:46.672 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:46.673 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:46.677 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:46.677 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:48.050 INFO:teuthology.orchestra.run.smithi078.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:48.081 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/664 2023-06-09T18:59:48.081 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/664 2023-06-09T18:59:48.082 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:48.103 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:48.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:48.277 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-06-09T18:59:48.898 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:48.911 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:48.913 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:48.917 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:48.917 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:50.219 INFO:teuthology.orchestra.run.smithi078.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:50.285 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/665 2023-06-09T18:59:50.286 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/665 2023-06-09T18:59:50.286 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:50.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:50.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:50.561 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-06-09T18:59:51.184 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:51.198 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:51.200 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:51.203 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:51.203 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:52.564 INFO:teuthology.orchestra.run.smithi078.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:52.664 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/666 2023-06-09T18:59:52.664 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/666 2023-06-09T18:59:52.665 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:52.675 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:52.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:52.865 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-06-09T18:59:53.486 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:53.504 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:53.506 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:53.511 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:53.511 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:54.880 INFO:teuthology.orchestra.run.smithi078.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:54.926 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/667 2023-06-09T18:59:54.926 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/667 2023-06-09T18:59:54.926 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:54.981 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:55.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:55.137 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-06-09T18:59:55.752 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:55.767 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:55.768 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:55.772 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:55.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:57.192 INFO:teuthology.orchestra.run.smithi078.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:57.259 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/668 2023-06-09T18:59:57.259 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/668 2023-06-09T18:59:57.259 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:57.286 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:57.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:57.409 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-06-09T18:59:58.021 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T18:59:58.037 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T18:59:58.039 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T18:59:58.043 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T18:59:58.043 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:59.348 INFO:teuthology.orchestra.run.smithi078.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T18:59:59.487 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/669 2023-06-09T18:59:59.487 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/669 2023-06-09T18:59:59.487 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T18:59:59.540 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T18:59:59.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T18:59:59.699 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-06-09T19:00:00.334 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:00:00.354 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:00:00.356 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:00:00.359 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:00:00.359 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:01.752 INFO:teuthology.orchestra.run.smithi078.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T19:00:01.801 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/670 2023-06-09T19:00:01.802 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/670 2023-06-09T19:00:01.802 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:00:01.832 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:01.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:00:01.971 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-06-09T19:00:02.591 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:00:02.607 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:00:02.610 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:00:02.614 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:00:02.614 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:03.963 INFO:teuthology.orchestra.run.smithi078.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T19:00:04.055 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/671 2023-06-09T19:00:04.055 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/671 2023-06-09T19:00:04.055 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:00:04.079 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:04.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:00:04.267 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-06-09T19:00:04.887 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:00:04.901 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:00:04.903 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:00:04.908 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:00:04.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:06.288 INFO:teuthology.orchestra.run.smithi078.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T19:00:06.359 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/672 2023-06-09T19:00:06.360 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/672 2023-06-09T19:00:06.360 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:00:06.431 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:06.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:00:06.551 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-06-09T19:00:07.186 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:00:07.204 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:00:07.205 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:00:07.209 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:00:07.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:09.075 INFO:teuthology.orchestra.run.smithi078.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T19:00:09.098 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/673 2023-06-09T19:00:09.099 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/673 2023-06-09T19:00:09.099 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:00:09.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:09.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:00:09.365 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-06-09T19:00:10.000 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:00:10.019 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:00:10.021 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:00:10.025 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:00:10.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:11.452 INFO:teuthology.orchestra.run.smithi078.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T19:00:11.660 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/674 2023-06-09T19:00:11.661 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/674 2023-06-09T19:00:11.661 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:00:11.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:11.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:00:11.970 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-06-09T19:00:12.587 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:00:12.605 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:00:12.606 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:00:12.610 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:00:12.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:13.999 INFO:teuthology.orchestra.run.smithi078.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T19:00:14.017 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/675 2023-06-09T19:00:14.018 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/675 2023-06-09T19:00:14.018 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:00:14.029 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:00:14.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:00:14.254 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-06-09T19:00:14.889 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:00:14.903 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:00:14.905 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:00:14.908 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:00:14.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:05:31.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:05:31.695 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:05:35.429 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T19:05:35.422+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44265) UID: 0 2023-06-09T19:05:35.430 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T19:05:35.422+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44265) UID: 0 2023-06-09T19:13:50.152 INFO:teuthology.orchestra.run.smithi078.stdout:generic/676 815s 2023-06-09T19:13:50.172 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/676 2023-06-09T19:13:50.172 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:13:50.181 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:50.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:13:50.526 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-06-09T19:13:51.243 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:13:51.255 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:13:51.257 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:13:51.261 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:13:51.261 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:52.120 INFO:teuthology.orchestra.run.smithi078.stdout:generic/677 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T19:13:52.140 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/677 2023-06-09T19:13:52.140 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/677 2023-06-09T19:13:52.140 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:13:52.150 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:52.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:13:52.307 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-06-09T19:13:52.937 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:13:52.956 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:13:52.958 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:13:52.961 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:13:52.961 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:54.412 INFO:teuthology.orchestra.run.smithi078.stdout:generic/678 [not run] kernel does not support IO_URING 2023-06-09T19:13:54.430 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/678 2023-06-09T19:13:54.430 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/678 2023-06-09T19:13:54.431 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:13:54.440 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:54.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:13:54.543 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-06-09T19:13:55.165 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:13:55.184 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:13:55.186 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:13:55.189 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:13:55.189 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:55.987 INFO:teuthology.orchestra.run.smithi078.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T19:13:56.006 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/679 2023-06-09T19:13:56.006 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/679 2023-06-09T19:13:56.007 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:13:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:56.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:13:56.106 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-06-09T19:13:56.765 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:13:56.780 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:13:56.782 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:13:56.785 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:13:56.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:58.199 INFO:teuthology.orchestra.run.smithi078.stdout:generic/680 1s 2023-06-09T19:13:58.221 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/680 2023-06-09T19:13:58.222 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:13:58.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:13:58.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:13:58.501 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-06-09T19:13:59.121 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T19:13:59.115+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44281) UID: 0 2023-06-09T19:13:59.122 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T19:13:59.115+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44281) UID: 0 2023-06-09T19:13:59.122 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T19:13:59.115+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44281) UID: 0 2023-06-09T19:13:59.122 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T19:13:59.115+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44281) UID: 0 2023-06-09T19:13:59.248 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:13:59.266 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:13:59.267 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:13:59.271 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:13:59.271 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:00.065 INFO:teuthology.orchestra.run.smithi078.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T19:14:00.078 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/681 2023-06-09T19:14:00.078 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/681 2023-06-09T19:14:00.078 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:00.087 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:00.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:00.178 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-06-09T19:14:00.789 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:00.804 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:00.806 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:00.809 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:00.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:01.595 INFO:teuthology.orchestra.run.smithi078.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T19:14:01.608 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/682 2023-06-09T19:14:01.609 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/682 2023-06-09T19:14:01.609 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:01.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:01.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:01.698 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-06-09T19:14:02.310 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:02.323 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:02.325 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:02.329 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:02.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:03.312 INFO:teuthology.orchestra.run.smithi078.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T19:14:03.326 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/683 2023-06-09T19:14:03.326 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/683 2023-06-09T19:14:03.326 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:03.336 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:03.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:03.427 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-06-09T19:14:04.052 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:04.067 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:04.069 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:04.073 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:04.073 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:09.532 INFO:teuthology.orchestra.run.smithi078.stdout:generic/684 5s 2023-06-09T19:14:09.554 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/684 2023-06-09T19:14:09.554 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:09.562 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:09.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:09.892 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-06-09T19:14:10.669 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:10.689 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:10.690 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:10.694 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:10.694 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:11.791 INFO:teuthology.orchestra.run.smithi078.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T19:14:11.805 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/685 2023-06-09T19:14:11.806 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/685 2023-06-09T19:14:11.806 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:11.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:11.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:11.919 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-06-09T19:14:12.565 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:12.582 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:12.583 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:12.587 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:12.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:13.705 INFO:teuthology.orchestra.run.smithi078.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-06-09T19:14:13.719 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/686 2023-06-09T19:14:13.720 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/686 2023-06-09T19:14:13.720 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:13.731 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:13.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:13.850 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-06-09T19:14:14.437 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:14.453 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:14.455 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:14.459 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:14.459 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:15.578 INFO:teuthology.orchestra.run.smithi078.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T19:14:15.594 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/687 2023-06-09T19:14:15.595 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/687 2023-06-09T19:14:15.595 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:15.605 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:15.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:15.686 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-06-09T19:14:16.306 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:16.321 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:16.323 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:16.327 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:16.327 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:17.228 INFO:teuthology.orchestra.run.smithi078.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T19:14:17.244 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/688 2023-06-09T19:14:17.244 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/688 2023-06-09T19:14:17.244 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:17.254 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:17.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:17.352 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-06-09T19:14:17.970 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:17.989 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:17.991 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:17.995 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:17.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:18.773 INFO:teuthology.orchestra.run.smithi078.stdout:generic/689 [not run] vfstest not support by ceph 2023-06-09T19:14:18.788 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/689 2023-06-09T19:14:18.788 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/689 2023-06-09T19:14:18.788 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:18.798 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:18.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:18.876 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-06-09T19:14:19.505 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:19.520 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:19.522 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:19.526 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:19.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:20.413 INFO:teuthology.orchestra.run.smithi078.stdout:generic/690 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T19:14:20.432 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/690 2023-06-09T19:14:20.433 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/690 2023-06-09T19:14:20.433 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:20.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:20.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:20.539 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-06-09T19:14:21.160 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:21.174 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:21.177 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:21.181 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:21.181 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:21.965 INFO:teuthology.orchestra.run.smithi078.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T19:14:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/691 2023-06-09T19:14:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/691 2023-06-09T19:14:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:21.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:22.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:22.076 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-06-09T19:14:22.701 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:22.719 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:22.720 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:22.724 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:22.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:23.563 INFO:teuthology.orchestra.run.smithi078.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-06-09T19:14:23.577 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/692 2023-06-09T19:14:23.577 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/692 2023-06-09T19:14:23.577 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:23.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:23.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:23.668 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-06-09T19:14:24.296 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:24.313 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:24.316 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:24.321 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:24.321 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:25.783 INFO:teuthology.orchestra.run.smithi078.stdout:generic/693 [not run] encryption policy '-c 1 -n 10 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2023-06-09T19:14:25.877 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/693 2023-06-09T19:14:25.878 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/693 2023-06-09T19:14:25.878 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:25.886 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:25.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:25.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-06-09T19:14:26.580 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:26.595 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:26.597 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:26.599 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:26.600 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:44.549 INFO:teuthology.orchestra.run.smithi078.stdout:generic/694 18s 2023-06-09T19:14:44.574 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/694 2023-06-09T19:14:44.574 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:44.583 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:44.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:44.678 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-06-09T19:14:45.294 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:45.309 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:45.311 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:45.315 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:45.316 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:46.135 INFO:teuthology.orchestra.run.smithi078.stdout:generic/695 [not run] require 172.21.15.78:6789:/scratch to be valid block disk 2023-06-09T19:14:46.152 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/695 2023-06-09T19:14:46.153 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/695 2023-06-09T19:14:46.153 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:46.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:46.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:46.248 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-06-09T19:14:46.873 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:46.888 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:46.890 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:46.894 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:46.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:48.129 INFO:teuthology.orchestra.run.smithi078.stdout:generic/696 1s 2023-06-09T19:14:48.157 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/696 2023-06-09T19:14:48.158 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:48.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:48.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:48.251 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-06-09T19:14:48.865 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:48.882 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:48.884 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:48.889 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:48.889 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:49.784 INFO:teuthology.orchestra.run.smithi078.stdout:generic/697 0s 2023-06-09T19:14:49.808 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/697 2023-06-09T19:14:49.808 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:49.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:49.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:49.925 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-06-09T19:14:50.552 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:50.570 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:50.573 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:50.578 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:50.578 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:51.438 INFO:teuthology.orchestra.run.smithi078.stdout:generic/698 [not run] vfstest not support by ceph 2023-06-09T19:14:51.451 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/698 2023-06-09T19:14:51.452 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/698 2023-06-09T19:14:51.452 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:51.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:51.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:51.575 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-06-09T19:14:52.214 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:52.234 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:52.237 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:52.241 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:52.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:53.159 INFO:teuthology.orchestra.run.smithi078.stdout:generic/699 [not run] vfstest not support by ceph 2023-06-09T19:14:53.175 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/699 2023-06-09T19:14:53.176 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/699 2023-06-09T19:14:53.176 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:53.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:53.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:53.287 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-06-09T19:14:53.877 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:53.895 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:53.897 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:53.899 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:53.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:54.796 INFO:teuthology.orchestra.run.smithi078.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-06-09T19:14:54.812 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/700 2023-06-09T19:14:54.812 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/700 2023-06-09T19:14:54.812 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:14:54.822 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:14:55.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:14:55.162 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-06-09T19:14:55.901 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:14:55.919 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:14:55.921 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:14:55.925 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:14:55.925 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:13.849 INFO:teuthology.orchestra.run.smithi078.stdout:generic/701 17s 2023-06-09T19:15:13.873 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/701 2023-06-09T19:15:13.873 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:15:13.882 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:16.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:15:16.994 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-06-09T19:15:17.935 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:15:17.952 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:15:17.953 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:15:17.957 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:15:17.958 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:19.396 INFO:teuthology.orchestra.run.smithi078.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T19:15:19.472 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/702 2023-06-09T19:15:19.472 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/702 2023-06-09T19:15:19.472 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:15:19.494 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:19.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:15:19.669 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-06-09T19:15:20.288 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:15:20.304 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:15:20.306 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:15:20.310 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:15:20.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:21.227 INFO:teuthology.orchestra.run.smithi078.stdout:generic/703 [not run] kernel does not support IO_URING 2023-06-09T19:15:21.240 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/703 2023-06-09T19:15:21.241 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/703 2023-06-09T19:15:21.241 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:15:21.251 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:21.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:15:21.347 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-06-09T19:15:21.989 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:15:22.007 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:15:22.008 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:15:22.012 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:15:22.012 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:22.928 INFO:teuthology.orchestra.run.smithi078.stdout:generic/704 [not run] require 172.21.15.78:6789:/test to be valid block disk 2023-06-09T19:15:22.945 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/704 2023-06-09T19:15:22.945 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/704 2023-06-09T19:15:22.945 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:15:22.955 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:23.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:15:23.036 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-06-09T19:15:23.662 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:15:23.676 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:15:23.677 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:15:23.681 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:15:23.681 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:24.876 INFO:teuthology.orchestra.run.smithi078.stdout:generic/705 [not run] ceph does not support shutdown 2023-06-09T19:15:24.944 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/705 2023-06-09T19:15:24.945 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/705 2023-06-09T19:15:24.945 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:15:24.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:25.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:15:25.045 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-06-09T19:15:25.653 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:15:25.669 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:15:25.671 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:15:25.674 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:15:25.674 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:28.387 INFO:teuthology.orchestra.run.smithi078.stdout:generic/706 2s 2023-06-09T19:15:28.412 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/706 2023-06-09T19:15:28.413 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T19:15:28.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:15:28.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T19:15:28.756 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-06-09T19:15:29.403 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T19:15:29.419 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T19:15:29.420 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T19:15:29.424 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T19:15:29.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T19:21:35.291 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:21:35.298 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:21:35.344 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T19:21:35.338+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 609126) UID: 0 2023-06-09T19:21:35.344 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T19:21:35.338+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 609126) UID: 0 2023-06-09T19:21:35.345 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T19:21:35.338+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 609126) UID: 0 2023-06-09T19:21:35.345 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T19:21:35.338+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 609126) UID: 0 2023-06-09T19:21:35.511 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T19:21:35.508+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44306) UID: 0 2023-06-09T19:21:35.512 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T19:21:35.508+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44306) UID: 0 2023-06-09T19:30:30.901 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:30:30.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:31:01.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:31:01.152 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:31:31.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:31:31.226 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:32:01.286 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:32:01.291 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:32:31.365 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:32:31.369 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:33:01.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:33:01.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:33:31.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:33:31.510 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:34:01.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:34:01.578 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:34:31.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:34:31.658 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:35:01.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:35:01.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:35:31.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:35:31.797 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:36:02.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:36:02.947 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:36:33.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:36:33.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:37:03.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:37:03.123 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:37:33.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:37:33.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:38:03.476 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:38:03.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:38:34.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:38:34.391 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:39:04.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:39:04.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:39:34.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:39:34.550 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:40:04.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:40:04.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:40:34.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:40:34.746 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:41:05.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:41:05.866 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:41:06.171 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T19:41:06.169+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642034) UID: 0 2023-06-09T19:41:06.171 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T19:41:06.169+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642034) UID: 0 2023-06-09T19:41:06.173 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T19:41:06.169+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642034) UID: 0 2023-06-09T19:41:06.173 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T19:41:06.169+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642034) UID: 0 2023-06-09T19:44:16.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:44:16.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:44:46.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:44:46.897 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:45:18.309 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:45:18.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:45:48.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:45:48.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:45:48.516 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T19:45:48.511+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44414) UID: 0 2023-06-09T19:45:48.516 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T19:45:48.511+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44414) UID: 0 2023-06-09T19:45:48.517 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T19:45:48.511+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44414) UID: 0 2023-06-09T19:45:48.517 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T19:45:48.511+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44414) UID: 0 2023-06-09T19:49:20.622 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:49:20.627 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:49:20.671 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T19:49:20.665+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653494) UID: 0 2023-06-09T19:49:20.671 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T19:49:20.665+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653494) UID: 0 2023-06-09T19:49:20.672 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T19:49:20.665+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653494) UID: 0 2023-06-09T19:49:20.672 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T19:49:20.665+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653494) UID: 0 2023-06-09T19:52:41.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:52:41.640 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:52:41.685 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T19:52:41.681+0000 7f852cb5d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44432) UID: 0 2023-06-09T19:52:41.686 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-06-09T19:52:41.681+0000 7fabc5382700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44432) UID: 0 2023-06-09T19:55:38.688 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T19:55:38.682+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44442) UID: 0 2023-06-09T19:55:38.689 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T19:55:38.682+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44442) UID: 0 2023-06-09T19:55:38.689 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T19:55:38.682+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44442) UID: 0 2023-06-09T19:55:38.690 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T19:55:38.682+0000 7f87abf50700 -1 Fail to open '/proc/44442/cmdline' error = (2) No such file or directory 2023-06-09T19:55:38.690 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T19:55:38.682+0000 7f87abf50700 -1 received signal: Hangup from (PID: 44442) UID: 0 2023-06-09T19:59:25.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:59:25.272 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:59:55.342 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T19:59:55.349 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:00:26.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:00:26.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:00:56.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:00:56.376 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:01:26.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:01:26.508 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:01:56.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:01:56.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:01:56.680 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-09T20:01:56.673+0000 7f2ccb0b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671462) UID: 0 2023-06-09T20:01:56.680 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-09T20:01:56.673+0000 7f9d08780700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671462) UID: 0 2023-06-09T20:01:56.680 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-09T20:01:56.673+0000 7f904e1b2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671462) UID: 0 2023-06-09T20:01:56.681 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-09T20:01:56.673+0000 7f53f7409700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671462) UID: 0 2023-06-09T20:05:08.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:05:08.827 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:05:08.878 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-06-09T20:05:08.869+0000 7f2dd17e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44479) UID: 0 2023-06-09T20:05:08.879 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-06-09T20:05:08.869+0000 7f4a4484a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44479) UID: 0 2023-06-09T20:05:08.879 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-06-09T20:05:08.869+0000 7fbd0d438700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44479) UID: 0 2023-06-09T20:05:08.879 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-06-09T20:05:08.869+0000 7f87abf50700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44479) UID: 0 2023-06-09T20:08:40.817 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:08:40.823 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:09:10.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:09:10.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:09:41.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:09:41.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:10:11.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:10:11.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:10:42.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:10:42.101 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:11:12.166 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:11:12.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:11:42.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:11:42.855 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:12:12.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:12:12.923 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:12:43.313 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:12:43.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:13:13.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:13:13.412 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:13:44.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:13:44.022 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:14:14.166 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:14:14.170 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:14:44.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:14:44.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:15:14.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:15:14.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:15:44.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:15:44.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:16:15.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:16:15.097 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:16:45.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:16:45.167 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:17:15.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:17:15.670 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:17:45.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:17:45.735 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:18:15.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:18:15.812 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:18:20.720 INFO:teuthology.orchestra.run.smithi078.stdout:generic/707 3771s 2023-06-09T20:18:20.811 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/707 2023-06-09T20:18:20.811 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:20.822 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:20.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:20.853 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-06-09T20:18:21.954 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:21.970 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:21.971 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:21.975 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:21.975 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:25.657 INFO:teuthology.orchestra.run.smithi078.stdout:generic/708 1s 2023-06-09T20:18:25.682 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/708 2023-06-09T20:18:25.683 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:25.693 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:25.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:25.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-06-09T20:18:26.750 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:26.773 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:26.776 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:26.779 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:26.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:27.655 INFO:teuthology.orchestra.run.smithi078.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:27.674 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/709 2023-06-09T20:18:27.674 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/709 2023-06-09T20:18:27.674 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:27.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:27.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:27.940 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-06-09T20:18:28.789 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:28.806 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:28.808 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:28.811 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:28.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:29.658 INFO:teuthology.orchestra.run.smithi078.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:29.672 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/710 2023-06-09T20:18:29.673 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/710 2023-06-09T20:18:29.673 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:29.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:29.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:29.925 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-06-09T20:18:30.789 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:30.807 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:30.809 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:30.813 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:30.813 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:31.664 INFO:teuthology.orchestra.run.smithi078.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:31.678 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/711 2023-06-09T20:18:31.678 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/711 2023-06-09T20:18:31.678 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:31.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:31.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:31.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-06-09T20:18:32.722 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:32.740 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:32.741 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:32.745 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:32.746 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:33.607 INFO:teuthology.orchestra.run.smithi078.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:33.630 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/712 2023-06-09T20:18:33.630 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/712 2023-06-09T20:18:33.630 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:33.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:33.962 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-06-09T20:18:34.740 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:34.756 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:34.757 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:34.761 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:34.762 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:35.626 INFO:teuthology.orchestra.run.smithi078.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-06-09T20:18:35.641 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/713 2023-06-09T20:18:35.641 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/713 2023-06-09T20:18:35.641 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:35.651 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:36.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:36.026 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-06-09T20:18:36.752 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:36.768 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:36.771 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:36.774 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:36.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:37.652 INFO:teuthology.orchestra.run.smithi078.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:37.665 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/714 2023-06-09T20:18:37.666 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/714 2023-06-09T20:18:37.666 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:37.674 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:38.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:38.160 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-06-09T20:18:38.917 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:38.938 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:38.940 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:38.944 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:38.945 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:39.801 INFO:teuthology.orchestra.run.smithi078.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-06-09T20:18:39.816 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/715 2023-06-09T20:18:39.816 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/715 2023-06-09T20:18:39.816 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:39.827 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:40.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:40.100 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-06-09T20:18:40.891 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:40.906 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:40.908 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:40.915 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:40.915 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:41.775 INFO:teuthology.orchestra.run.smithi078.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:41.790 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/716 2023-06-09T20:18:41.791 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/716 2023-06-09T20:18:41.791 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:41.802 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:42.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:42.188 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-06-09T20:18:42.881 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:42.901 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:42.902 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:42.908 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:42.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:43.784 INFO:teuthology.orchestra.run.smithi078.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:43.798 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/717 2023-06-09T20:18:43.798 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/717 2023-06-09T20:18:43.798 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:43.808 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:44.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:44.222 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-06-09T20:18:44.885 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:44.901 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:44.903 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:44.906 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:44.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:45.793 INFO:teuthology.orchestra.run.smithi078.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:45.810 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/718 2023-06-09T20:18:45.810 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/718 2023-06-09T20:18:45.810 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:45.821 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:45.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:18:45.898 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:18:46.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:46.027 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-06-09T20:18:46.861 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:46.876 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:46.878 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:46.882 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:46.882 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:47.744 INFO:teuthology.orchestra.run.smithi078.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:47.757 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/719 2023-06-09T20:18:47.757 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/719 2023-06-09T20:18:47.757 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:47.776 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:48.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:48.051 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-06-09T20:18:48.878 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:48.898 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:48.900 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:48.903 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:48.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:49.760 INFO:teuthology.orchestra.run.smithi078.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:49.777 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/720 2023-06-09T20:18:49.778 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/720 2023-06-09T20:18:49.778 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:49.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:50.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:50.140 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-06-09T20:18:50.886 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:50.901 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:50.903 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:50.909 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:50.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:51.723 INFO:teuthology.orchestra.run.smithi078.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-06-09T20:18:51.739 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/721 2023-06-09T20:18:51.739 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/721 2023-06-09T20:18:51.739 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:51.749 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:51.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:51.852 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-06-09T20:18:52.485 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:52.504 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:52.506 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:52.511 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:52.511 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:53.429 INFO:teuthology.orchestra.run.smithi078.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-06-09T20:18:53.445 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/722 2023-06-09T20:18:53.445 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/722 2023-06-09T20:18:53.446 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:53.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:53.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:53.796 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-06-09T20:18:54.526 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:54.542 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:54.545 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:54.549 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:54.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:55.405 INFO:teuthology.orchestra.run.smithi078.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph 2023-06-09T20:18:55.422 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/723 2023-06-09T20:18:55.423 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/723 2023-06-09T20:18:55.423 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:55.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:55.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:55.721 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-06-09T20:18:56.503 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:56.520 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:56.522 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:56.525 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:56.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:57.393 INFO:teuthology.orchestra.run.smithi078.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-06-09T20:18:57.410 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/724 2023-06-09T20:18:57.410 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/724 2023-06-09T20:18:57.411 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:57.420 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:57.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:57.768 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-06-09T20:18:58.466 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:18:58.481 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:18:58.484 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:18:58.488 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:18:58.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:59.342 INFO:teuthology.orchestra.run.smithi078.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-06-09T20:18:59.360 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/725 2023-06-09T20:18:59.360 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/725 2023-06-09T20:18:59.360 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:18:59.373 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:18:59.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:18:59.691 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-06-09T20:19:00.409 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:19:00.422 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:19:00.424 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:19:00.428 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:19:00.428 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:01.852 INFO:teuthology.orchestra.run.smithi078.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-06-09T20:19:01.867 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/726 2023-06-09T20:19:01.867 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/726 2023-06-09T20:19:01.868 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:19:01.878 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:02.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:19:02.188 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.bWnQzKjaCzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-06-09T20:19:02.978 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph 2023-06-09T20:19:03.002 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T20:19:03.004 INFO:teuthology.orchestra.run.smithi078.stdout:MKFS_OPTIONS -- 172.21.15.78:6789:/scratch 2023-06-09T20:19:03.008 INFO:teuthology.orchestra.run.smithi078.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDBCINk8Xb6OhAAbfNx2wH4ugKNgKVZcsOU0g== 172.21.15.78:6789:/scratch /tmp/tmp.cKkqOgfa4gscratch 2023-06-09T20:19:03.008 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:04.007 INFO:teuthology.orchestra.run.smithi078.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-06-09T20:19:04.022 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/727 2023-06-09T20:19:04.022 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/727 2023-06-09T20:19:04.022 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-06-09T20:19:04.033 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:04.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T20:19:04.353 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 1========================================================= 2023-06-09T20:19:04.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo userdel --force --remove fsgqa 2023-06-09T20:19:05.099 INFO:teuthology.orchestra.run.smithi078.stderr:userdel: user fsgqa is currently used by process 708715 2023-06-09T20:19:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-06-09T20:19:05.569 DEBUG:teuthology.orchestra.run.smithi078:> sudo userdel --force --remove 123456-fsgqa 2023-06-09T20:19:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-06-09T20:19:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-06-09T20:19:06.025 DEBUG:teuthology.orchestra.run.smithi078:> sudo groupdel fsgqa 2023-06-09T20:19:06.059 INFO:teuthology.orchestra.run.smithi078.stderr:groupdel: group 'fsgqa' does not exist 2023-06-09T20:19:06.062 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-06-09T20:19:06.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:06.063 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.bWnQzKjaCzxfstests-dev/results) 2023-06-09T20:19:06.180 INFO:teuthology.orchestra.run.smithi078.stdout: File: /tmp/tmp.bWnQzKjaCzxfstests-dev/results 2023-06-09T20:19:06.180 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-06-09T20:19:06.180 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 801h/2049d Inode: 1208468 Links: 3 2023-06-09T20:19:06.180 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T20:19:06.180 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-09 11:16:25.247020188 +0000 2023-06-09T20:19:06.180 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-09 20:18:25.670808865 +0000 2023-06-09T20:19:06.181 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-09 20:18:25.670808865 +0000 2023-06-09T20:19:06.181 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-09T20:19:06.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:06.181 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-06-09T20:19:06.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:06.216 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.bWnQzKjaCzxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-06-09T20:19:06.922 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.bWnQzKjaCzxfstests-dev to /var/log/ceph. 2023-06-09T20:19:06.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf /tmp/tmp.bWnQzKjaCzxfstests-dev 2023-06-09T20:19:07.387 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-09T20:19:07.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T20:19:07.555 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T20:19:07.659 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-09T20:19:07.659 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T20:19:07.660 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:07.678 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T20:19:07.679 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:07.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T20:19:08.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd0517ff700 1 Processor -- start 2023-06-09T20:19:08.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd0517ff700 1 -- start start 2023-06-09T20:19:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd0517ff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0480e0560 0x7fd04800c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd0517ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 0x7fd048039df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd0517ff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd048038a20 con 0x7fd04800c9f0 2023-06-09T20:19:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd043fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd04800c9f0 0x7fd048052d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56068/0 (socket says 172.21.15.78:56068) 2023-06-09T20:19:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd053262700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0480e0560 0x7fd04800c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.558+0000 7fd043fff700 1 -- 172.21.15.78:0/824077551 learned_addr learned my addr 172.21.15.78:0/824077551 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 -- 172.21.15.78:0/824077551 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04800ce40 con 0x7fd0480e0560 2023-06-09T20:19:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 -- 172.21.15.78:0/824077551 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480395a0 con 0x7fd048053450 2023-06-09T20:19:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd053262700 1 -- 172.21.15.78:0/824077551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 msgr2=0x7fd048039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd053262700 1 --2- 172.21.15.78:0/824077551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 0x7fd048039df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd053262700 1 -- 172.21.15.78:0/824077551 >> v1:172.21.15.78:6789/0 conn(0x7fd04800c9f0 legacy=0x7fd048052d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:08.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd053262700 1 -- 172.21.15.78:0/824077551 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0480e0930 con 0x7fd0480e0560 2023-06-09T20:19:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd053262700 1 --2- 172.21.15.78:0/824077551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0480e0560 0x7fd04800c4b0 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 crypto rx=0x7fd04400a840 tx=0x7fd04400ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cedd668719db6a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0437fe700 1 -- 172.21.15.78:0/824077551 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400c670 con 0x7fd0480e0560 2023-06-09T20:19:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0437fe700 1 -- 172.21.15.78:0/824077551 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04400c7d0 con 0x7fd0480e0560 2023-06-09T20:19:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0437fe700 1 -- 172.21.15.78:0/824077551 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400cb80 con 0x7fd0480e0560 2023-06-09T20:19:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 -- 172.21.15.78:0/824077551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0480e0560 msgr2=0x7fd04800c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 --2- 172.21.15.78:0/824077551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0480e0560 0x7fd04800c4b0 secure :-1 s=READY pgs=3215 cs=0 l=1 rev1=1 crypto rx=0x7fd04400a840 tx=0x7fd04400ab50 comp rx=0 tx=0).stop 2023-06-09T20:19:08.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 -- 172.21.15.78:0/824077551 shutdown_connections 2023-06-09T20:19:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 --2- 172.21.15.78:0/824077551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 0x7fd048039df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 --2- 172.21.15.78:0/824077551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0480e0560 0x7fd04800c4b0 unknown :-1 s=CLOSED pgs=3215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 -- 172.21.15.78:0/824077551 >> 172.21.15.78:0/824077551 conn(0x7fd048056fa0 msgr2=0x7fd0480573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 -- 172.21.15.78:0/824077551 shutdown_connections 2023-06-09T20:19:08.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.562+0000 7fd0517ff700 1 -- 172.21.15.78:0/824077551 wait complete. 2023-06-09T20:19:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 Processor -- start 2023-06-09T20:19:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 -- start start 2023-06-09T20:19:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04800c9f0 0x7fd04804dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 0x7fd04804b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:08.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0480e0560 0x7fd0480e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:08.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04804f2d0 con 0x7fd04800c9f0 2023-06-09T20:19:08.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04804e650 con 0x7fd0480e0560 2023-06-09T20:19:08.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd0517ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04804e930 con 0x7fd048053450 2023-06-09T20:19:08.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd052000700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0480e0560 0x7fd0480e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:08.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd052000700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0480e0560 0x7fd0480e1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50638/0 (socket says 172.21.15.78:50638) 2023-06-09T20:19:08.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd052000700 1 -- 172.21.15.78:0/2723325877 learned_addr learned my addr 172.21.15.78:0/2723325877 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:08.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.570+0000 7fd053262700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04800c9f0 0x7fd04804dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:08.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.574+0000 7fd043fff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 0x7fd04804b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:08.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd053262700 1 -- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 msgr2=0x7fd04804b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:08.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd053262700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 0x7fd04804b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd053262700 1 -- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0480e0560 msgr2=0x7fd0480e1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd053262700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0480e0560 0x7fd0480e1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:08.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd053262700 1 -- 172.21.15.78:0/2723325877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04400d040 con 0x7fd04800c9f0 2023-06-09T20:19:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd053262700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04800c9f0 0x7fd04804dfe0 secure :-1 s=READY pgs=3216 cs=0 l=1 rev1=1 crypto rx=0x7fd044016000 tx=0x7fd044001fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd0417fa700 1 -- 172.21.15.78:0/2723325877 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04401fb10 con 0x7fd04800c9f0 2023-06-09T20:19:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd0417fa700 1 -- 172.21.15.78:0/2723325877 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044023070 con 0x7fd04800c9f0 2023-06-09T20:19:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd0417fa700 1 -- 172.21.15.78:0/2723325877 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044012660 con 0x7fd04800c9f0 2023-06-09T20:19:08.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.578+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd048038f50 con 0x7fd04800c9f0 2023-06-09T20:19:08.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.582+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd048038c70 con 0x7fd04800c9f0 2023-06-09T20:19:08.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.582+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd048039230 con 0x7fd04800c9f0 2023-06-09T20:19:08.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.626+0000 7fd0417fa700 1 -- 172.21.15.78:0/2723325877 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0440127c0 con 0x7fd04800c9f0 2023-06-09T20:19:08.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.626+0000 7fd0417fa700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd038066320 0x7fd0380687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:08.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.626+0000 7fd043fff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd038066320 0x7fd0380687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:08.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.630+0000 7fd043fff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd038066320 0x7fd0380687d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd0480df110 tx=0x7fd03c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:08.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.646+0000 7fd0417fa700 1 -- 172.21.15.78:0/2723325877 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd044025070 con 0x7fd04800c9f0 2023-06-09T20:19:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:08.846+0000 7fd0417fa700 1 -- 172.21.15.78:0/2723325877 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd044057130 con 0x7fd04800c9f0 2023-06-09T20:19:09.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.106+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0480055d0 con 0x7fd04800c9f0 2023-06-09T20:19:09.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.190+0000 7fd0417fa700 1 -- 172.21.15.78:0/2723325877 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18308 (secure 0 0 0) 0x7fd044015020 con 0x7fd04800c9f0 2023-06-09T20:19:09.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:09.197 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:50.349113+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:13:10.180078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T11:13:11.109063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.19","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T20:19:09.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd038066320 msgr2=0x7fd0380687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd038066320 0x7fd0380687d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd0480df110 tx=0x7fd03c009040 comp rx=0 tx=0).stop 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04800c9f0 msgr2=0x7fd04804dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04800c9f0 0x7fd04804dfe0 secure :-1 s=READY pgs=3216 cs=0 l=1 rev1=1 crypto rx=0x7fd044016000 tx=0x7fd044001fd0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 shutdown_connections 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd038066320 0x7fd0380687d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0480e0560 0x7fd0480e1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd048053450 0x7fd04804b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 --2- 172.21.15.78:0/2723325877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd04800c9f0 0x7fd04804dfe0 secure :-1 s=CLOSED pgs=3216 cs=0 l=1 rev1=1 crypto rx=0x7fd044016000 tx=0x7fd044001fd0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 >> 172.21.15.78:0/2723325877 conn(0x7fd048056fa0 msgr2=0x7fd0480df820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:09.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 shutdown_connections 2023-06-09T20:19:09.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.194+0000 7fd0517ff700 1 -- 172.21.15.78:0/2723325877 wait complete. 2023-06-09T20:19:09.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:13:10.180078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:13:11.109063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T20:19:09.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T20:19:09.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.430+0000 7fb87602f700 1 Processor -- start 2023-06-09T20:19:09.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.430+0000 7fb87602f700 1 -- start start 2023-06-09T20:19:09.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.430+0000 7fb87602f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb87015a160 0x7fb87015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87006d730 con 0x7fb870070890 2023-06-09T20:19:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87015a530 con 0x7fb87015a160 2023-06-09T20:19:09.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015d180 con 0x7fb8700d26d0 2023-06-09T20:19:09.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb87015a160 0x7fb87015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb87015a160 0x7fb87015cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46578/0 (socket says 172.21.15.78:46578) 2023-06-09T20:19:09.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 -- 172.21.15.78:0/1677659981 learned_addr learned my addr 172.21.15.78:0/1677659981 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:09.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87482c700 1 --2- 172.21.15.78:0/1677659981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 -- 172.21.15.78:0/1677659981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 msgr2=0x7fb8700d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 --2- 172.21.15.78:0/1677659981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 -- 172.21.15.78:0/1677659981 >> v1:172.21.15.187:6789/0 conn(0x7fb870070890 legacy=0x7fb87006dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 -- 172.21.15.78:0/1677659981 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87015d460 con 0x7fb87015a160 2023-06-09T20:19:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87502d700 1 --2- 172.21.15.78:0/1677659981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87015a160 0x7fb87015cb30 secure :-1 s=READY pgs=3217 cs=0 l=1 rev1=1 crypto rx=0x7fb868009910 tx=0x7fb868009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca80202619ba11c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb86ffff700 1 -- 172.21.15.78:0/1677659981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868011830 con 0x7fb87015a160 2023-06-09T20:19:09.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb86ffff700 1 -- 172.21.15.78:0/1677659981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868011990 con 0x7fb87015a160 2023-06-09T20:19:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb86ffff700 1 -- 172.21.15.78:0/1677659981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868011d00 con 0x7fb87015a160 2023-06-09T20:19:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 -- 172.21.15.78:0/1677659981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87015a160 msgr2=0x7fb87015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 --2- 172.21.15.78:0/1677659981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87015a160 0x7fb87015cb30 secure :-1 s=READY pgs=3217 cs=0 l=1 rev1=1 crypto rx=0x7fb868009910 tx=0x7fb868009c20 comp rx=0 tx=0).stop 2023-06-09T20:19:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 -- 172.21.15.78:0/1677659981 shutdown_connections 2023-06-09T20:19:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 --2- 172.21.15.78:0/1677659981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 --2- 172.21.15.78:0/1677659981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87015a160 0x7fb87015cb30 unknown :-1 s=CLOSED pgs=3217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.434+0000 7fb87602f700 1 -- 172.21.15.78:0/1677659981 >> 172.21.15.78:0/1677659981 conn(0x7fb8700cf930 msgr2=0x7fb8700cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.438+0000 7fb87602f700 1 -- 172.21.15.78:0/1677659981 shutdown_connections 2023-06-09T20:19:09.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.438+0000 7fb87602f700 1 -- 172.21.15.78:0/1677659981 wait complete. 2023-06-09T20:19:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.438+0000 7fb87602f700 1 Processor -- start 2023-06-09T20:19:09.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.438+0000 7fb87602f700 1 -- start start 2023-06-09T20:19:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87602f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb870070890 0x7fb8701fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87602f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87602f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb87015a160 0x7fb87014a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87602f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870157910 con 0x7fb870070890 2023-06-09T20:19:09.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87602f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87014df70 con 0x7fb87015a160 2023-06-09T20:19:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87602f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8701fa910 con 0x7fb8700d26d0 2023-06-09T20:19:09.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87502d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb870070890 0x7fb8701fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87582e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb87015a160 0x7fb87014a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87482c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87582e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb87015a160 0x7fb87014a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50650/0 (socket says 172.21.15.78:50650) 2023-06-09T20:19:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87582e700 1 -- 172.21.15.78:0/4221969350 learned_addr learned my addr 172.21.15.78:0/4221969350 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87502d700 1 -- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 msgr2=0x7fb8700b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87502d700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87502d700 1 -- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb87015a160 msgr2=0x7fb87014a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87502d700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb87015a160 0x7fb87014a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87502d700 1 -- 172.21.15.78:0/4221969350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868009570 con 0x7fb870070890 2023-06-09T20:19:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb87502d700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb870070890 0x7fb8701fa3d0 secure :-1 s=READY pgs=3218 cs=0 l=1 rev1=1 crypto rx=0x7fb868016000 tx=0x7fb868004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb86dffb700 1 -- 172.21.15.78:0/4221969350 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86800b860 con 0x7fb870070890 2023-06-09T20:19:09.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb86dffb700 1 -- 172.21.15.78:0/4221969350 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86801f070 con 0x7fb870070890 2023-06-09T20:19:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.442+0000 7fb86dffb700 1 -- 172.21.15.78:0/4221969350 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86800bbc0 con 0x7fb870070890 2023-06-09T20:19:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.446+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87015da20 con 0x7fb870070890 2023-06-09T20:19:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.446+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87015d740 con 0x7fb870070890 2023-06-09T20:19:09.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.450+0000 7fb86dffb700 1 -- 172.21.15.78:0/4221969350 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb868021030 con 0x7fb870070890 2023-06-09T20:19:09.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.450+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8700d0fc0 con 0x7fb870070890 2023-06-09T20:19:09.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.450+0000 7fb86dffb700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb85c066340 0x7fb85c0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.450+0000 7fb86dffb700 1 -- 172.21.15.78:0/4221969350 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fb8680859c0 con 0x7fb870070890 2023-06-09T20:19:09.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.450+0000 7fb87482c700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb85c066340 0x7fb85c0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.450+0000 7fb87482c700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb85c066340 0x7fb85c0687f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb870158060 tx=0x7fb86000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:09.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.458+0000 7fb86dffb700 1 -- 172.21.15.78:0/4221969350 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb868052640 con 0x7fb870070890 2023-06-09T20:19:09.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.690+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb870066f00 con 0x7fb870070890 2023-06-09T20:19:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.706+0000 7fb86dffb700 1 -- 172.21.15.78:0/4221969350 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb868055c60 con 0x7fb870070890 2023-06-09T20:19:09.712 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T20:19:09.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb85c066340 msgr2=0x7fb85c0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb85c066340 0x7fb85c0687f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb870158060 tx=0x7fb86000b040 comp rx=0 tx=0).stop 2023-06-09T20:19:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb870070890 msgr2=0x7fb8701fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb870070890 0x7fb8701fa3d0 secure :-1 s=READY pgs=3218 cs=0 l=1 rev1=1 crypto rx=0x7fb868016000 tx=0x7fb868004770 comp rx=0 tx=0).stop 2023-06-09T20:19:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 shutdown_connections 2023-06-09T20:19:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb85c066340 0x7fb85c0687f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb87015a160 0x7fb87014a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8700d26d0 0x7fb8700b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 --2- 172.21.15.78:0/4221969350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb870070890 0x7fb8701fa3d0 unknown :-1 s=CLOSED pgs=3218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 >> 172.21.15.78:0/4221969350 conn(0x7fb8700cf930 msgr2=0x7fb8701600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 shutdown_connections 2023-06-09T20:19:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.710+0000 7fb87602f700 1 -- 172.21.15.78:0/4221969350 wait complete. 2023-06-09T20:19:09.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T20:19:09.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.946+0000 7f88f5866700 1 Processor -- start 2023-06-09T20:19:09.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5866700 1 -- start start 2023-06-09T20:19:09.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5866700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f88f01600b0 0x7f88f006b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5866700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88f0070890 0x7f88f0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:09.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5866700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f0143970 con 0x7f88f0142a50 2023-06-09T20:19:09.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5866700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f006bb80 con 0x7f88f01600b0 2023-06-09T20:19:09.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5866700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f00b5f50 con 0x7f88f0070890 2023-06-09T20:19:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88effff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f88f01600b0 0x7f88f006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88f0070890 0x7f88f0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88f0070890 0x7f88f0070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50664/0 (socket says 172.21.15.78:50664) 2023-06-09T20:19:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 -- 172.21.15.78:0/3060583780 learned_addr learned my addr 172.21.15.78:0/3060583780 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 -- 172.21.15.78:0/3060583780 >> v2:172.21.15.78:3300/0 conn(0x7f88f01600b0 msgr2=0x7f88f006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:09.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 --2- 172.21.15.78:0/3060583780 >> v2:172.21.15.78:3300/0 conn(0x7f88f01600b0 0x7f88f006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:09.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 -- 172.21.15.78:0/3060583780 >> v1:172.21.15.187:6789/0 conn(0x7f88f0142a50 legacy=0x7f88f0143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:09.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 -- 172.21.15.78:0/3060583780 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0160650 con 0x7f88f0070890 2023-06-09T20:19:09.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88f5065700 1 --2- 172.21.15.78:0/3060583780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f0070d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f88f00b5ec0 tx=0x7f88e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09ad8b649aaca99 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:09.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.950+0000 7f88ef7fe700 1 -- 172.21.15.78:0/3060583780 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800e070 con 0x7f88f0070890 2023-06-09T20:19:09.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88ef7fe700 1 -- 172.21.15.78:0/3060583780 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8003a40 con 0x7f88f0070890 2023-06-09T20:19:10.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88ef7fe700 1 -- 172.21.15.78:0/3060583780 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8003df0 con 0x7f88f0070890 2023-06-09T20:19:10.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 -- 172.21.15.78:0/3060583780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 msgr2=0x7f88f0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 --2- 172.21.15.78:0/3060583780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f0070d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f88f00b5ec0 tx=0x7f88e800b330 comp rx=0 tx=0).stop 2023-06-09T20:19:10.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 -- 172.21.15.78:0/3060583780 shutdown_connections 2023-06-09T20:19:10.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 --2- 172.21.15.78:0/3060583780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f0070d10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 --2- 172.21.15.78:0/3060583780 >> v2:172.21.15.78:3300/0 conn(0x7f88f01600b0 0x7f88f006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 -- 172.21.15.78:0/3060583780 >> 172.21.15.78:0/3060583780 conn(0x7f88f00d2e10 msgr2=0x7f88f00d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:10.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 -- 172.21.15.78:0/3060583780 shutdown_connections 2023-06-09T20:19:10.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.994+0000 7f88f5866700 1 -- 172.21.15.78:0/3060583780 wait complete. 2023-06-09T20:19:10.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 Processor -- start 2023-06-09T20:19:10.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 -- start start 2023-06-09T20:19:10.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f01f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f0142a50 0x7f88f0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88f01600b0 0x7f88f00d1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f015a440 con 0x7f88f01600b0 2023-06-09T20:19:10.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01f1db0 con 0x7f88f0070890 2023-06-09T20:19:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:09.998+0000 7f88f5866700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f015e9e0 con 0x7f88f0142a50 2023-06-09T20:19:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f01f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f01f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50666/0 (socket says 172.21.15.78:50666) 2023-06-09T20:19:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 -- 172.21.15.78:0/1317090771 learned_addr learned my addr 172.21.15.78:0/1317090771 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f5065700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88f01600b0 0x7f88f00d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88effff700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f0142a50 0x7f88f0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 -- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f0142a50 msgr2=0x7f88f0159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f0142a50 0x7f88f0159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 -- 172.21.15.78:0/1317090771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88f01600b0 msgr2=0x7f88f00d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88f01600b0 0x7f88f00d1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 -- 172.21.15.78:0/1317090771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009b30 con 0x7f88f0070890 2023-06-09T20:19:10.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f4864700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f01f3260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c4d0 tx=0x7f88e400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:10.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88ed7fa700 1 -- 172.21.15.78:0/1317090771 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40054e0 con 0x7f88f0070890 2023-06-09T20:19:10.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88ed7fa700 1 -- 172.21.15.78:0/1317090771 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e40036a0 con 0x7f88f0070890 2023-06-09T20:19:10.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88ed7fa700 1 -- 172.21.15.78:0/1317090771 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4003a50 con 0x7f88f0070890 2023-06-09T20:19:10.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f0160c10 con 0x7f88f0070890 2023-06-09T20:19:10.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f0160930 con 0x7f88f0070890 2023-06-09T20:19:10.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.002+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f0160ef0 con 0x7f88f0070890 2023-06-09T20:19:10.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.026+0000 7f88ed7fa700 1 -- 172.21.15.78:0/1317090771 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88e4003bb0 con 0x7f88f0070890 2023-06-09T20:19:10.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.026+0000 7f88ed7fa700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88d40662f0 0x7f88d40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.026+0000 7f88effff700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88d40662f0 0x7f88d40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.026+0000 7f88effff700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88d40662f0 0x7f88d40687a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f88f01f52c0 tx=0x7f88dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:10.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.030+0000 7f88ed7fa700 1 -- 172.21.15.78:0/1317090771 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f88e4058040 con 0x7f88f0070890 2023-06-09T20:19:10.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.234+0000 7f88ed7fa700 1 -- 172.21.15.78:0/1317090771 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f88e40503c0 con 0x7f88f0070890 2023-06-09T20:19:10.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.506+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88f0067610 con 0x7f88f0070890 2023-06-09T20:19:10.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.562+0000 7f88ed7fa700 1 -- 172.21.15.78:0/1317090771 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88e4017020 con 0x7f88f0070890 2023-06-09T20:19:10.569 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T20:19:10.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88d40662f0 msgr2=0x7f88d40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88d40662f0 0x7f88d40687a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f88f01f52c0 tx=0x7f88dc008040 comp rx=0 tx=0).stop 2023-06-09T20:19:10.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 msgr2=0x7f88f01f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f01f3260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c4d0 tx=0x7f88e400c7e0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 shutdown_connections 2023-06-09T20:19:10.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88d40662f0 0x7f88d40687a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88f01600b0 0x7f88f00d1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f0142a50 0x7f88f0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 --2- 172.21.15.78:0/1317090771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f0070890 0x7f88f01f3260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 >> 172.21.15.78:0/1317090771 conn(0x7f88f00d2e10 msgr2=0x7f88f00b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:10.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 shutdown_connections 2023-06-09T20:19:10.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.566+0000 7f88f5866700 1 -- 172.21.15.78:0/1317090771 wait complete. 2023-06-09T20:19:10.599 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T20:19:10.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffb59e700 1 Processor -- start 2023-06-09T20:19:10.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffb59e700 1 -- start start 2023-06-09T20:19:10.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffb59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ffc15cb30 0x7f8ffc0d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffb59e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8ffc070890 0x7f8ffc070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffb59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc06d730 con 0x7f8ffc15a160 2023-06-09T20:19:10.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffb59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc0711d0 con 0x7f8ffc15cb30 2023-06-09T20:19:10.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffb59e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc15a530 con 0x7f8ffc070890 2023-06-09T20:19:10.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ff9d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ffc15cb30 0x7f8ffc0d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffa59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8ffc15a160 0x7f8ffc0d26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56076/0 (socket says 172.21.15.78:56076) 2023-06-09T20:19:10.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ff9d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ffc15cb30 0x7f8ffc0d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46638/0 (socket says 172.21.15.78:46638) 2023-06-09T20:19:10.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffa59c700 1 -- 172.21.15.78:0/1441513009 learned_addr learned my addr 172.21.15.78:0/1441513009 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:10.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ffad9d700 1 --2- 172.21.15.78:0/1441513009 >> v2:172.21.15.187:3300/0 conn(0x7f8ffc070890 0x7f8ffc070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ff9d9b700 1 -- 172.21.15.78:0/1441513009 >> v2:172.21.15.187:3300/0 conn(0x7f8ffc070890 msgr2=0x7f8ffc070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ff9d9b700 1 --2- 172.21.15.78:0/1441513009 >> v2:172.21.15.187:3300/0 conn(0x7f8ffc070890 0x7f8ffc070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ff9d9b700 1 -- 172.21.15.78:0/1441513009 >> v1:172.21.15.78:6789/0 conn(0x7f8ffc15a160 legacy=0x7f8ffc0d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ff9d9b700 1 -- 172.21.15.78:0/1441513009 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc15d180 con 0x7f8ffc15cb30 2023-06-09T20:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.790+0000 7f8ff959a700 1 -- 172.21.15.78:0/1441513009 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882968476 0 0) 0x7f8ffc06d730 con 0x7f8ffc15a160 2023-06-09T20:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ff9d9b700 1 --2- 172.21.15.78:0/1441513009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15cb30 0x7f8ffc0d0a80 secure :-1 s=READY pgs=3220 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0d0970 tx=0x7f8ff0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0caf73957305399 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ff959a700 1 -- 172.21.15.78:0/1441513009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0011830 con 0x7f8ffc15cb30 2023-06-09T20:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ff959a700 1 -- 172.21.15.78:0/1441513009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0011990 con 0x7f8ffc15cb30 2023-06-09T20:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ff959a700 1 -- 172.21.15.78:0/1441513009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0011d20 con 0x7f8ffc15cb30 2023-06-09T20:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1441513009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15cb30 msgr2=0x7f8ffc0d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1441513009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15cb30 0x7f8ffc0d0a80 secure :-1 s=READY pgs=3220 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0d0970 tx=0x7f8ff0009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1441513009 shutdown_connections 2023-06-09T20:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1441513009 >> v2:172.21.15.187:3300/0 conn(0x7f8ffc070890 0x7f8ffc070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1441513009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15cb30 0x7f8ffc0d0a80 unknown :-1 s=CLOSED pgs=3220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1441513009 >> 172.21.15.78:0/1441513009 conn(0x7f8ffc0cf930 msgr2=0x7f8ffc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1441513009 shutdown_connections 2023-06-09T20:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1441513009 wait complete. 2023-06-09T20:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 Processor -- start 2023-06-09T20:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.794+0000 7f8ffb59e700 1 -- start start 2023-06-09T20:19:10.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffb59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ffc070890 0x7f8ffc0b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffb59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15a160 0x7f8ffc0b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffb59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ffc15cb30 0x7f8ffc0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffb59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc15e150 con 0x7f8ffc15a160 2023-06-09T20:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffb59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0b8c80 con 0x7f8ffc070890 2023-06-09T20:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffb59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0b86c0 con 0x7f8ffc15cb30 2023-06-09T20:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15a160 0x7f8ffc0b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15a160 0x7f8ffc0b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46646/0 (socket says 172.21.15.78:46646) 2023-06-09T20:19:10.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 -- 172.21.15.78:0/1651979222 learned_addr learned my addr 172.21.15.78:0/1651979222 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:10.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffa59c700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ffc070890 0x7f8ffc0b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ffad9d700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ffc15cb30 0x7f8ffc0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 -- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ffc15cb30 msgr2=0x7f8ffc0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ffc15cb30 0x7f8ffc0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 -- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ffc070890 msgr2=0x7f8ffc0b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:10.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ffc070890 0x7f8ffc0b7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:10.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 -- 172.21.15.78:0/1651979222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00094b0 con 0x7f8ffc15a160 2023-06-09T20:19:10.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8ff9d9b700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15a160 0x7f8ffc0b4200 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009fd0 tx=0x7f8ff0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8feaffd700 1 -- 172.21.15.78:0/1651979222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0004520 con 0x7f8ffc15a160 2023-06-09T20:19:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8feaffd700 1 -- 172.21.15.78:0/1651979222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff001f070 con 0x7f8ffc15a160 2023-06-09T20:19:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.798+0000 7f8feaffd700 1 -- 172.21.15.78:0/1651979222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0003900 con 0x7f8ffc15a160 2023-06-09T20:19:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.802+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc15d740 con 0x7f8ffc15a160 2023-06-09T20:19:10.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.802+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc15d460 con 0x7f8ffc15a160 2023-06-09T20:19:10.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.802+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc15da20 con 0x7f8ffc15a160 2023-06-09T20:19:10.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.814+0000 7f8feaffd700 1 -- 172.21.15.78:0/1651979222 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ff0003a60 con 0x7f8ffc15a160 2023-06-09T20:19:10.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.814+0000 7f8feaffd700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8fdc066370 0x7f8fdc068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:10.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.818+0000 7f8ffa59c700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8fdc066370 0x7f8fdc068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:10.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.818+0000 7f8ffa59c700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8fdc066370 0x7f8fdc068820 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000f60 tx=0x7f8fec007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:10.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.822+0000 7f8feaffd700 1 -- 172.21.15.78:0/1651979222 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f8ff0021070 con 0x7f8ffc15a160 2023-06-09T20:19:10.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:10.822+0000 7f8feaffd700 1 -- 172.21.15.78:0/1651979222 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8ff0052b40 con 0x7f8ffc15a160 2023-06-09T20:19:11.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.066+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ffc067610 con 0x7f8ffc15a160 2023-06-09T20:19:11.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.066+0000 7f8feaffd700 1 -- 172.21.15.78:0/1651979222 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ff00150a0 con 0x7f8ffc15a160 2023-06-09T20:19:11.072 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T20:19:11.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8fdc066370 msgr2=0x7f8fdc068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8fdc066370 0x7f8fdc068820 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000f60 tx=0x7f8fec007e00 comp rx=0 tx=0).stop 2023-06-09T20:19:11.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15a160 msgr2=0x7f8ffc0b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15a160 0x7f8ffc0b4200 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009fd0 tx=0x7f8ff0004770 comp rx=0 tx=0).stop 2023-06-09T20:19:11.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 shutdown_connections 2023-06-09T20:19:11.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8fdc066370 0x7f8fdc068820 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ffc15cb30 0x7f8ffc0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ffc15a160 0x7f8ffc0b4200 unknown :-1 s=CLOSED pgs=3221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 --2- 172.21.15.78:0/1651979222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ffc070890 0x7f8ffc0b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 >> 172.21.15.78:0/1651979222 conn(0x7f8ffc0cf930 msgr2=0x7f8ffc0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:11.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 shutdown_connections 2023-06-09T20:19:11.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.070+0000 7f8ffb59e700 1 -- 172.21.15.78:0/1651979222 wait complete. 2023-06-09T20:19:11.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T20:19:11.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.290+0000 7f2498c28700 1 Processor -- start 2023-06-09T20:19:11.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.290+0000 7f2498c28700 1 -- start start 2023-06-09T20:19:11.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2498c28700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415cb30 0x7f24940d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2498c28700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2494070890 0x7f2494070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2498c28700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249406d730 con 0x7f249415a160 2023-06-09T20:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2498c28700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2494071250 con 0x7f2494070890 2023-06-09T20:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2498c28700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249415a530 con 0x7f249415cb30 2023-06-09T20:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f24937fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f249415a160 0x7f24940d26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:41740/0 (socket says 172.21.15.78:41740) 2023-06-09T20:19:11.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f24937fe700 1 -- 172.21.15.78:0/925639644 learned_addr learned my addr 172.21.15.78:0/925639644 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:11.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2493fff700 1 --2- 172.21.15.78:0/925639644 >> v2:172.21.15.187:3300/0 conn(0x7f2494070890 0x7f2494070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f24927fc700 1 -- 172.21.15.78:0/925639644 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731989466 0 0) 0x7f249406d730 con 0x7f249415a160 2023-06-09T20:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f24927fc700 1 -- 172.21.15.78:0/925639644 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f247c0035d0 con 0x7f249415a160 2023-06-09T20:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2493fff700 1 -- 172.21.15.78:0/925639644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415cb30 msgr2=0x7f24940d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2493fff700 1 --2- 172.21.15.78:0/925639644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415cb30 0x7f24940d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2493fff700 1 -- 172.21.15.78:0/925639644 >> v1:172.21.15.187:6789/0 conn(0x7f249415a160 legacy=0x7f24940d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.294+0000 7f2493fff700 1 -- 172.21.15.78:0/925639644 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249415d180 con 0x7f2494070890 2023-06-09T20:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2493fff700 1 --2- 172.21.15.78:0/925639644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2494070890 0x7f2494070d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816b83866d63e707 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:11.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f24927fc700 1 -- 172.21.15.78:0/925639644 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00e070 con 0x7f2494070890 2023-06-09T20:19:11.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f24927fc700 1 -- 172.21.15.78:0/925639644 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c00bb20 con 0x7f2494070890 2023-06-09T20:19:11.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f24927fc700 1 -- 172.21.15.78:0/925639644 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c012430 con 0x7f2494070890 2023-06-09T20:19:11.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 -- 172.21.15.78:0/925639644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2494070890 msgr2=0x7f2494070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 --2- 172.21.15.78:0/925639644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2494070890 0x7f2494070d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c00b330 comp rx=0 tx=0).stop 2023-06-09T20:19:11.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 -- 172.21.15.78:0/925639644 shutdown_connections 2023-06-09T20:19:11.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 --2- 172.21.15.78:0/925639644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2494070890 0x7f2494070d10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 --2- 172.21.15.78:0/925639644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415cb30 0x7f24940d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 -- 172.21.15.78:0/925639644 >> 172.21.15.78:0/925639644 conn(0x7f24940cf930 msgr2=0x7f24940cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:11.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 -- 172.21.15.78:0/925639644 shutdown_connections 2023-06-09T20:19:11.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.298+0000 7f2498c28700 1 -- 172.21.15.78:0/925639644 wait complete. 2023-06-09T20:19:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.302+0000 7f2498c28700 1 Processor -- start 2023-06-09T20:19:11.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.302+0000 7f2498c28700 1 -- start start 2023-06-09T20:19:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.302+0000 7f2498c28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2494070890 0x7f24941464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.302+0000 7f2498c28700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415a160 0x7f24940b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2498c28700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249415cb30 0x7f24940b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2498c28700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249415b190 con 0x7f2494070890 2023-06-09T20:19:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2498c28700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24941f1bd0 con 0x7f249415cb30 2023-06-09T20:19:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2498c28700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249415a7f0 con 0x7f249415a160 2023-06-09T20:19:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2494070890 0x7f24941464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2492ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415a160 0x7f24940b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2494070890 0x7f24941464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46662/0 (socket says 172.21.15.78:46662) 2023-06-09T20:19:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 -- 172.21.15.78:0/4048141190 learned_addr learned my addr 172.21.15.78:0/4048141190 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2493fff700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249415cb30 0x7f24940b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 -- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415a160 msgr2=0x7f24940b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415a160 0x7f24940b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 -- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249415cb30 msgr2=0x7f24940b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249415cb30 0x7f24940b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 -- 172.21.15.78:0/4048141190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c009a70 con 0x7f2494070890 2023-06-09T20:19:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f24937fe700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2494070890 0x7f24941464c0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7f248400c700 tx=0x7f248400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f247bfff700 1 -- 172.21.15.78:0/4048141190 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484005d90 con 0x7f2494070890 2023-06-09T20:19:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f247bfff700 1 -- 172.21.15.78:0/4048141190 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24840070d0 con 0x7f2494070890 2023-06-09T20:19:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249415d740 con 0x7f2494070890 2023-06-09T20:19:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f247bfff700 1 -- 172.21.15.78:0/4048141190 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484007480 con 0x7f2494070890 2023-06-09T20:19:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249415d460 con 0x7f2494070890 2023-06-09T20:19:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.306+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249415da20 con 0x7f2494070890 2023-06-09T20:19:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.310+0000 7f247bfff700 1 -- 172.21.15.78:0/4048141190 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24840075e0 con 0x7f2494070890 2023-06-09T20:19:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.310+0000 7f247bfff700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2480066340 0x7f24800687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.310+0000 7f247bfff700 1 -- 172.21.15.78:0/4048141190 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f2484057fe0 con 0x7f2494070890 2023-06-09T20:19:11.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.310+0000 7f2492ffd700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2480066340 0x7f24800687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.314+0000 7f2492ffd700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2480066340 0x7f24800687f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2494157000 tx=0x7f24880091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.314+0000 7f247bfff700 1 -- 172.21.15.78:0/4048141190 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2484088060 con 0x7f2494070890 2023-06-09T20:19:11.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.550+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f249415b2d0 con 0x7f2494070890 2023-06-09T20:19:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.550+0000 7f247bfff700 1 -- 172.21.15.78:0/4048141190 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24840170a0 con 0x7f2494070890 2023-06-09T20:19:11.557 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T20:19:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2480066340 msgr2=0x7f24800687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2480066340 0x7f24800687f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2494157000 tx=0x7f24880091c0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2494070890 msgr2=0x7f24941464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2494070890 0x7f24941464c0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7f248400c700 tx=0x7f248400ca10 comp rx=0 tx=0).stop 2023-06-09T20:19:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 shutdown_connections 2023-06-09T20:19:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f2480066340 0x7f24800687f0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249415cb30 0x7f24940b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249415a160 0x7f24940b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 --2- 172.21.15.78:0/4048141190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2494070890 0x7f24941464c0 unknown :-1 s=CLOSED pgs=3222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 >> 172.21.15.78:0/4048141190 conn(0x7f24940cf930 msgr2=0x7f24940d1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 shutdown_connections 2023-06-09T20:19:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.554+0000 7f2498c28700 1 -- 172.21.15.78:0/4048141190 wait complete. 2023-06-09T20:19:11.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T20:19:11.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 Processor -- start 2023-06-09T20:19:11.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 -- start start 2023-06-09T20:19:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0bc15c880 0x7fe0bc0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc071fa0 0x7fe0bc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe0bc15cc50 0x7fe0bc0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0b5af0 con 0x7fe0bc15c880 2023-06-09T20:19:11.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0ce120 con 0x7fe0bc15cc50 2023-06-09T20:19:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0c13d2700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc06fa20 con 0x7fe0bc071fa0 2023-06-09T20:19:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0baffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0bc15c880 0x7fe0bc0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0bb7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe0bc15cc50 0x7fe0bc0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0bb7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe0bc15cc50 0x7fe0bc0b05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50706/0 (socket says 172.21.15.78:50706) 2023-06-09T20:19:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0bb7fe700 1 -- 172.21.15.78:0/1377334009 learned_addr learned my addr 172.21.15.78:0/1377334009 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0baffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0bc15c880 0x7fe0bc0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46678/0 (socket says 172.21.15.78:46678) 2023-06-09T20:19:11.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0ba7fc700 1 --2- 172.21.15.78:0/1377334009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc071fa0 0x7fe0bc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0baffd700 1 -- 172.21.15.78:0/1377334009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc071fa0 msgr2=0x7fe0bc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:11.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0baffd700 1 --2- 172.21.15.78:0/1377334009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc071fa0 0x7fe0bc0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0baffd700 1 -- 172.21.15.78:0/1377334009 >> v2:172.21.15.187:3300/0 conn(0x7fe0bc15cc50 msgr2=0x7fe0bc0b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:11.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0baffd700 1 --2- 172.21.15.78:0/1377334009 >> v2:172.21.15.187:3300/0 conn(0x7fe0bc15cc50 0x7fe0bc0b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0baffd700 1 -- 172.21.15.78:0/1377334009 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc06fd00 con 0x7fe0bc15c880 2023-06-09T20:19:11.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.766+0000 7fe0bb7fe700 1 --2- 172.21.15.78:0/1377334009 >> v2:172.21.15.187:3300/0 conn(0x7fe0bc15cc50 0x7fe0bc0b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:11.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0baffd700 1 --2- 172.21.15.78:0/1377334009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc15c880 0x7fe0bc0b55b0 secure :-1 s=READY pgs=3223 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009850 tx=0x7fe0ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce76c813f6bb760d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:11.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0b9ffb700 1 -- 172.21.15.78:0/1377334009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac011830 con 0x7fe0bc15c880 2023-06-09T20:19:11.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0b9ffb700 1 -- 172.21.15.78:0/1377334009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac011990 con 0x7fe0bc15c880 2023-06-09T20:19:11.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0b9ffb700 1 -- 172.21.15.78:0/1377334009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac011d20 con 0x7fe0bc15c880 2023-06-09T20:19:11.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1377334009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc15c880 msgr2=0x7fe0bc0b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1377334009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc15c880 0x7fe0bc0b55b0 secure :-1 s=READY pgs=3223 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009850 tx=0x7fe0ac009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1377334009 shutdown_connections 2023-06-09T20:19:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1377334009 >> v2:172.21.15.187:3300/0 conn(0x7fe0bc15cc50 0x7fe0bc0b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1377334009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc071fa0 0x7fe0bc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1377334009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc15c880 0x7fe0bc0b55b0 unknown :-1 s=CLOSED pgs=3223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1377334009 >> 172.21.15.78:0/1377334009 conn(0x7fe0bc0b2b50 msgr2=0x7fe0bc0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1377334009 shutdown_connections 2023-06-09T20:19:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.770+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1377334009 wait complete. 2023-06-09T20:19:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 Processor -- start 2023-06-09T20:19:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 -- start start 2023-06-09T20:19:11.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc071fa0 0x7fe0bc0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc15c880 0x7fe0bc0709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0bc15cc50 0x7fe0bc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0cae40 con 0x7fe0bc071fa0 2023-06-09T20:19:11.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0ba7fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc15c880 0x7fe0bc0709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0ba7fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc15c880 0x7fe0bc0709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:38538/0 (socket says 172.21.15.78:38538) 2023-06-09T20:19:11.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0ba7fc700 1 -- 172.21.15.78:0/1939657365 learned_addr learned my addr 172.21.15.78:0/1939657365 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:11.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0baffd700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc071fa0 0x7fe0bc0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0bb7fe700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0bc15cc50 0x7fe0bc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14a910 con 0x7fe0bc15cc50 2023-06-09T20:19:11.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.774+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14aba0 con 0x7fe0bc15c880 2023-06-09T20:19:11.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0bb7fe700 1 -- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc15c880 msgr2=0x7fe0bc0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0bb7fe700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc15c880 0x7fe0bc0709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0bb7fe700 1 -- 172.21.15.78:0/1939657365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc071fa0 msgr2=0x7fe0bc0ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:11.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0bb7fe700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc071fa0 0x7fe0bc0ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:11.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0bb7fe700 1 -- 172.21.15.78:0/1939657365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4009b30 con 0x7fe0bc15cc50 2023-06-09T20:19:11.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0ba7fc700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc15c880 0x7fe0bc0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:11.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0bb7fe700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0bc15cc50 0x7fe0bc070f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400efc0 tx=0x7fe0b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:11.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0a37fe700 1 -- 172.21.15.78:0/1939657365 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4018070 con 0x7fe0bc15cc50 2023-06-09T20:19:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0a37fe700 1 -- 172.21.15.78:0/1939657365 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b400f040 con 0x7fe0bc15cc50 2023-06-09T20:19:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0a37fe700 1 -- 172.21.15.78:0/1939657365 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4003c60 con 0x7fe0bc15cc50 2023-06-09T20:19:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac0094b0 con 0x7fe0bc15cc50 2023-06-09T20:19:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.778+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc0702c0 con 0x7fe0bc15cc50 2023-06-09T20:19:11.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.782+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc06ffe0 con 0x7fe0bc15cc50 2023-06-09T20:19:11.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.782+0000 7fe0a37fe700 1 -- 172.21.15.78:0/1939657365 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0b400c880 con 0x7fe0bc15cc50 2023-06-09T20:19:11.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.782+0000 7fe0a37fe700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe0a80662f0 0x7fe0a80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:11.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.782+0000 7fe0a37fe700 1 -- 172.21.15.78:0/1939657365 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fe0b4083c00 con 0x7fe0bc15cc50 2023-06-09T20:19:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.786+0000 7fe0baffd700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe0a80662f0 0x7fe0a80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:11.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.786+0000 7fe0baffd700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe0a80662f0 0x7fe0a80687a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac000c00 tx=0x7fe0ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:11.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:11.798+0000 7fe0a37fe700 1 -- 172.21.15.78:0/1939657365 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe0b408a080 con 0x7fe0bc15cc50 2023-06-09T20:19:12.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.070+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0bc0705a0 con 0x7fe0bc15cc50 2023-06-09T20:19:12.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.070+0000 7fe0a37fe700 1 -- 172.21.15.78:0/1939657365 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe0b40510f0 con 0x7fe0bc15cc50 2023-06-09T20:19:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe0a80662f0 msgr2=0x7fe0a80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe0a80662f0 0x7fe0a80687a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac000c00 tx=0x7fe0ac008030 comp rx=0 tx=0).stop 2023-06-09T20:19:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0bc15cc50 msgr2=0x7fe0bc070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0bc15cc50 0x7fe0bc070f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400efc0 tx=0x7fe0b400c3a0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 shutdown_connections 2023-06-09T20:19:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe0a80662f0 0x7fe0a80687a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0bc15cc50 0x7fe0bc070f00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0bc15c880 0x7fe0bc0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 --2- 172.21.15.78:0/1939657365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0bc071fa0 0x7fe0bc0ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 >> 172.21.15.78:0/1939657365 conn(0x7fe0bc0b2b50 msgr2=0x7fe0bc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.074+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 shutdown_connections 2023-06-09T20:19:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.078+0000 7fe0c13d2700 1 -- 172.21.15.78:0/1939657365 wait complete. 2023-06-09T20:19:12.085 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-09T20:19:12.106 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T20:19:12.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:12.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-06-09T20:19:12.181 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T20:19:12.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:12.182 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T20:19:12.348 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T20:19:12.349 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:12.371 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352416k,nr_inodes=4088104,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2901 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T20:19:12.371 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T20:19:12.372 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:12.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352392k,nr_inodes=4088098,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 tmpfs /run/user/10101 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=10101,gid=10101 0 0 2023-06-09T20:19:12.384 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T20:19:12.385 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:12.427 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352416k,nr_inodes=4088104,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2901 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T20:19:12.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T20:19:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.618+0000 7fa4af59e700 1 Processor -- start 2023-06-09T20:19:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.618+0000 7fa4af59e700 1 -- start start 2023-06-09T20:19:12.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4af59e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa4a80e29f0 0x7fa4a8055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4af59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a8007360 con 0x7fa4a8038560 2023-06-09T20:19:12.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4af59e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a8053f70 con 0x7fa4a803b330 2023-06-09T20:19:12.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4af59e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a80e2dc0 con 0x7fa4a80e29f0 2023-06-09T20:19:12.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4add9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa4a8038560 0x7fa4a803ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56082/0 (socket says 172.21.15.78:56082) 2023-06-09T20:19:12.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4add9b700 1 -- 172.21.15.78:0/3353809145 learned_addr learned my addr 172.21.15.78:0/3353809145 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:12.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970551637 0 0) 0x7fa4a8007360 con 0x7fa4a8038560 2023-06-09T20:19:12.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4980035d0 con 0x7fa4a8038560 2023-06-09T20:19:12.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050290366 0 0) 0x7fa4a8053f70 con 0x7fa4a803b330 2023-06-09T20:19:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ae59c700 1 --2- 172.21.15.78:0/3353809145 >> v2:172.21.15.187:3300/0 conn(0x7fa4a80e29f0 0x7fa4a8055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a8007360 con 0x7fa4a803b330 2023-06-09T20:19:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 927092869 0 0) 0x7fa4980035d0 con 0x7fa4a8038560 2023-06-09T20:19:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 >> v2:172.21.15.187:3300/0 conn(0x7fa4a80e29f0 msgr2=0x7fa4a8055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:12.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 --2- 172.21.15.78:0/3353809145 >> v2:172.21.15.187:3300/0 conn(0x7fa4a80e29f0 0x7fa4a8055490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 >> v1:172.21.15.187:6789/0 conn(0x7fa4a803b330 legacy=0x7fa4a8057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8006dc0 con 0x7fa4a8038560 2023-06-09T20:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1424286335 0 0) 0x7fa4a4001670 con 0x7fa4a8038560 2023-06-09T20:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 >> v1:172.21.15.78:6789/0 conn(0x7fa4a8038560 legacy=0x7fa4a803ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa498005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa498003810 0x7fa498003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4980042e0 0x7fa49800b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80e2dc0 con 0x7fa4980042e0 2023-06-09T20:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49800c170 con 0x7fa498004c10 2023-06-09T20:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49800c330 con 0x7fa498003810 2023-06-09T20:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4aed9d700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4980042e0 0x7fa49800b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.622+0000 7fa4ae59c700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa498005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4add9b700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa498003810 0x7fa498003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ae59c700 1 -- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa498003810 msgr2=0x7fa498003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ae59c700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa498003810 0x7fa498003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ae59c700 1 -- 172.21.15.78:0/3353809145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4980042e0 msgr2=0x7fa49800b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ae59c700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4980042e0 0x7fa49800b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ae59c700 1 -- 172.21.15.78:0/3353809145 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980035d0 con 0x7fa498004c10 2023-06-09T20:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4aed9d700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4980042e0 0x7fa49800b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4aed9d700 1 -- 172.21.15.78:0/3353809145 reap_dead start 2023-06-09T20:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ae59c700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa498005000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000aa60 tx=0x7fa4980058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c359dc29748dca server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000a4d0 con 0x7fa498004c10 2023-06-09T20:19:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a000ae90 con 0x7fa498004c10 2023-06-09T20:19:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4ad59a700 1 -- 172.21.15.78:0/3353809145 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000cac0 con 0x7fa498004c10 2023-06-09T20:19:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4af59e700 1 -- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 msgr2=0x7fa498005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4af59e700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa498005000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000aa60 tx=0x7fa4980058a0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4af59e700 1 -- 172.21.15.78:0/3353809145 shutdown_connections 2023-06-09T20:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4af59e700 1 --2- 172.21.15.78:0/3353809145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa498005000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4af59e700 1 -- 172.21.15.78:0/3353809145 >> 172.21.15.78:0/3353809145 conn(0x7fa4a8055c20 msgr2=0x7fa4a8056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.626+0000 7fa4af59e700 1 -- 172.21.15.78:0/3353809145 shutdown_connections 2023-06-09T20:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.630+0000 7fa4af59e700 1 -- 172.21.15.78:0/3353809145 wait complete. 2023-06-09T20:19:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.630+0000 7fa4af59e700 1 Processor -- start 2023-06-09T20:19:12.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 -- start start 2023-06-09T20:19:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa4a80daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a80d5f90 0x7fa4a804df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a8178d10 0x7fa4a80def20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a81788f0 con 0x7fa4a8178d10 2023-06-09T20:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a804ff70 con 0x7fa498004c10 2023-06-09T20:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a804e490 con 0x7fa4a80d5f90 2023-06-09T20:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a8178d10 0x7fa4a80def20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a8178d10 0x7fa4a80def20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46698/0 (socket says 172.21.15.78:46698) 2023-06-09T20:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 -- 172.21.15.78:0/642391086 learned_addr learned my addr 172.21.15.78:0/642391086 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4add9b700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a80d5f90 0x7fa4a804df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 -- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a80d5f90 msgr2=0x7fa4a804df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a80d5f90 0x7fa4a804df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 -- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 msgr2=0x7fa4a80daeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa4a80daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 -- 172.21.15.78:0/642391086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8053920 con 0x7fa4a8178d10 2023-06-09T20:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4aed9d700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a8178d10 0x7fa4a80def20 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0072930 tx=0x7fa4b00671e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa49effd700 1 -- 172.21.15.78:0/642391086 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b008e070 con 0x7fa4a8178d10 2023-06-09T20:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa49effd700 1 -- 172.21.15.78:0/642391086 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0072070 con 0x7fa4a8178d10 2023-06-09T20:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a8007080 con 0x7fa4a8178d10 2023-06-09T20:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa49effd700 1 -- 172.21.15.78:0/642391086 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00723e0 con 0x7fa4a8178d10 2023-06-09T20:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.634+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a8053c00 con 0x7fa4a8178d10 2023-06-09T20:19:12.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.638+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a8005570 con 0x7fa4a8178d10 2023-06-09T20:19:12.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.638+0000 7fa49effd700 1 -- 172.21.15.78:0/642391086 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4b00733e0 con 0x7fa4a8178d10 2023-06-09T20:19:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.638+0000 7fa49effd700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa490066320 0x7fa4900687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.638+0000 7fa49effd700 1 -- 172.21.15.78:0/642391086 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa4b00fcc50 con 0x7fa4a8178d10 2023-06-09T20:19:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.638+0000 7fa4ae59c700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa490066320 0x7fa4900687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.642+0000 7fa4ae59c700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa490066320 0x7fa4900687d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000a1a0 tx=0x7fa4a0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:12.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.646+0000 7fa49effd700 1 -- 172.21.15.78:0/642391086 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa4b00ca140 con 0x7fa4a8178d10 2023-06-09T20:19:12.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.950+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4a80077b0 con 0x7fa4a8178d10 2023-06-09T20:19:12.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.962+0000 7fa49effd700 1 -- 172.21.15.78:0/642391086 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fa4b0073c80 con 0x7fa4a8178d10 2023-06-09T20:19:12.969 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:12.969 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3399791462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3399791462},{"type":"v1","addr":"172.21.15.187:6837","nonce":3399791462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/658938311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":658938311},{"type":"v1","addr":"172.21.15.78:6834","nonce":658938311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/952789446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":952789446},{"type":"v1","addr":"172.21.15.78:6835","nonce":952789446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:13:12.092475+0000","modified":"2023-06-09T11:13:15.123169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5137":{"gid":5137,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.187:6835/1349991607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1349991607},{"type":"v1","addr":"172.21.15.187:6835","nonce":1349991607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T20:19:12.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa490066320 msgr2=0x7fa4900687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa490066320 0x7fa4900687d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000a1a0 tx=0x7fa4a0011000 comp rx=0 tx=0).stop 2023-06-09T20:19:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a8178d10 msgr2=0x7fa4a80def20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a8178d10 0x7fa4a80def20 secure :-1 s=READY pgs=3225 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0072930 tx=0x7fa4b00671e0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 shutdown_connections 2023-06-09T20:19:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa490066320 0x7fa4900687d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a8178d10 0x7fa4a80def20 unknown :-1 s=CLOSED pgs=3225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a80d5f90 0x7fa4a804df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 --2- 172.21.15.78:0/642391086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa498004c10 0x7fa4a80daeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 >> 172.21.15.78:0/642391086 conn(0x7fa4a8055c20 msgr2=0x7fa4a80591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 shutdown_connections 2023-06-09T20:19:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:12.966+0000 7fa4af59e700 1 -- 172.21.15.78:0/642391086 wait complete. 2023-06-09T20:19:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2023-06-09T20:19:12.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T20:19:13.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.194+0000 7fb1f2891700 1 Processor -- start 2023-06-09T20:19:13.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.194+0000 7fb1f2891700 1 -- start start 2023-06-09T20:19:13.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1f2891700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb1ec15c440 0x7fb1ec070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1f2891700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec06edb0 0x7fb1ec0ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1f2891700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec06a290 con 0x7fb1ec0b2520 2023-06-09T20:19:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1f2891700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec06ae10 con 0x7fb1ec15c440 2023-06-09T20:19:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1f2891700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0b1d10 con 0x7fb1ec06edb0 2023-06-09T20:19:13.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1eb7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb1ec0b2520 0x7fb1ec06e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56084/0 (socket says 172.21.15.78:56084) 2023-06-09T20:19:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1eb7fe700 1 -- 172.21.15.78:0/3225109204 learned_addr learned my addr 172.21.15.78:0/3225109204 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1ebfff700 1 --2- 172.21.15.78:0/3225109204 >> v2:172.21.15.78:3300/0 conn(0x7fb1ec15c440 0x7fb1ec070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1f0e2e700 1 --2- 172.21.15.78:0/3225109204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec06edb0 0x7fb1ec0ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1eaffd700 1 -- 172.21.15.78:0/3225109204 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947611023 0 0) 0x7fb1ec06a290 con 0x7fb1ec0b2520 2023-06-09T20:19:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1eaffd700 1 -- 172.21.15.78:0/3225109204 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d80035d0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1ebfff700 1 -- 172.21.15.78:0/3225109204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec06edb0 msgr2=0x7fb1ec0ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:13.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1ebfff700 1 --2- 172.21.15.78:0/3225109204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec06edb0 0x7fb1ec0ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1ebfff700 1 -- 172.21.15.78:0/3225109204 >> v1:172.21.15.78:6789/0 conn(0x7fb1ec0b2520 legacy=0x7fb1ec06e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1ebfff700 1 -- 172.21.15.78:0/3225109204 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec06a4e0 con 0x7fb1ec15c440 2023-06-09T20:19:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.198+0000 7fb1eaffd700 1 -- 172.21.15.78:0/3225109204 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3211489692 0 0) 0x7fb1d80035d0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1ebfff700 1 --2- 172.21.15.78:0/3225109204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec15c440 0x7fb1ec070290 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009850 tx=0x7fb1e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f7fdcff493879c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1eaffd700 1 -- 172.21.15.78:0/3225109204 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0019f0 con 0x7fb1ec15c440 2023-06-09T20:19:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1eaffd700 1 -- 172.21.15.78:0/3225109204 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4004030 con 0x7fb1ec15c440 2023-06-09T20:19:13.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1eaffd700 1 -- 172.21.15.78:0/3225109204 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40043e0 con 0x7fb1ec15c440 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 -- 172.21.15.78:0/3225109204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec15c440 msgr2=0x7fb1ec070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 --2- 172.21.15.78:0/3225109204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec15c440 0x7fb1ec070290 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009850 tx=0x7fb1e4009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 -- 172.21.15.78:0/3225109204 shutdown_connections 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 --2- 172.21.15.78:0/3225109204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec06edb0 0x7fb1ec0ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 --2- 172.21.15.78:0/3225109204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec15c440 0x7fb1ec070290 unknown :-1 s=CLOSED pgs=3227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 -- 172.21.15.78:0/3225109204 >> 172.21.15.78:0/3225109204 conn(0x7fb1ec0b13e0 msgr2=0x7fb1ec0cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 -- 172.21.15.78:0/3225109204 shutdown_connections 2023-06-09T20:19:13.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 -- 172.21.15.78:0/3225109204 wait complete. 2023-06-09T20:19:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.202+0000 7fb1f2891700 1 Processor -- start 2023-06-09T20:19:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 -- start start 2023-06-09T20:19:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1ec06edb0 0x7fb1ec14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec0b2520 0x7fb1ec15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec15c440 0x7fb1ec15f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec15db70 con 0x7fb1ec0b2520 2023-06-09T20:19:13.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec15dd50 con 0x7fb1ec06edb0 2023-06-09T20:19:13.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec15e030 con 0x7fb1ec15c440 2023-06-09T20:19:13.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec0b2520 0x7fb1ec15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec0b2520 0x7fb1ec15f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46722/0 (socket says 172.21.15.78:46722) 2023-06-09T20:19:13.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 -- 172.21.15.78:0/2438088189 learned_addr learned my addr 172.21.15.78:0/2438088189 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:13.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f0e2e700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec15c440 0x7fb1ec15f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 -- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec15c440 msgr2=0x7fb1ec15f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec15c440 0x7fb1ec15f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 -- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1ec06edb0 msgr2=0x7fb1ec14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1ec06edb0 0x7fb1ec14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 -- 172.21.15.78:0/2438088189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40094b0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f0e2e700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec15c440 0x7fb1ec15f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1eb7fe700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec0b2520 0x7fb1ec15f4a0 secure :-1 s=READY pgs=3228 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc001560 tx=0x7fb1dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1e8ff9700 1 -- 172.21.15.78:0/2438088189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00ada0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1e8ff9700 1 -- 172.21.15.78:0/2438088189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0070d0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec06aaa0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1e8ff9700 1 -- 172.21.15.78:0/2438088189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc007480 con 0x7fb1ec0b2520 2023-06-09T20:19:13.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.206+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec06a7c0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.210+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec15c810 con 0x7fb1ec0b2520 2023-06-09T20:19:13.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.210+0000 7fb1e8ff9700 1 -- 172.21.15.78:0/2438088189 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1dc0075e0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.214+0000 7fb1e8ff9700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb1cc0662f0 0x7fb1cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.214+0000 7fb1ebfff700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb1cc0662f0 0x7fb1cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.214+0000 7fb1e8ff9700 1 -- 172.21.15.78:0/2438088189 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fb1dc058e20 con 0x7fb1ec0b2520 2023-06-09T20:19:13.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.214+0000 7fb1ebfff700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb1cc0662f0 0x7fb1cc0687a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40090b0 tx=0x7fb1e4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.222+0000 7fb1e8ff9700 1 -- 172.21.15.78:0/2438088189 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb1dc0511a0 con 0x7fb1ec0b2520 2023-06-09T20:19:13.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.470+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1ec067610 con 0x7fb1ec0b2520 2023-06-09T20:19:13.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1e8ff9700 1 -- 172.21.15.78:0/2438088189 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18308 (secure 0 0 0) 0x7fb1dc018070 con 0x7fb1ec0b2520 2023-06-09T20:19:13.479 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:13.480 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:50.349113+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:13:10.180078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T11:13:11.109063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.19","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T20:19:13.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb1cc0662f0 msgr2=0x7fb1cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb1cc0662f0 0x7fb1cc0687a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40090b0 tx=0x7fb1e4010000 comp rx=0 tx=0).stop 2023-06-09T20:19:13.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec0b2520 msgr2=0x7fb1ec15f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec0b2520 0x7fb1ec15f4a0 secure :-1 s=READY pgs=3228 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc001560 tx=0x7fb1dc00a340 comp rx=0 tx=0).stop 2023-06-09T20:19:13.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 shutdown_connections 2023-06-09T20:19:13.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fb1cc0662f0 0x7fb1cc0687a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1ec15c440 0x7fb1ec15f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1ec0b2520 0x7fb1ec15f4a0 unknown :-1 s=CLOSED pgs=3228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 --2- 172.21.15.78:0/2438088189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1ec06edb0 0x7fb1ec14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.474+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 >> 172.21.15.78:0/2438088189 conn(0x7fb1ec0b13e0 msgr2=0x7fb1ec15a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.478+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 shutdown_connections 2023-06-09T20:19:13.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.478+0000 7fb1f2891700 1 -- 172.21.15.78:0/2438088189 wait complete. 2023-06-09T20:19:13.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T11:11:55.689491+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T11:12:01.668945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T11:13:10.180078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T11:13:11.109063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T20:19:13.512 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T20:19:13.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.714+0000 7f5aed4fa700 1 Processor -- start 2023-06-09T20:19:13.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.714+0000 7f5aed4fa700 1 -- start start 2023-06-09T20:19:13.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.714+0000 7f5aed4fa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ae815a160 0x7f5ae815cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.714+0000 7f5aed4fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae8070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.714+0000 7f5aed4fa700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae8071210 con 0x7f5ae80d26d0 2023-06-09T20:19:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ae815a160 0x7f5ae815cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.714+0000 7f5aed4fa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae80d1190 con 0x7f5ae815a160 2023-06-09T20:19:13.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ae815a160 0x7f5ae815cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46730/0 (socket says 172.21.15.78:46730) 2023-06-09T20:19:13.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 -- 172.21.15.78:0/2106289819 learned_addr learned my addr 172.21.15.78:0/2106289819 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:13.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5aed4fa700 1 -- 172.21.15.78:0/2106289819 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae806d730 con 0x7f5ae8070890 2023-06-09T20:19:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae77fe700 1 --2- 172.21.15.78:0/2106289819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae8070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 -- 172.21.15.78:0/2106289819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 msgr2=0x7f5ae8070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 --2- 172.21.15.78:0/2106289819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae8070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 -- 172.21.15.78:0/2106289819 >> v1:172.21.15.78:6789/0 conn(0x7f5ae80d26d0 legacy=0x7f5ae80d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae5ffb700 1 -- 172.21.15.78:0/2106289819 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145968555 0 0) 0x7f5ae8071210 con 0x7f5ae80d26d0 2023-06-09T20:19:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 -- 172.21.15.78:0/2106289819 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae815a530 con 0x7f5ae815a160 2023-06-09T20:19:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae77fe700 1 --2- 172.21.15.78:0/2106289819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae6ffd700 1 --2- 172.21.15.78:0/2106289819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815cb30 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009910 tx=0x7f5ad8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7044e785b665f87e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae5ffb700 1 -- 172.21.15.78:0/2106289819 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8011830 con 0x7f5ae815a160 2023-06-09T20:19:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae5ffb700 1 -- 172.21.15.78:0/2106289819 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad8011990 con 0x7f5ae815a160 2023-06-09T20:19:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5ae5ffb700 1 -- 172.21.15.78:0/2106289819 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8011d40 con 0x7f5ae815a160 2023-06-09T20:19:13.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5aed4fa700 1 -- 172.21.15.78:0/2106289819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 msgr2=0x7f5ae815cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.718+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/2106289819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815cb30 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009910 tx=0x7f5ad8009c20 comp rx=0 tx=0).stop 2023-06-09T20:19:13.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 -- 172.21.15.78:0/2106289819 shutdown_connections 2023-06-09T20:19:13.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/2106289819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/2106289819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815cb30 unknown :-1 s=CLOSED pgs=3230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 -- 172.21.15.78:0/2106289819 >> 172.21.15.78:0/2106289819 conn(0x7f5ae80cf930 msgr2=0x7f5ae80cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 -- 172.21.15.78:0/2106289819 shutdown_connections 2023-06-09T20:19:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 -- 172.21.15.78:0/2106289819 wait complete. 2023-06-09T20:19:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 Processor -- start 2023-06-09T20:19:13.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 -- start start 2023-06-09T20:19:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae80b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.722+0000 7f5aed4fa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ae80d26d0 0x7f5ae815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5aed4fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5aed4fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b6a90 con 0x7f5ae815a160 2023-06-09T20:19:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5aed4fa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae81f2310 con 0x7f5ae80d26d0 2023-06-09T20:19:13.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5aed4fa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae81f25f0 con 0x7f5ae8070890 2023-06-09T20:19:13.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46738/0 (socket says 172.21.15.78:46738) 2023-06-09T20:19:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 -- 172.21.15.78:0/1692176927 learned_addr learned my addr 172.21.15.78:0/1692176927 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae6ffd700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae80b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae67fc700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ae80d26d0 0x7f5ae815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 -- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 msgr2=0x7f5ae80b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae80b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 -- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ae80d26d0 msgr2=0x7f5ae815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ae80d26d0 0x7f5ae815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 -- 172.21.15.78:0/1692176927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae0009a70 con 0x7f5ae815a160 2023-06-09T20:19:13.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5ae77fe700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815ef10 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000efc0 tx=0x7f5ae000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:13.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5acf7fe700 1 -- 172.21.15.78:0/1692176927 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000ca90 con 0x7f5ae815a160 2023-06-09T20:19:13.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5acf7fe700 1 -- 172.21.15.78:0/1692176927 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae000f040 con 0x7f5ae815a160 2023-06-09T20:19:13.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad8009570 con 0x7f5ae815a160 2023-06-09T20:19:13.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5acf7fe700 1 -- 172.21.15.78:0/1692176927 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000ce30 con 0x7f5ae815a160 2023-06-09T20:19:13.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae815d460 con 0x7f5ae815a160 2023-06-09T20:19:13.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.726+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae815d180 con 0x7f5ae815a160 2023-06-09T20:19:13.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.730+0000 7f5acf7fe700 1 -- 172.21.15.78:0/1692176927 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ae0014480 con 0x7f5ae815a160 2023-06-09T20:19:13.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.730+0000 7f5acf7fe700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5ad40662f0 0x7f5ad40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:13.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.730+0000 7f5acf7fe700 1 -- 172.21.15.78:0/1692176927 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f5ae0084380 con 0x7f5ae815a160 2023-06-09T20:19:13.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.730+0000 7f5ae6ffd700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5ad40662f0 0x7f5ad40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:13.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.734+0000 7f5ae6ffd700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5ad40662f0 0x7f5ad40687a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8000c00 tx=0x7f5ad8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:13.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.738+0000 7f5acf7fe700 1 -- 172.21.15.78:0/1692176927 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5ae00517d0 con 0x7f5ae815a160 2023-06-09T20:19:13.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.982+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ae815d740 con 0x7f5ae815a160 2023-06-09T20:19:13.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.982+0000 7f5acf7fe700 1 -- 172.21.15.78:0/1692176927 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ae0009cd0 con 0x7f5ae815a160 2023-06-09T20:19:13.988 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-09T20:19:13.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5ad40662f0 msgr2=0x7f5ad40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5ad40662f0 0x7f5ad40687a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8000c00 tx=0x7f5ad8008030 comp rx=0 tx=0).stop 2023-06-09T20:19:13.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 msgr2=0x7f5ae815ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:13.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815ef10 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000efc0 tx=0x7f5ae000c3a0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 shutdown_connections 2023-06-09T20:19:13.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f5ad40662f0 0x7f5ad40687a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ae815a160 0x7f5ae815ef10 unknown :-1 s=CLOSED pgs=3231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ae80d26d0 0x7f5ae815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 --2- 172.21.15.78:0/1692176927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ae8070890 0x7f5ae80b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:13.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 >> 172.21.15.78:0/1692176927 conn(0x7f5ae80cf930 msgr2=0x7f5ae81599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:13.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 shutdown_connections 2023-06-09T20:19:13.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:13.986+0000 7f5aed4fa700 1 -- 172.21.15.78:0/1692176927 wait complete. 2023-06-09T20:19:14.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T20:19:14.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f098cba0700 1 Processor -- start 2023-06-09T20:19:14.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f098cba0700 1 -- start start 2023-06-09T20:19:14.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f098cba0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09880c9270 0x7f098806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f098cba0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f09881645a0 0x7f0988164a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f098cba0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880c9d90 con 0x7f09881641d0 2023-06-09T20:19:14.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f098cba0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880ca070 con 0x7f09880c9270 2023-06-09T20:19:14.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f098cba0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880ccf90 con 0x7f09881645a0 2023-06-09T20:19:14.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f0986d9d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f09881645a0 0x7f0988164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f0986d9d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f09881645a0 0x7f0988164a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50774/0 (socket says 172.21.15.78:50774) 2023-06-09T20:19:14.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.218+0000 7f0986d9d700 1 -- 172.21.15.78:0/2203545483 learned_addr learned my addr 172.21.15.78:0/2203545483 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f0986d9d700 1 -- 172.21.15.78:0/2203545483 >> v2:172.21.15.78:3300/0 conn(0x7f09880c9270 msgr2=0x7f098806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f0986d9d700 1 --2- 172.21.15.78:0/2203545483 >> v2:172.21.15.78:3300/0 conn(0x7f09880c9270 0x7f098806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f0986d9d700 1 -- 172.21.15.78:0/2203545483 >> v1:172.21.15.78:6789/0 conn(0x7f09881641d0 legacy=0x7f098806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f0986d9d700 1 -- 172.21.15.78:0/2203545483 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880cd270 con 0x7f09881645a0 2023-06-09T20:19:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f0986d9d700 1 --2- 172.21.15.78:0/2203545483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881645a0 0x7f0988164a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f098806eca0 tx=0x7f0970009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f1c983d2048d62 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098559a700 1 -- 172.21.15.78:0/2203545483 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970004230 con 0x7f09881645a0 2023-06-09T20:19:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098559a700 1 -- 172.21.15.78:0/2203545483 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970004390 con 0x7f09881645a0 2023-06-09T20:19:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098559a700 1 -- 172.21.15.78:0/2203545483 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700036c0 con 0x7f09881645a0 2023-06-09T20:19:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 -- 172.21.15.78:0/2203545483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881645a0 msgr2=0x7f0988164a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 --2- 172.21.15.78:0/2203545483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881645a0 0x7f0988164a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f098806eca0 tx=0x7f0970009bf0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 -- 172.21.15.78:0/2203545483 shutdown_connections 2023-06-09T20:19:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 --2- 172.21.15.78:0/2203545483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881645a0 0x7f0988164a00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 --2- 172.21.15.78:0/2203545483 >> v2:172.21.15.78:3300/0 conn(0x7f09880c9270 0x7f098806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 -- 172.21.15.78:0/2203545483 >> 172.21.15.78:0/2203545483 conn(0x7f09880cf8b0 msgr2=0x7f09880cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 -- 172.21.15.78:0/2203545483 shutdown_connections 2023-06-09T20:19:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.222+0000 7f098cba0700 1 -- 172.21.15.78:0/2203545483 wait complete. 2023-06-09T20:19:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 Processor -- start 2023-06-09T20:19:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 -- start start 2023-06-09T20:19:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09880c9270 0x7f09880c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881641d0 0x7f09880b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09881645a0 0x7f09880b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098815c750 con 0x7f09881645a0 2023-06-09T20:19:14.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098815ca30 con 0x7f09881641d0 2023-06-09T20:19:14.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.226+0000 7f098cba0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098815cd10 con 0x7f09880c9270 2023-06-09T20:19:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09880c9270 0x7f09880c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09880c9270 0x7f09880c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:38598/0 (socket says 172.21.15.78:38598) 2023-06-09T20:19:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 -- 172.21.15.78:0/2405167041 learned_addr learned my addr 172.21.15.78:0/2405167041 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f0985d9b700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881641d0 0x7f09880b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f0986d9d700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09881645a0 0x7f09880b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 -- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881641d0 msgr2=0x7f09880b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881641d0 0x7f09880b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 -- 172.21.15.78:0/2405167041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09881645a0 msgr2=0x7f09880b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09881645a0 0x7f09880b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 -- 172.21.15.78:0/2405167041 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970009570 con 0x7f09880c9270 2023-06-09T20:19:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f0986d9d700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09881645a0 0x7f09880b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098659c700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09880c9270 0x7f09880c8740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f098000c4d0 tx=0x7f098000c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f097effd700 1 -- 172.21.15.78:0/2405167041 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09800054e0 con 0x7f09880c9270 2023-06-09T20:19:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f097effd700 1 -- 172.21.15.78:0/2405167041 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09800036a0 con 0x7f09880c9270 2023-06-09T20:19:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880c1f20 con 0x7f09880c9270 2023-06-09T20:19:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f097effd700 1 -- 172.21.15.78:0/2405167041 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980003a50 con 0x7f09880c9270 2023-06-09T20:19:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.230+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880cd550 con 0x7f09880c9270 2023-06-09T20:19:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.234+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0988069f40 con 0x7f09880c9270 2023-06-09T20:19:14.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.246+0000 7f097effd700 1 -- 172.21.15.78:0/2405167041 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0980003bb0 con 0x7f09880c9270 2023-06-09T20:19:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.246+0000 7f097effd700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0968066320 0x7f09680687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.246+0000 7f097effd700 1 -- 172.21.15.78:0/2405167041 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0980082e00 con 0x7f09880c9270 2023-06-09T20:19:14.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.246+0000 7f0985d9b700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0968066320 0x7f09680687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.250+0000 7f0985d9b700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0968066320 0x7f09680687d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f09881596f0 tx=0x7f097800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.386+0000 7f097effd700 1 -- 172.21.15.78:0/2405167041 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f09800502c0 con 0x7f09880c9270 2023-06-09T20:19:14.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.666+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09880741c0 con 0x7f09880c9270 2023-06-09T20:19:14.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.686+0000 7f097effd700 1 -- 172.21.15.78:0/2405167041 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0980017020 con 0x7f09880c9270 2023-06-09T20:19:14.694 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-09T20:19:14.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.690+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0968066320 msgr2=0x7f09680687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.690+0000 7f098cba0700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0968066320 0x7f09680687d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f09881596f0 tx=0x7f097800d040 comp rx=0 tx=0).stop 2023-06-09T20:19:14.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.690+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09880c9270 msgr2=0x7f09880c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.690+0000 7f098cba0700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09880c9270 0x7f09880c8740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f098000c4d0 tx=0x7f098000c7e0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 shutdown_connections 2023-06-09T20:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0968066320 0x7f09680687d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09881645a0 0x7f09880b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09881641d0 0x7f09880b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 --2- 172.21.15.78:0/2405167041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09880c9270 0x7f09880c8740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 >> 172.21.15.78:0/2405167041 conn(0x7f09880cf8b0 msgr2=0x7f09880cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 shutdown_connections 2023-06-09T20:19:14.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.694+0000 7f098cba0700 1 -- 172.21.15.78:0/2405167041 wait complete. 2023-06-09T20:19:14.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T20:19:14.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.902+0000 7ff27908c700 1 Processor -- start 2023-06-09T20:19:14.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.902+0000 7ff27908c700 1 -- start start 2023-06-09T20:19:14.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27908c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff27415cb30 0x7ff2740d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27908c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27406d730 con 0x7ff274070890 2023-06-09T20:19:14.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27908c700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27415a530 con 0x7ff27415a160 2023-06-09T20:19:14.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27908c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27415d180 con 0x7ff27415cb30 2023-06-09T20:19:14.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27888b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff274070890 0x7ff274070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49386/0 (socket says 172.21.15.78:49386) 2023-06-09T20:19:14.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27888b700 1 -- 172.21.15.78:0/3655122249 learned_addr learned my addr 172.21.15.78:0/3655122249 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:14.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff26bfff700 1 --2- 172.21.15.78:0/3655122249 >> v2:172.21.15.78:3300/0 conn(0x7ff27415cb30 0x7ff2740d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff2737fe700 1 -- 172.21.15.78:0/3655122249 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566226521 0 0) 0x7ff27406d730 con 0x7ff274070890 2023-06-09T20:19:14.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff26bfff700 1 -- 172.21.15.78:0/3655122249 >> v1:172.21.15.187:6789/0 conn(0x7ff27415a160 legacy=0x7ff2740d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff26bfff700 1 -- 172.21.15.78:0/3655122249 >> v1:172.21.15.78:6789/0 conn(0x7ff274070890 legacy=0x7ff274070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff26bfff700 1 -- 172.21.15.78:0/3655122249 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27415d460 con 0x7ff27415cb30 2023-06-09T20:19:14.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff26bfff700 1 --2- 172.21.15.78:0/3655122249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff27415cb30 0x7ff2740d0a80 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097d0 tx=0x7ff25c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55f3fc42b2c81f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff2737fe700 1 -- 172.21.15.78:0/3655122249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c004230 con 0x7ff27415cb30 2023-06-09T20:19:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff2737fe700 1 -- 172.21.15.78:0/3655122249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c004390 con 0x7ff27415cb30 2023-06-09T20:19:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff2737fe700 1 -- 172.21.15.78:0/3655122249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0036c0 con 0x7ff27415cb30 2023-06-09T20:19:14.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27908c700 1 -- 172.21.15.78:0/3655122249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff27415cb30 msgr2=0x7ff2740d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.906+0000 7ff27908c700 1 --2- 172.21.15.78:0/3655122249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff27415cb30 0x7ff2740d0a80 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097d0 tx=0x7ff25c009ae0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.910+0000 7ff27908c700 1 -- 172.21.15.78:0/3655122249 shutdown_connections 2023-06-09T20:19:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.910+0000 7ff27908c700 1 --2- 172.21.15.78:0/3655122249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff27415cb30 0x7ff2740d0a80 unknown :-1 s=CLOSED pgs=3233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.910+0000 7ff27908c700 1 -- 172.21.15.78:0/3655122249 >> 172.21.15.78:0/3655122249 conn(0x7ff2740cf930 msgr2=0x7ff2740cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.910+0000 7ff27908c700 1 -- 172.21.15.78:0/3655122249 shutdown_connections 2023-06-09T20:19:14.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.910+0000 7ff27908c700 1 -- 172.21.15.78:0/3655122249 wait complete. 2023-06-09T20:19:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.910+0000 7ff27908c700 1 Processor -- start 2023-06-09T20:19:14.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.910+0000 7ff27908c700 1 -- start start 2023-06-09T20:19:14.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27908c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff274070890 0x7ff27414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27908c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff27415a160 0x7ff274155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27908c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2740b6050 0x7ff2740b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27908c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27414e5e0 con 0x7ff2740b6050 2023-06-09T20:19:14.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27908c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27415dbb0 con 0x7ff274070890 2023-06-09T20:19:14.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27908c700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740b81f0 con 0x7ff27415a160 2023-06-09T20:19:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff273fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff274070890 0x7ff27414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27888b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2740b6050 0x7ff2740b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff273fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff274070890 0x7ff27414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36508/0 (socket says 172.21.15.78:36508) 2023-06-09T20:19:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff273fff700 1 -- 172.21.15.78:0/3426220356 learned_addr learned my addr 172.21.15.78:0/3426220356 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff26bfff700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff27415a160 0x7ff274155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27888b700 1 -- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff27415a160 msgr2=0x7ff274155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27888b700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff27415a160 0x7ff274155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27888b700 1 -- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff274070890 msgr2=0x7ff27414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27888b700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff274070890 0x7ff27414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.914+0000 7ff27888b700 1 -- 172.21.15.78:0/3426220356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0094b0 con 0x7ff2740b6050 2023-06-09T20:19:14.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.922+0000 7ff27888b700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2740b6050 0x7ff2740b64f0 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7ff2740b2960 tx=0x7ff26c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:14.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.922+0000 7ff2717fa700 1 -- 172.21.15.78:0/3426220356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c007480 con 0x7ff2740b6050 2023-06-09T20:19:14.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.922+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27415da20 con 0x7ff2740b6050 2023-06-09T20:19:14.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.922+0000 7ff2717fa700 1 -- 172.21.15.78:0/3426220356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c0075e0 con 0x7ff2740b6050 2023-06-09T20:19:14.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.922+0000 7ff2717fa700 1 -- 172.21.15.78:0/3426220356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c007990 con 0x7ff2740b6050 2023-06-09T20:19:14.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.922+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27415d740 con 0x7ff2740b6050 2023-06-09T20:19:14.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.922+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff274067610 con 0x7ff2740b6050 2023-06-09T20:19:14.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.926+0000 7ff2717fa700 1 -- 172.21.15.78:0/3426220356 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff26c012400 con 0x7ff2740b6050 2023-06-09T20:19:14.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.926+0000 7ff2717fa700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff254066320 0x7ff2540687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:14.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.926+0000 7ff2717fa700 1 -- 172.21.15.78:0/3426220356 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7ff26c0833f0 con 0x7ff2740b6050 2023-06-09T20:19:14.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.926+0000 7ff273fff700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff254066320 0x7ff2540687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:14.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.926+0000 7ff273fff700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff254066320 0x7ff2540687d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff264001ba0 tx=0x7ff264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:14.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:14.934+0000 7ff2717fa700 1 -- 172.21.15.78:0/3426220356 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff26c050910 con 0x7ff2740b6050 2023-06-09T20:19:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.174+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff27415dcf0 con 0x7ff2740b6050 2023-06-09T20:19:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.178+0000 7ff2717fa700 1 -- 172.21.15.78:0/3426220356 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff26c001b40 con 0x7ff2740b6050 2023-06-09T20:19:15.183 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-09T20:19:15.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.178+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff254066320 msgr2=0x7ff2540687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.178+0000 7ff27908c700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff254066320 0x7ff2540687d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff264001ba0 tx=0x7ff264009040 comp rx=0 tx=0).stop 2023-06-09T20:19:15.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.178+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2740b6050 msgr2=0x7ff2740b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.178+0000 7ff27908c700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2740b6050 0x7ff2740b64f0 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7ff2740b2960 tx=0x7ff26c00caa0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 shutdown_connections 2023-06-09T20:19:15.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff254066320 0x7ff2540687d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2740b6050 0x7ff2740b64f0 unknown :-1 s=CLOSED pgs=3234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff27415a160 0x7ff274155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 --2- 172.21.15.78:0/3426220356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff274070890 0x7ff27414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 >> 172.21.15.78:0/3426220356 conn(0x7ff2740cf930 msgr2=0x7ff2740c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:15.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 shutdown_connections 2023-06-09T20:19:15.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.182+0000 7ff27908c700 1 -- 172.21.15.78:0/3426220356 wait complete. 2023-06-09T20:19:15.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T20:19:15.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.414+0000 7f005a24a700 1 Processor -- start 2023-06-09T20:19:15.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f005a24a700 1 -- start start 2023-06-09T20:19:15.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f005a24a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f005406d790 0x7f00540d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f005a24a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540cda60 con 0x7f005415c9f0 2023-06-09T20:19:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f005a24a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540d15d0 con 0x7f00540d11b0 2023-06-09T20:19:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f005a24a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0054160d70 con 0x7f005406d790 2023-06-09T20:19:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f00537fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f005415c9f0 0x7f0054160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49388/0 (socket says 172.21.15.78:49388) 2023-06-09T20:19:15.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f00537fe700 1 -- 172.21.15.78:0/52580284 learned_addr learned my addr 172.21.15.78:0/52580284 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f0052ffd700 1 --2- 172.21.15.78:0/52580284 >> v2:172.21.15.78:3300/0 conn(0x7f005406d790 0x7f00540d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f00527fc700 1 -- 172.21.15.78:0/52580284 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351531382 0 0) 0x7f00540cda60 con 0x7f005415c9f0 2023-06-09T20:19:15.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f00527fc700 1 -- 172.21.15.78:0/52580284 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003c0035d0 con 0x7f005415c9f0 2023-06-09T20:19:15.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f00527fc700 1 -- 172.21.15.78:0/52580284 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678653821 0 0) 0x7f003c0035d0 con 0x7f005415c9f0 2023-06-09T20:19:15.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f0052ffd700 1 -- 172.21.15.78:0/52580284 >> v1:172.21.15.187:6789/0 conn(0x7f00540d11b0 legacy=0x7f00540cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f0052ffd700 1 -- 172.21.15.78:0/52580284 >> v1:172.21.15.78:6789/0 conn(0x7f005415c9f0 legacy=0x7f0054160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.418+0000 7f0052ffd700 1 -- 172.21.15.78:0/52580284 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054161050 con 0x7f005406d790 2023-06-09T20:19:15.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f0052ffd700 1 --2- 172.21.15.78:0/52580284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f005406d790 0x7f00540d0c70 secure :-1 s=READY pgs=3236 cs=0 l=1 rev1=1 crypto rx=0x7f0048009850 tx=0x7f0048009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b277a024ce1c2a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:15.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f00527fc700 1 -- 172.21.15.78:0/52580284 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044001670 con 0x7f005406d790 2023-06-09T20:19:15.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f00527fc700 1 -- 172.21.15.78:0/52580284 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0048010590 con 0x7f005406d790 2023-06-09T20:19:15.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f00527fc700 1 -- 172.21.15.78:0/52580284 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0048010940 con 0x7f005406d790 2023-06-09T20:19:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f005a24a700 1 -- 172.21.15.78:0/52580284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f005406d790 msgr2=0x7f00540d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f005a24a700 1 --2- 172.21.15.78:0/52580284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f005406d790 0x7f00540d0c70 secure :-1 s=READY pgs=3236 cs=0 l=1 rev1=1 crypto rx=0x7f0048009850 tx=0x7f0048009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f005a24a700 1 -- 172.21.15.78:0/52580284 shutdown_connections 2023-06-09T20:19:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f005a24a700 1 --2- 172.21.15.78:0/52580284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f005406d790 0x7f00540d0c70 unknown :-1 s=CLOSED pgs=3236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f005a24a700 1 -- 172.21.15.78:0/52580284 >> 172.21.15.78:0/52580284 conn(0x7f00540b4c90 msgr2=0x7f00540b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f005a24a700 1 -- 172.21.15.78:0/52580284 shutdown_connections 2023-06-09T20:19:15.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.422+0000 7f005a24a700 1 -- 172.21.15.78:0/52580284 wait complete. 2023-06-09T20:19:15.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 Processor -- start 2023-06-09T20:19:15.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 -- start start 2023-06-09T20:19:15.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f005406d790 0x7f005414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00540d11b0 0x7f005415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f005415c9f0 0x7f005406dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541f3ad0 con 0x7f00540d11b0 2023-06-09T20:19:15.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541f2c80 con 0x7f005415c9f0 2023-06-09T20:19:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00541f2e70 con 0x7f005406d790 2023-06-09T20:19:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00540d11b0 0x7f005415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f00537fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f005406d790 0x7f005414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00540d11b0 0x7f005415f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54124/0 (socket says 172.21.15.78:54124) 2023-06-09T20:19:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 -- 172.21.15.78:0/1834921368 learned_addr learned my addr 172.21.15.78:0/1834921368 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:15.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 -- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f005406d790 msgr2=0x7f005414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f005406d790 0x7f005414c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 -- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f005415c9f0 msgr2=0x7f005406dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f005415c9f0 0x7f005406dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 -- 172.21.15.78:0/1834921368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480094b0 con 0x7f00540d11b0 2023-06-09T20:19:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f0052ffd700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00540d11b0 0x7f005415f050 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 crypto rx=0x7f0048013040 tx=0x7f0048004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f003bfff700 1 -- 172.21.15.78:0/1834921368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0048004610 con 0x7f00540d11b0 2023-06-09T20:19:15.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f003bfff700 1 -- 172.21.15.78:0/1834921368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00480036c0 con 0x7f00540d11b0 2023-06-09T20:19:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00540cd6f0 con 0x7f00540d11b0 2023-06-09T20:19:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f003bfff700 1 -- 172.21.15.78:0/1834921368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0048003a70 con 0x7f00540d11b0 2023-06-09T20:19:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.426+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0054161330 con 0x7f00540d11b0 2023-06-09T20:19:15.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.430+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005415cdc0 con 0x7f00540d11b0 2023-06-09T20:19:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.430+0000 7f003bfff700 1 -- 172.21.15.78:0/1834921368 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0048003bd0 con 0x7f00540d11b0 2023-06-09T20:19:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.430+0000 7f003bfff700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0040066320 0x7f00400687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.430+0000 7f003bfff700 1 -- 172.21.15.78:0/1834921368 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0048085260 con 0x7f00540d11b0 2023-06-09T20:19:15.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.434+0000 7f00537fe700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0040066320 0x7f00400687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.434+0000 7f00537fe700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0040066320 0x7f00400687d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f00440011e0 tx=0x7f0044001230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:15.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.438+0000 7f003bfff700 1 -- 172.21.15.78:0/1834921368 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0048052750 con 0x7f00540d11b0 2023-06-09T20:19:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.686+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00541f3c10 con 0x7f00540d11b0 2023-06-09T20:19:15.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f003bfff700 1 -- 172.21.15.78:0/1834921368 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00541f3c10 con 0x7f00540d11b0 2023-06-09T20:19:15.695 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-09T20:19:15.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0040066320 msgr2=0x7f00400687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0040066320 0x7f00400687d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f00440011e0 tx=0x7f0044001230 comp rx=0 tx=0).stop 2023-06-09T20:19:15.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00540d11b0 msgr2=0x7f005415f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00540d11b0 0x7f005415f050 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 crypto rx=0x7f0048013040 tx=0x7f0048004770 comp rx=0 tx=0).stop 2023-06-09T20:19:15.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 shutdown_connections 2023-06-09T20:19:15.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0040066320 0x7f00400687d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f005415c9f0 0x7f005406dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00540d11b0 0x7f005415f050 unknown :-1 s=CLOSED pgs=3237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 --2- 172.21.15.78:0/1834921368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f005406d790 0x7f005414c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 >> 172.21.15.78:0/1834921368 conn(0x7f00540b4c90 msgr2=0x7f00540d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:15.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 shutdown_connections 2023-06-09T20:19:15.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.690+0000 7f005a24a700 1 -- 172.21.15.78:0/1834921368 wait complete. 2023-06-09T20:19:15.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T20:19:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.906+0000 7f7c66271700 1 Processor -- start 2023-06-09T20:19:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.906+0000 7f7c66271700 1 -- start start 2023-06-09T20:19:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c66271700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c6015c920 0x7f7c600d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c66271700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c60070400 0x7f7c60160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c66271700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6006b0f0 0x7f7c6006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c66271700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6006ba70 con 0x7f7c60070400 2023-06-09T20:19:15.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c66271700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6015ccf0 con 0x7f7c6015c920 2023-06-09T20:19:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c66271700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60161320 con 0x7f7c6006b0f0 2023-06-09T20:19:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c6480e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6006b0f0 0x7f7c6006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c60070400 0x7f7c60160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c6480e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6006b0f0 0x7f7c6006b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50012/0 (socket says 172.21.15.78:50012) 2023-06-09T20:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c6480e700 1 -- 172.21.15.78:0/2335098960 learned_addr learned my addr 172.21.15.78:0/2335098960 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5ffff700 1 --2- 172.21.15.78:0/2335098960 >> v2:172.21.15.187:3300/0 conn(0x7f7c6015c920 0x7f7c600d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5f7fe700 1 -- 172.21.15.78:0/2335098960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6006b0f0 msgr2=0x7f7c6006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5f7fe700 1 --2- 172.21.15.78:0/2335098960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6006b0f0 0x7f7c6006b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5f7fe700 1 -- 172.21.15.78:0/2335098960 >> v2:172.21.15.187:3300/0 conn(0x7f7c6015c920 msgr2=0x7f7c600d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5f7fe700 1 --2- 172.21.15.78:0/2335098960 >> v2:172.21.15.187:3300/0 conn(0x7f7c6015c920 0x7f7c600d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5f7fe700 1 -- 172.21.15.78:0/2335098960 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600d14d0 con 0x7f7c60070400 2023-06-09T20:19:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5ffff700 1 --2- 172.21.15.78:0/2335098960 >> v2:172.21.15.187:3300/0 conn(0x7f7c6015c920 0x7f7c600d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5f7fe700 1 --2- 172.21.15.78:0/2335098960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 0x7f7c60160de0 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f7c6006bfc0 tx=0x7f7c50009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998fb63a6dcd0578 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5effd700 1 -- 172.21.15.78:0/2335098960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50011830 con 0x7f7c60070400 2023-06-09T20:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5effd700 1 -- 172.21.15.78:0/2335098960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50011990 con 0x7f7c60070400 2023-06-09T20:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.910+0000 7f7c5effd700 1 -- 172.21.15.78:0/2335098960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50011d20 con 0x7f7c60070400 2023-06-09T20:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 -- 172.21.15.78:0/2335098960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 msgr2=0x7f7c60160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 --2- 172.21.15.78:0/2335098960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 0x7f7c60160de0 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f7c6006bfc0 tx=0x7f7c50009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 -- 172.21.15.78:0/2335098960 shutdown_connections 2023-06-09T20:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 --2- 172.21.15.78:0/2335098960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6006b0f0 0x7f7c6006b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 --2- 172.21.15.78:0/2335098960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 0x7f7c60160de0 unknown :-1 s=CLOSED pgs=3238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 --2- 172.21.15.78:0/2335098960 >> v2:172.21.15.187:3300/0 conn(0x7f7c6015c920 0x7f7c600d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 -- 172.21.15.78:0/2335098960 >> 172.21.15.78:0/2335098960 conn(0x7f7c600d3c10 msgr2=0x7f7c600cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 -- 172.21.15.78:0/2335098960 shutdown_connections 2023-06-09T20:19:15.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.914+0000 7f7c66271700 1 -- 172.21.15.78:0/2335098960 wait complete. 2023-06-09T20:19:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 Processor -- start 2023-06-09T20:19:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 -- start start 2023-06-09T20:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c6006b0f0 0x7f7c6015e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 0x7f7c600ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6015c920 0x7f7c601f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015f0e0 con 0x7f7c60070400 2023-06-09T20:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015f3c0 con 0x7f7c6006b0f0 2023-06-09T20:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c66271700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015f6a0 con 0x7f7c6015c920 2023-06-09T20:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c6480e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6015c920 0x7f7c601f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 0x7f7c600ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c6006b0f0 0x7f7c6015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c6480e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6015c920 0x7f7c601f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50026/0 (socket says 172.21.15.78:50026) 2023-06-09T20:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c6480e700 1 -- 172.21.15.78:0/3637852718 learned_addr learned my addr 172.21.15.78:0/3637852718 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5ffff700 1 -- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6015c920 msgr2=0x7f7c601f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5ffff700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6015c920 0x7f7c601f15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5ffff700 1 -- 172.21.15.78:0/3637852718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 msgr2=0x7f7c600ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5ffff700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 0x7f7c600ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5ffff700 1 -- 172.21.15.78:0/3637852718 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540094b0 con 0x7f7c6006b0f0 2023-06-09T20:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c6480e700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6015c920 0x7f7c601f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.918+0000 7f7c5ffff700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c6006b0f0 0x7f7c6015e890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400e9b0 tx=0x7f7c5400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.922+0000 7f7c5cff9700 1 -- 172.21.15.78:0/3637852718 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400ee50 con 0x7f7c6006b0f0 2023-06-09T20:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.922+0000 7f7c5cff9700 1 -- 172.21.15.78:0/3637852718 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5400c850 con 0x7f7c6006b0f0 2023-06-09T20:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.922+0000 7f7c5cff9700 1 -- 172.21.15.78:0/3637852718 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400cc00 con 0x7f7c6006b0f0 2023-06-09T20:19:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.922+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c500094b0 con 0x7f7c6006b0f0 2023-06-09T20:19:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.922+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6006f920 con 0x7f7c6006b0f0 2023-06-09T20:19:15.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.926+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c600d17b0 con 0x7f7c6006b0f0 2023-06-09T20:19:15.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.934+0000 7f7c5cff9700 1 -- 172.21.15.78:0/3637852718 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c54013470 con 0x7f7c6006b0f0 2023-06-09T20:19:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.934+0000 7f7c5cff9700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7c4c066370 0x7f7c4c068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:15.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.934+0000 7f7c5cff9700 1 -- 172.21.15.78:0/3637852718 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7c54084480 con 0x7f7c6006b0f0 2023-06-09T20:19:15.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.938+0000 7f7c5f7fe700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7c4c066370 0x7f7c4c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:15.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.938+0000 7f7c5f7fe700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7c4c066370 0x7f7c4c068820 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7c50000c00 tx=0x7f7c50008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:15.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:15.950+0000 7f7c5cff9700 1 -- 172.21.15.78:0/3637852718 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7c540518c0 con 0x7f7c6006b0f0 2023-06-09T20:19:16.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:19:16.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:19:16.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.246+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c6006fc00 con 0x7f7c6006b0f0 2023-06-09T20:19:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.342+0000 7f7c5cff9700 1 -- 172.21.15.78:0/3637852718 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f7c54054ee0 con 0x7f7c6006b0f0 2023-06-09T20:19:16.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:16.350 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3399791462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3399791462},{"type":"v1","addr":"172.21.15.187:6837","nonce":3399791462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/658938311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":658938311},{"type":"v1","addr":"172.21.15.78:6834","nonce":658938311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/952789446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":952789446},{"type":"v1","addr":"172.21.15.78:6835","nonce":952789446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:13:12.092475+0000","modified":"2023-06-09T11:13:15.123169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5137":{"gid":5137,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.187:6835/1349991607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1349991607},{"type":"v1","addr":"172.21.15.187:6835","nonce":1349991607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T20:19:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7c4c066370 msgr2=0x7f7c4c068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7c4c066370 0x7f7c4c068820 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7c50000c00 tx=0x7f7c50008030 comp rx=0 tx=0).stop 2023-06-09T20:19:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c6006b0f0 msgr2=0x7f7c6015e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:16.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c6006b0f0 0x7f7c6015e890 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400e9b0 tx=0x7f7c5400ecc0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 shutdown_connections 2023-06-09T20:19:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7c4c066370 0x7f7c4c068820 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c6015c920 0x7f7c601f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c60070400 0x7f7c600ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 --2- 172.21.15.78:0/3637852718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c6006b0f0 0x7f7c6015e890 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 >> 172.21.15.78:0/3637852718 conn(0x7f7c600d3c10 msgr2=0x7f7c600b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 shutdown_connections 2023-06-09T20:19:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.346+0000 7f7c66271700 1 -- 172.21.15.78:0/3637852718 wait complete. 2023-06-09T20:19:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2023-06-09T20:19:16.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T20:19:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.614+0000 7f34d759e700 1 Processor -- start 2023-06-09T20:19:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 -- start start 2023-06-09T20:19:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 0x7f34d8070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f34d815c880 0x7f34d806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:16.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34d80c7cb0 0x7f34d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:16.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80c87a0 con 0x7f34d815c880 2023-06-09T20:19:16.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d8070590 con 0x7f34d80c7cb0 2023-06-09T20:19:16.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80c81e0 con 0x7f34d806fc80 2023-06-09T20:19:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f34d815c880 0x7f34d806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f34d815c880 0x7f34d806df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54164/0 (socket says 172.21.15.78:54164) 2023-06-09T20:19:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 -- 172.21.15.78:0/4057774379 learned_addr learned my addr 172.21.15.78:0/4057774379 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d6d9d700 1 --2- 172.21.15.78:0/4057774379 >> v2:172.21.15.187:3300/0 conn(0x7f34d80c7cb0 0x7f34d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 -- 172.21.15.78:0/4057774379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 msgr2=0x7f34d8070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 --2- 172.21.15.78:0/4057774379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 0x7f34d8070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 -- 172.21.15.78:0/4057774379 >> v2:172.21.15.187:3300/0 conn(0x7f34d80c7cb0 msgr2=0x7f34d806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 --2- 172.21.15.78:0/4057774379 >> v2:172.21.15.187:3300/0 conn(0x7f34d80c7cb0 0x7f34d806a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 -- 172.21.15.78:0/4057774379 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80c84c0 con 0x7f34d815c880 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d5d9b700 1 --2- 172.21.15.78:0/4057774379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d815c880 0x7f34d806df50 secure :-1 s=READY pgs=3239 cs=0 l=1 rev1=1 crypto rx=0x7f34d806d440 tx=0x7f34cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28e2afa7d19f3f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d559a700 1 -- 172.21.15.78:0/4057774379 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc011830 con 0x7f34d815c880 2023-06-09T20:19:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d559a700 1 -- 172.21.15.78:0/4057774379 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc011990 con 0x7f34d815c880 2023-06-09T20:19:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d559a700 1 -- 172.21.15.78:0/4057774379 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc011d20 con 0x7f34d815c880 2023-06-09T20:19:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 -- 172.21.15.78:0/4057774379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d815c880 msgr2=0x7f34d806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.618+0000 7f34d759e700 1 --2- 172.21.15.78:0/4057774379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d815c880 0x7f34d806df50 secure :-1 s=READY pgs=3239 cs=0 l=1 rev1=1 crypto rx=0x7f34d806d440 tx=0x7f34cc009bf0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.622+0000 7f34d759e700 1 -- 172.21.15.78:0/4057774379 shutdown_connections 2023-06-09T20:19:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.622+0000 7f34d759e700 1 --2- 172.21.15.78:0/4057774379 >> v2:172.21.15.187:3300/0 conn(0x7f34d80c7cb0 0x7f34d806a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.622+0000 7f34d759e700 1 --2- 172.21.15.78:0/4057774379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d815c880 0x7f34d806df50 unknown :-1 s=CLOSED pgs=3239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.622+0000 7f34d759e700 1 --2- 172.21.15.78:0/4057774379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 0x7f34d8070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.622+0000 7f34d759e700 1 -- 172.21.15.78:0/4057774379 >> 172.21.15.78:0/4057774379 conn(0x7f34d80cf870 msgr2=0x7f34d80cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.622+0000 7f34d759e700 1 -- 172.21.15.78:0/4057774379 shutdown_connections 2023-06-09T20:19:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.622+0000 7f34d759e700 1 -- 172.21.15.78:0/4057774379 wait complete. 2023-06-09T20:19:16.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.638+0000 7f34d759e700 1 Processor -- start 2023-06-09T20:19:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d759e700 1 -- start start 2023-06-09T20:19:16.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 0x7f34d814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:16.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d80c7cb0 0x7f34d80b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:16.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d815c880 0x7f34d815eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:16.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80b73a0 con 0x7f34d80c7cb0 2023-06-09T20:19:16.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d759e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80b6790 con 0x7f34d815c880 2023-06-09T20:19:16.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80b6a70 con 0x7f34d806fc80 2023-06-09T20:19:16.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d80c7cb0 0x7f34d80b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:16.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d80c7cb0 0x7f34d80b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54180/0 (socket says 172.21.15.78:54180) 2023-06-09T20:19:16.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 -- 172.21.15.78:0/2038736614 learned_addr learned my addr 172.21.15.78:0/2038736614 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:16.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d659c700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 0x7f34d814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:16.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d6d9d700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d815c880 0x7f34d815eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:16.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 -- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 msgr2=0x7f34d814c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:16.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 0x7f34d814c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 -- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d815c880 msgr2=0x7f34d815eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:16.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d815c880 0x7f34d815eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 -- 172.21.15.78:0/2038736614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009570 con 0x7f34d80c7cb0 2023-06-09T20:19:16.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d6d9d700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d815c880 0x7f34d815eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T20:19:16.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.642+0000 7f34d5d9b700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d80c7cb0 0x7f34d80b5d40 secure :-1 s=READY pgs=3240 cs=0 l=1 rev1=1 crypto rx=0x7f34cc014040 tx=0x7f34cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:16.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.646+0000 7f34c6ffd700 1 -- 172.21.15.78:0/2038736614 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc004520 con 0x7f34d80c7cb0 2023-06-09T20:19:16.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.646+0000 7f34c6ffd700 1 -- 172.21.15.78:0/2038736614 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc026070 con 0x7f34d80c7cb0 2023-06-09T20:19:16.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.646+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d806a350 con 0x7f34d80c7cb0 2023-06-09T20:19:16.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.646+0000 7f34c6ffd700 1 -- 172.21.15.78:0/2038736614 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc003900 con 0x7f34d80c7cb0 2023-06-09T20:19:16.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.646+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d806a070 con 0x7f34d80c7cb0 2023-06-09T20:19:16.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.646+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d806e490 con 0x7f34d80c7cb0 2023-06-09T20:19:16.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.646+0000 7f34c6ffd700 1 -- 172.21.15.78:0/2038736614 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34cc003a60 con 0x7f34d80c7cb0 2023-06-09T20:19:16.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.650+0000 7f34c6ffd700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34b8066340 0x7f34b80687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:16.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.650+0000 7f34c6ffd700 1 -- 172.21.15.78:0/2038736614 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f34cc028070 con 0x7f34d80c7cb0 2023-06-09T20:19:16.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.650+0000 7f34d659c700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34b8066340 0x7f34b80687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.650+0000 7f34d659c700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34b8066340 0x7f34b80687f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009ac0 tx=0x7f34c80091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:16.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.654+0000 7f34c6ffd700 1 -- 172.21.15.78:0/2038736614 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f34cc05b220 con 0x7f34d80c7cb0 2023-06-09T20:19:16.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.910+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34d80741c0 con 0x7f34d80c7cb0 2023-06-09T20:19:16.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.914+0000 7f34c6ffd700 1 -- 172.21.15.78:0/2038736614 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18308 (secure 0 0 0) 0x7f34cc05e840 con 0x7f34d80c7cb0 2023-06-09T20:19:16.921 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:16.921 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:50.349113+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:13:10.180078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T11:13:11.109063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.19","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T20:19:16.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34b8066340 msgr2=0x7f34b80687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:16.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34b8066340 0x7f34b80687f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009ac0 tx=0x7f34c80091c0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d80c7cb0 msgr2=0x7f34d80b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:16.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d80c7cb0 0x7f34d80b5d40 secure :-1 s=READY pgs=3240 cs=0 l=1 rev1=1 crypto rx=0x7f34cc014040 tx=0x7f34cc004770 comp rx=0 tx=0).stop 2023-06-09T20:19:16.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 shutdown_connections 2023-06-09T20:19:16.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f34b8066340 0x7f34b80687f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34d815c880 0x7f34d815eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d80c7cb0 0x7f34d80b5d40 unknown :-1 s=CLOSED pgs=3240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 --2- 172.21.15.78:0/2038736614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34d806fc80 0x7f34d814c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:16.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 >> 172.21.15.78:0/2038736614 conn(0x7f34d80cf870 msgr2=0x7f34d80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:16.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 shutdown_connections 2023-06-09T20:19:16.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:16.922+0000 7f34d759e700 1 -- 172.21.15.78:0/2038736614 wait complete. 2023-06-09T20:19:16.953 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T20:19:16.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T20:19:17.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d7fff700 1 Processor -- start 2023-06-09T20:19:17.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d7fff700 1 -- start start 2023-06-09T20:19:17.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8d80c7cb0 0x7fc8d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d7fff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80c87a0 con 0x7fc8d806fc80 2023-06-09T20:19:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d7fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80c81e0 con 0x7fc8d815c880 2023-06-09T20:19:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d7fff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d806e660 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8d80c7cb0 0x7fc8d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d6ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc8d806fc80 0x7fc8d8070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49390/0 (socket says 172.21.15.78:49390) 2023-06-09T20:19:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d77fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8d80c7cb0 0x7fc8d806a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54182/0 (socket says 172.21.15.78:54182) 2023-06-09T20:19:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d6ffd700 1 -- 172.21.15.78:0/3150709132 learned_addr learned my addr 172.21.15.78:0/3150709132 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d77fe700 1 -- 172.21.15.78:0/3150709132 >> v1:172.21.15.187:6789/0 conn(0x7fc8d815c880 legacy=0x7fc8d806df50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T20:19:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d77fe700 1 -- 172.21.15.78:0/3150709132 >> v1:172.21.15.78:6789/0 conn(0x7fc8d806fc80 legacy=0x7fc8d8070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.130+0000 7fc8d77fe700 1 -- 172.21.15.78:0/3150709132 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80c84c0 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d77fe700 1 --2- 172.21.15.78:0/3150709132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d806a870 secure :-1 s=READY pgs=3242 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009dc0 tx=0x7fc8d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731e3efb40faa587 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d5ffb700 1 -- 172.21.15.78:0/3150709132 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000e070 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d5ffb700 1 -- 172.21.15.78:0/3150709132 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000bb50 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d5ffb700 1 -- 172.21.15.78:0/3150709132 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0003a40 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d7fff700 1 -- 172.21.15.78:0/3150709132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 msgr2=0x7fc8d806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/3150709132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d806a870 secure :-1 s=READY pgs=3242 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009dc0 tx=0x7fc8d000b330 comp rx=0 tx=0).stop 2023-06-09T20:19:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d7fff700 1 -- 172.21.15.78:0/3150709132 shutdown_connections 2023-06-09T20:19:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/3150709132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d806a870 unknown :-1 s=CLOSED pgs=3242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d7fff700 1 -- 172.21.15.78:0/3150709132 >> 172.21.15.78:0/3150709132 conn(0x7fc8d80cf870 msgr2=0x7fc8d80cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d7fff700 1 -- 172.21.15.78:0/3150709132 shutdown_connections 2023-06-09T20:19:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.134+0000 7fc8d7fff700 1 -- 172.21.15.78:0/3150709132 wait complete. 2023-06-09T20:19:17.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 Processor -- start 2023-06-09T20:19:17.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 -- start start 2023-06-09T20:19:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8d806fc80 0x7fc8d81f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d8146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d815c880 0x7fc8d81f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b70a0 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b6d90 con 0x7fc8d815c880 2023-06-09T20:19:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d7fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d81f28b0 con 0x7fc8d806fc80 2023-06-09T20:19:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d8146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d8146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54188/0 (socket says 172.21.15.78:54188) 2023-06-09T20:19:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d815c880 0x7fc8d81f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 -- 172.21.15.78:0/2730826653 learned_addr learned my addr 172.21.15.78:0/2730826653 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d6ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8d806fc80 0x7fc8d81f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 -- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8d806fc80 msgr2=0x7fc8d81f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8d806fc80 0x7fc8d81f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 -- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d815c880 msgr2=0x7fc8d81f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d815c880 0x7fc8d81f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.138+0000 7fc8d67fc700 1 -- 172.21.15.78:0/2730826653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0009a70 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.142+0000 7fc8d67fc700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d8146400 secure :-1 s=READY pgs=3243 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00b4a0 tx=0x7fc8cc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.142+0000 7fc8bffff700 1 -- 172.21.15.78:0/2730826653 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc011830 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.142+0000 7fc8bffff700 1 -- 172.21.15.78:0/2730826653 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc0119b0 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.142+0000 7fc8bffff700 1 -- 172.21.15.78:0/2730826653 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc011d60 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.142+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d806a350 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.142+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d806a070 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.142+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d806adb0 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.170+0000 7fc8bffff700 1 -- 172.21.15.78:0/2730826653 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8cc01a400 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.174+0000 7fc8bffff700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc8c4066340 0x7fc8c40687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.174+0000 7fc8bffff700 1 -- 172.21.15.78:0/2730826653 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc8cc084150 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.174+0000 7fc8d6ffd700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc8c4066340 0x7fc8c40687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.174+0000 7fc8d6ffd700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc8c4066340 0x7fc8c40687f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8005930 tx=0x7fc8c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:17.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.174+0000 7fc8bffff700 1 -- 172.21.15.78:0/2730826653 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc8cc0516d0 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.494+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8d80741c0 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.498+0000 7fc8bffff700 1 -- 172.21.15.78:0/2730826653 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fc8cc054cf0 con 0x7fc8d80c7cb0 2023-06-09T20:19:17.504 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:17.504 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3399791462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3399791462},{"type":"v1","addr":"172.21.15.187:6837","nonce":3399791462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/658938311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":658938311},{"type":"v1","addr":"172.21.15.78:6834","nonce":658938311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/952789446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":952789446},{"type":"v1","addr":"172.21.15.78:6835","nonce":952789446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:13:12.092475+0000","modified":"2023-06-09T11:13:15.123169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5137":{"gid":5137,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.187:6835/1349991607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1349991607},{"type":"v1","addr":"172.21.15.187:6835","nonce":1349991607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T20:19:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc8c4066340 msgr2=0x7fc8c40687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc8c4066340 0x7fc8c40687f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8005930 tx=0x7fc8c8009040 comp rx=0 tx=0).stop 2023-06-09T20:19:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 msgr2=0x7fc8d8146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d8146400 secure :-1 s=READY pgs=3243 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00b4a0 tx=0x7fc8cc00b7b0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 shutdown_connections 2023-06-09T20:19:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fc8c4066340 0x7fc8c40687f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d815c880 0x7fc8d81f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d80c7cb0 0x7fc8d8146400 unknown :-1 s=CLOSED pgs=3243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 --2- 172.21.15.78:0/2730826653 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8d806fc80 0x7fc8d81f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 >> 172.21.15.78:0/2730826653 conn(0x7fc8d80cf870 msgr2=0x7fc8d80c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:17.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 shutdown_connections 2023-06-09T20:19:17.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.502+0000 7fc8d7fff700 1 -- 172.21.15.78:0/2730826653 wait complete. 2023-06-09T20:19:17.509 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2023-06-09T20:19:17.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T20:19:17.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda32a91700 1 Processor -- start 2023-06-09T20:19:17.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda32a91700 1 -- start start 2023-06-09T20:19:17.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda32a91700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda2c0c1ce0 0x7fda2c06f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda32a91700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c164700 con 0x7fda2c160db0 2023-06-09T20:19:17.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda32a91700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c164950 con 0x7fda2c06d8d0 2023-06-09T20:19:17.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda32a91700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c1655d0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda3082d700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fda2c06d8d0 0x7fda2c06dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:57080/0 (socket says 172.21.15.78:57080) 2023-06-09T20:19:17.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.722+0000 7fda3082d700 1 -- 172.21.15.78:0/1458883390 learned_addr learned my addr 172.21.15.78:0/1458883390 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:17.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda3102e700 1 --2- 172.21.15.78:0/1458883390 >> v2:172.21.15.78:3300/0 conn(0x7fda2c0c1ce0 0x7fda2c06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda2b7fe700 1 -- 172.21.15.78:0/1458883390 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103219437 0 0) 0x7fda2c164950 con 0x7fda2c06d8d0 2023-06-09T20:19:17.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda2b7fe700 1 -- 172.21.15.78:0/1458883390 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda1c0035d0 con 0x7fda2c06d8d0 2023-06-09T20:19:17.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda3102e700 1 -- 172.21.15.78:0/1458883390 >> v1:172.21.15.187:6789/0 conn(0x7fda2c06d8d0 legacy=0x7fda2c06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda3102e700 1 -- 172.21.15.78:0/1458883390 >> v1:172.21.15.78:6789/0 conn(0x7fda2c160db0 legacy=0x7fda2c161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda3102e700 1 -- 172.21.15.78:0/1458883390 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c164c30 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda3102e700 1 --2- 172.21.15.78:0/1458883390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c06f880 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7fda24009d90 tx=0x7fda2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8783936580b3e42 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:17.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda2b7fe700 1 -- 172.21.15.78:0/1458883390 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400e070 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda2b7fe700 1 -- 172.21.15.78:0/1458883390 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400bb20 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda2b7fe700 1 -- 172.21.15.78:0/1458883390 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24012430 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda32a91700 1 -- 172.21.15.78:0/1458883390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 msgr2=0x7fda2c06f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda32a91700 1 --2- 172.21.15.78:0/1458883390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c06f880 secure :-1 s=READY pgs=3245 cs=0 l=1 rev1=1 crypto rx=0x7fda24009d90 tx=0x7fda2400b330 comp rx=0 tx=0).stop 2023-06-09T20:19:17.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda32a91700 1 -- 172.21.15.78:0/1458883390 shutdown_connections 2023-06-09T20:19:17.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda32a91700 1 --2- 172.21.15.78:0/1458883390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c06f880 unknown :-1 s=CLOSED pgs=3245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda32a91700 1 -- 172.21.15.78:0/1458883390 >> 172.21.15.78:0/1458883390 conn(0x7fda2c0b1440 msgr2=0x7fda2c0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda32a91700 1 -- 172.21.15.78:0/1458883390 shutdown_connections 2023-06-09T20:19:17.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.726+0000 7fda32a91700 1 -- 172.21.15.78:0/1458883390 wait complete. 2023-06-09T20:19:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 Processor -- start 2023-06-09T20:19:17.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 -- start start 2023-06-09T20:19:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda2c06d8d0 0x7fda2c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c0c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda2c160db0 0x7fda2c163400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c07d0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c0430 con 0x7fda2c160db0 2023-06-09T20:19:17.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.730+0000 7fda32a91700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c3130 con 0x7fda2c06d8d0 2023-06-09T20:19:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda2bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c0c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda3102e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda2c160db0 0x7fda2c163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda3102e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda2c160db0 0x7fda2c163400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36574/0 (socket says 172.21.15.78:36574) 2023-06-09T20:19:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda3102e700 1 -- 172.21.15.78:0/789109642 learned_addr learned my addr 172.21.15.78:0/789109642 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda3082d700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda2c06d8d0 0x7fda2c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda2bfff700 1 -- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda2c06d8d0 msgr2=0x7fda2c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda2bfff700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda2c06d8d0 0x7fda2c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda2bfff700 1 -- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda2c160db0 msgr2=0x7fda2c163400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda2bfff700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda2c160db0 0x7fda2c163400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda2bfff700 1 -- 172.21.15.78:0/789109642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24009a70 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda2bfff700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c0c2770 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c480 tx=0x7fda2000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda297fa700 1 -- 172.21.15.78:0/789109642 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200052d0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda297fa700 1 -- 172.21.15.78:0/789109642 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20005430 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c1651f0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda297fa700 1 -- 172.21.15.78:0/789109642 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200055a0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c164f10 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.734+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c06ead0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.738+0000 7fda297fa700 1 -- 172.21.15.78:0/789109642 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda200038e0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.738+0000 7fda297fa700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda10066320 0x7fda100687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:17.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.738+0000 7fda3082d700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda10066320 0x7fda100687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:17.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.738+0000 7fda297fa700 1 -- 172.21.15.78:0/789109642 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fda200580a0 con 0x7fda2c0c1ce0 2023-06-09T20:19:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.742+0000 7fda3082d700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda10066320 0x7fda100687d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fda18007fd0 tx=0x7fda18007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:17.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:17.746+0000 7fda297fa700 1 -- 172.21.15.78:0/789109642 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fda20050bb0 con 0x7fda2c0c1ce0 2023-06-09T20:19:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.042+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda2c0741c0 con 0x7fda2c0c1ce0 2023-06-09T20:19:18.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.046+0000 7fda297fa700 1 -- 172.21.15.78:0/789109642 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fda20050d50 con 0x7fda2c0c1ce0 2023-06-09T20:19:18.051 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:18.051 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3399791462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3399791462},{"type":"v1","addr":"172.21.15.187:6837","nonce":3399791462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/658938311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":658938311},{"type":"v1","addr":"172.21.15.78:6834","nonce":658938311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/952789446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":952789446},{"type":"v1","addr":"172.21.15.78:6835","nonce":952789446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T11:13:12.092475+0000","modified":"2023-06-09T11:13:15.123169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5137":{"gid":5137,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.187:6835/1349991607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1349991607},{"type":"v1","addr":"172.21.15.187:6835","nonce":1349991607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T20:19:18.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda10066320 msgr2=0x7fda100687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda10066320 0x7fda100687d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fda18007fd0 tx=0x7fda18007de0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 msgr2=0x7fda2c0c2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c0c2770 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c480 tx=0x7fda2000c790 comp rx=0 tx=0).stop 2023-06-09T20:19:18.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 shutdown_connections 2023-06-09T20:19:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda10066320 0x7fda100687d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda2c160db0 0x7fda2c163400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c0c1ce0 0x7fda2c0c2770 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 --2- 172.21.15.78:0/789109642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda2c06d8d0 0x7fda2c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 >> 172.21.15.78:0/789109642 conn(0x7fda2c0b1440 msgr2=0x7fda2c0cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 shutdown_connections 2023-06-09T20:19:18.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.050+0000 7fda32a91700 1 -- 172.21.15.78:0/789109642 wait complete. 2023-06-09T20:19:18.058 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 16 2023-06-09T20:19:18.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T20:19:18.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.274+0000 7f7191476700 1 Processor -- start 2023-06-09T20:19:18.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.274+0000 7f7191476700 1 -- start start 2023-06-09T20:19:18.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f718c06fc80 0x7f718c070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f718c0c7cb0 0x7f718c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c0c87a0 con 0x7f718c15c880 2023-06-09T20:19:18.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c06e660 con 0x7f718c06fc80 2023-06-09T20:19:18.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c070590 con 0x7f718c0c7cb0 2023-06-09T20:19:18.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f718c06fc80 0x7f718c070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f718c06fc80 0x7f718c070050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54208/0 (socket says 172.21.15.78:54208) 2023-06-09T20:19:18.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 -- 172.21.15.78:0/2110672097 learned_addr learned my addr 172.21.15.78:0/2110672097 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:18.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7190c75700 1 --2- 172.21.15.78:0/2110672097 >> v2:172.21.15.187:3300/0 conn(0x7f718c0c7cb0 0x7f718c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 -- 172.21.15.78:0/2110672097 >> v2:172.21.15.187:3300/0 conn(0x7f718c0c7cb0 msgr2=0x7f718c06a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:18.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 --2- 172.21.15.78:0/2110672097 >> v2:172.21.15.187:3300/0 conn(0x7f718c0c7cb0 0x7f718c06a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 -- 172.21.15.78:0/2110672097 >> v1:172.21.15.187:6789/0 conn(0x7f718c15c880 legacy=0x7f718c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 -- 172.21.15.78:0/2110672097 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c0c81e0 con 0x7f718c06fc80 2023-06-09T20:19:18.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718affd700 1 -- 172.21.15.78:0/2110672097 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702012452 0 0) 0x7f718c0c87a0 con 0x7f718c15c880 2023-06-09T20:19:18.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718bfff700 1 --2- 172.21.15.78:0/2110672097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c070050 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f7180009910 tx=0x7f7180009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cae1309fe441d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:18.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718affd700 1 -- 172.21.15.78:0/2110672097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180011830 con 0x7f718c06fc80 2023-06-09T20:19:18.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718affd700 1 -- 172.21.15.78:0/2110672097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7180011990 con 0x7f718c06fc80 2023-06-09T20:19:18.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f718affd700 1 -- 172.21.15.78:0/2110672097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180011d40 con 0x7f718c06fc80 2023-06-09T20:19:18.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- 172.21.15.78:0/2110672097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 msgr2=0x7f718c070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 --2- 172.21.15.78:0/2110672097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c070050 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7f7180009910 tx=0x7f7180009c20 comp rx=0 tx=0).stop 2023-06-09T20:19:18.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- 172.21.15.78:0/2110672097 shutdown_connections 2023-06-09T20:19:18.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 --2- 172.21.15.78:0/2110672097 >> v2:172.21.15.187:3300/0 conn(0x7f718c0c7cb0 0x7f718c06a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 --2- 172.21.15.78:0/2110672097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c070050 unknown :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- 172.21.15.78:0/2110672097 >> 172.21.15.78:0/2110672097 conn(0x7f718c0cf870 msgr2=0x7f718c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:18.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- 172.21.15.78:0/2110672097 shutdown_connections 2023-06-09T20:19:18.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.278+0000 7f7191476700 1 -- 172.21.15.78:0/2110672097 wait complete. 2023-06-09T20:19:18.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.282+0000 7f7191476700 1 Processor -- start 2023-06-09T20:19:18.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.282+0000 7f7191476700 1 -- start start 2023-06-09T20:19:18.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c1603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f718c0c7cb0 0x7f718c1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f718c15c880 0x7f718c1f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c161040 con 0x7f718c06fc80 2023-06-09T20:19:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c15d120 con 0x7f718c15c880 2023-06-09T20:19:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c159c20 con 0x7f718c0c7cb0 2023-06-09T20:19:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c1603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c1603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54220/0 (socket says 172.21.15.78:54220) 2023-06-09T20:19:18.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 -- 172.21.15.78:0/1014190816 learned_addr learned my addr 172.21.15.78:0/1014190816 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7190c75700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f718c15c880 0x7f718c1f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718b7fe700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f718c0c7cb0 0x7f718c1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 -- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f718c0c7cb0 msgr2=0x7f718c1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f718c0c7cb0 0x7f718c1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 -- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f718c15c880 msgr2=0x7f718c1f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f718c15c880 0x7f718c1f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 -- 172.21.15.78:0/1014190816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009570 con 0x7f718c06fc80 2023-06-09T20:19:18.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7190c75700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f718c15c880 0x7f718c1f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T20:19:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f718bfff700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c1603f0 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b5b00 tx=0x7f7180004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7188ff9700 1 -- 172.21.15.78:0/1014190816 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718001aac0 con 0x7f718c06fc80 2023-06-09T20:19:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7188ff9700 1 -- 172.21.15.78:0/1014190816 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718001f070 con 0x7f718c06fc80 2023-06-09T20:19:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7188ff9700 1 -- 172.21.15.78:0/1014190816 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718001ae80 con 0x7f718c06fc80 2023-06-09T20:19:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c06a070 con 0x7f718c06fc80 2023-06-09T20:19:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.286+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c0c84c0 con 0x7f718c06fc80 2023-06-09T20:19:18.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.290+0000 7f7188ff9700 1 -- 172.21.15.78:0/1014190816 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f718001b430 con 0x7f718c06fc80 2023-06-09T20:19:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.294+0000 7f7188ff9700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f71780663c0 0x7f7178068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.294+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c06a350 con 0x7f718c06fc80 2023-06-09T20:19:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.294+0000 7f7188ff9700 1 -- 172.21.15.78:0/1014190816 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7180084e40 con 0x7f718c06fc80 2023-06-09T20:19:18.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.298+0000 7f718b7fe700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f71780663c0 0x7f7178068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.298+0000 7f718b7fe700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f71780663c0 0x7f7178068870 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f718c0d25b0 tx=0x7f717c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:18.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.302+0000 7f7188ff9700 1 -- 172.21.15.78:0/1014190816 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7180015080 con 0x7f718c06fc80 2023-06-09T20:19:18.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.549+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f718c0741c0 con 0x7f718c06fc80 2023-06-09T20:19:18.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.549+0000 7f7188ff9700 1 -- 172.21.15.78:0/1014190816 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18308 (secure 0 0 0) 0x7f7180021020 con 0x7f718c06fc80 2023-06-09T20:19:18.558 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:18.558 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T11:13:50.349113+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-09T11:13:10.180078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-09T11:13:11.109063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.19","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T20:19:18.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f71780663c0 msgr2=0x7f7178068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f71780663c0 0x7f7178068870 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f718c0d25b0 tx=0x7f717c009040 comp rx=0 tx=0).stop 2023-06-09T20:19:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 msgr2=0x7f718c1603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c1603f0 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7f718c0b5b00 tx=0x7f7180004770 comp rx=0 tx=0).stop 2023-06-09T20:19:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 shutdown_connections 2023-06-09T20:19:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f71780663c0 0x7f7178068870 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f718c15c880 0x7f718c1f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f718c0c7cb0 0x7f718c1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 --2- 172.21.15.78:0/1014190816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718c06fc80 0x7f718c1603f0 unknown :-1 s=CLOSED pgs=3248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 >> 172.21.15.78:0/1014190816 conn(0x7f718c0cf870 msgr2=0x7f718c15a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:18.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.553+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 shutdown_connections 2023-06-09T20:19:18.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.557+0000 7f7191476700 1 -- 172.21.15.78:0/1014190816 wait complete. 2023-06-09T20:19:18.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-09T20:19:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f29017a7700 1 Processor -- start 2023-06-09T20:19:18.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f29017a7700 1 -- start start 2023-06-09T20:19:18.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f29017a7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28fc15c880 0x7f28fc06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f29017a7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc0c7cb0 0x7f28fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f29017a7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc0c87a0 con 0x7f28fc06fc80 2023-06-09T20:19:18.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f29017a7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0c81e0 con 0x7f28fc15c880 2023-06-09T20:19:18.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f29017a7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0c84c0 con 0x7f28fc0c7cb0 2023-06-09T20:19:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f28fa7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28fc15c880 0x7f28fc06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f28faffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f28fc06fc80 0x7f28fc070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49398/0 (socket says 172.21.15.78:49398) 2023-06-09T20:19:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.761+0000 7f28faffd700 1 -- 172.21.15.78:0/3870742861 learned_addr learned my addr 172.21.15.78:0/3870742861 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28fb7fe700 1 --2- 172.21.15.78:0/3870742861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc0c7cb0 0x7f28fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28f9ffb700 1 -- 172.21.15.78:0/3870742861 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678317439 0 0) 0x7f28fc0c87a0 con 0x7f28fc06fc80 2023-06-09T20:19:18.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28f9ffb700 1 -- 172.21.15.78:0/3870742861 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e40035d0 con 0x7f28fc06fc80 2023-06-09T20:19:18.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28fa7fc700 1 -- 172.21.15.78:0/3870742861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc0c7cb0 msgr2=0x7f28fc06a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:18.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28fa7fc700 1 --2- 172.21.15.78:0/3870742861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc0c7cb0 0x7f28fc06a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28fa7fc700 1 -- 172.21.15.78:0/3870742861 >> v1:172.21.15.78:6789/0 conn(0x7f28fc06fc80 legacy=0x7f28fc070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28fa7fc700 1 -- 172.21.15.78:0/3870742861 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc06a070 con 0x7f28fc15c880 2023-06-09T20:19:18.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28fa7fc700 1 --2- 172.21.15.78:0/3870742861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc06df50 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009880 tx=0x7f28f0009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39596e1d575b6ab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:18.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28f9ffb700 1 -- 172.21.15.78:0/3870742861 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0011830 con 0x7f28fc15c880 2023-06-09T20:19:18.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28f9ffb700 1 -- 172.21.15.78:0/3870742861 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f0011990 con 0x7f28fc15c880 2023-06-09T20:19:18.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f28f9ffb700 1 -- 172.21.15.78:0/3870742861 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0011d20 con 0x7f28fc15c880 2023-06-09T20:19:18.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f29017a7700 1 -- 172.21.15.78:0/3870742861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 msgr2=0x7f28fc06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.765+0000 7f29017a7700 1 --2- 172.21.15.78:0/3870742861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc06df50 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009880 tx=0x7f28f0009b90 comp rx=0 tx=0).stop 2023-06-09T20:19:18.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 -- 172.21.15.78:0/3870742861 shutdown_connections 2023-06-09T20:19:18.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 --2- 172.21.15.78:0/3870742861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc0c7cb0 0x7f28fc06a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 --2- 172.21.15.78:0/3870742861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc06df50 unknown :-1 s=CLOSED pgs=3250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 -- 172.21.15.78:0/3870742861 >> 172.21.15.78:0/3870742861 conn(0x7f28fc0cf870 msgr2=0x7f28fc0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:18.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 -- 172.21.15.78:0/3870742861 shutdown_connections 2023-06-09T20:19:18.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 -- 172.21.15.78:0/3870742861 wait complete. 2023-06-09T20:19:18.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 Processor -- start 2023-06-09T20:19:18.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.769+0000 7f29017a7700 1 -- start start 2023-06-09T20:19:18.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc06fc80 0x7f28fc1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28fc0c7cb0 0x7f28fc15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc15cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc15e0e0 con 0x7f28fc15c880 2023-06-09T20:19:18.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1f50e0 con 0x7f28fc0c7cb0 2023-06-09T20:19:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc15d1c0 con 0x7f28fc06fc80 2023-06-09T20:19:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc06fc80 0x7f28fc1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28fb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc15cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc06fc80 0x7f28fc1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50092/0 (socket says 172.21.15.78:50092) 2023-06-09T20:19:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 -- 172.21.15.78:0/1138906274 learned_addr learned my addr 172.21.15.78:0/1138906274 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:18.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28fa7fc700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28fc0c7cb0 0x7f28fc15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 -- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28fc0c7cb0 msgr2=0x7f28fc15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28fc0c7cb0 0x7f28fc15fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 -- 172.21.15.78:0/1138906274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 msgr2=0x7f28fc15cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc15cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 -- 172.21.15.78:0/1138906274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00094b0 con 0x7f28fc06fc80 2023-06-09T20:19:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28fb7fe700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc15cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28faffd700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc06fc80 0x7f28fc1532a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c700 tx=0x7f28ec00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28e37fe700 1 -- 172.21.15.78:0/1138906274 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec005d90 con 0x7f28fc06fc80 2023-06-09T20:19:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28e37fe700 1 -- 172.21.15.78:0/1138906274 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec0070d0 con 0x7f28fc06fc80 2023-06-09T20:19:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc06e490 con 0x7f28fc06fc80 2023-06-09T20:19:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f28e37fe700 1 -- 172.21.15.78:0/1138906274 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec007480 con 0x7f28fc06fc80 2023-06-09T20:19:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.773+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc06a350 con 0x7f28fc06fc80 2023-06-09T20:19:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.777+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc15e220 con 0x7f28fc06fc80 2023-06-09T20:19:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.777+0000 7f28e37fe700 1 -- 172.21.15.78:0/1138906274 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28ec0075e0 con 0x7f28fc06fc80 2023-06-09T20:19:18.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.777+0000 7f28e37fe700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f28e80662f0 0x7f28e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:18.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.777+0000 7f28e37fe700 1 -- 172.21.15.78:0/1138906274 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f28ec083460 con 0x7f28fc06fc80 2023-06-09T20:19:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.781+0000 7f28fa7fc700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f28e80662f0 0x7f28e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.781+0000 7f28fa7fc700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f28e80662f0 0x7f28e80687a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000c00 tx=0x7f28f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:18.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:18.797+0000 7f28e37fe700 1 -- 172.21.15.78:0/1138906274 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f28ec050930 con 0x7f28fc06fc80 2023-06-09T20:19:19.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:19.117+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f28fc15e220 con 0x7f28fc06fc80 2023-06-09T20:19:19.746 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-06-09T20:19:19.741+0000 7f8526350700 -1 mds.0.12 we have been blocklisted (fenced), respawning... 2023-06-09T20:19:19.785 INFO:tasks.ceph.mds.b.smithi187.stderr: -1> 2023-06-09T20:19:19.741+0000 7f8526350700 -1 mds.0.12 we have been blocklisted (fenced), respawning... 2023-06-09T20:19:20.058 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-06-09T20:19:20.049+0000 7f67899f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-09T20:19:20.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.117+0000 7f28e37fe700 1 -- 172.21.15.78:0/1138906274 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f28fc15e220 con 0x7f28fc06fc80 2023-06-09T20:19:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f28e80662f0 msgr2=0x7f28e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f28e80662f0 0x7f28e80687a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000c00 tx=0x7f28f0008030 comp rx=0 tx=0).stop 2023-06-09T20:19:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc06fc80 msgr2=0x7f28fc1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc06fc80 0x7f28fc1532a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c700 tx=0x7f28ec00ca10 comp rx=0 tx=0).stop 2023-06-09T20:19:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 shutdown_connections 2023-06-09T20:19:20.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f28e80662f0 0x7f28e80687a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28fc15c880 0x7f28fc15cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28fc0c7cb0 0x7f28fc15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 --2- 172.21.15.78:0/1138906274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28fc06fc80 0x7f28fc1532a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 >> 172.21.15.78:0/1138906274 conn(0x7f28fc0cf870 msgr2=0x7f28fc070050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:20.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 shutdown_connections 2023-06-09T20:19:20.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.121+0000 7f29017a7700 1 -- 172.21.15.78:0/1138906274 wait complete. 2023-06-09T20:19:20.133 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-09T20:19:20.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-09T20:19:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.321+0000 7f7a7ffff700 1 Processor -- start 2023-06-09T20:19:20.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.325+0000 7f7a7ffff700 1 -- start start 2023-06-09T20:19:20.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.325+0000 7f7a7ffff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7a8006bd70 0x7f7a8006a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:20.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a80142e20 con 0x7f7a8006e6a0 2023-06-09T20:19:20.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8006acd0 con 0x7f7a80142a50 2023-06-09T20:19:20.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8006afb0 con 0x7f7a8006bd70 2023-06-09T20:19:20.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7a8006e6a0 0x7f7a801431f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49400/0 (socket says 172.21.15.78:49400) 2023-06-09T20:19:20.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7f7fe700 1 -- 172.21.15.78:0/249622226 learned_addr learned my addr 172.21.15.78:0/249622226 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:20.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7e7fc700 1 --2- 172.21.15.78:0/249622226 >> v2:172.21.15.187:3300/0 conn(0x7f7a8006bd70 0x7f7a8006a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:20.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7dffb700 1 -- 172.21.15.78:0/249622226 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095218420 0 0) 0x7f7a80142e20 con 0x7f7a8006e6a0 2023-06-09T20:19:20.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7dffb700 1 -- 172.21.15.78:0/249622226 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a680035d0 con 0x7f7a8006e6a0 2023-06-09T20:19:20.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7dffb700 1 -- 172.21.15.78:0/249622226 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464270818 0 0) 0x7f7a8006acd0 con 0x7f7a80142a50 2023-06-09T20:19:20.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7dffb700 1 -- 172.21.15.78:0/249622226 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a80142e20 con 0x7f7a80142a50 2023-06-09T20:19:20.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7e7fc700 1 -- 172.21.15.78:0/249622226 >> v1:172.21.15.187:6789/0 conn(0x7f7a80142a50 legacy=0x7f7a800b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:20.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7e7fc700 1 -- 172.21.15.78:0/249622226 >> v1:172.21.15.78:6789/0 conn(0x7f7a8006e6a0 legacy=0x7f7a801431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:20.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7e7fc700 1 -- 172.21.15.78:0/249622226 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8006b290 con 0x7f7a8006bd70 2023-06-09T20:19:20.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7e7fc700 1 --2- 172.21.15.78:0/249622226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006bd70 0x7f7a8006a680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009850 tx=0x7f7a74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa1e589c34202cc8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:20.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7dffb700 1 -- 172.21.15.78:0/249622226 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74011830 con 0x7f7a8006bd70 2023-06-09T20:19:20.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7dffb700 1 -- 172.21.15.78:0/249622226 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a74011990 con 0x7f7a8006bd70 2023-06-09T20:19:20.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7dffb700 1 -- 172.21.15.78:0/249622226 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74011d40 con 0x7f7a8006bd70 2023-06-09T20:19:20.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- 172.21.15.78:0/249622226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006bd70 msgr2=0x7f7a8006a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:20.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/249622226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006bd70 0x7f7a8006a680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009850 tx=0x7f7a74009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- 172.21.15.78:0/249622226 shutdown_connections 2023-06-09T20:19:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/249622226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006bd70 0x7f7a8006a680 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- 172.21.15.78:0/249622226 >> 172.21.15.78:0/249622226 conn(0x7f7a800b5820 msgr2=0x7f7a800d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- 172.21.15.78:0/249622226 shutdown_connections 2023-06-09T20:19:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.329+0000 7f7a7ffff700 1 -- 172.21.15.78:0/249622226 wait complete. 2023-06-09T20:19:20.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 Processor -- start 2023-06-09T20:19:20.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 -- start start 2023-06-09T20:19:20.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a8006bd70 0x7f7a80140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006e6a0 0x7f7a8015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a80142a50 0x7f7a800d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8015ecb0 con 0x7f7a8006bd70 2023-06-09T20:19:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8015f610 con 0x7f7a8006e6a0 2023-06-09T20:19:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7ffff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8015e030 con 0x7f7a80142a50 2023-06-09T20:19:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a8006bd70 0x7f7a80140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a8006bd70 0x7f7a80140c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54248/0 (socket says 172.21.15.78:54248) 2023-06-09T20:19:20.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7effd700 1 -- 172.21.15.78:0/3657859366 learned_addr learned my addr 172.21.15.78:0/3657859366 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7e7fc700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006e6a0 0x7f7a8015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7f7fe700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a80142a50 0x7f7a800d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7effd700 1 -- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a80142a50 msgr2=0x7f7a800d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.333+0000 7f7a7effd700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a80142a50 0x7f7a800d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a7effd700 1 -- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006e6a0 msgr2=0x7f7a8015f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a7effd700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006e6a0 0x7f7a8015f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a7effd700 1 -- 172.21.15.78:0/3657859366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740094b0 con 0x7f7a8006bd70 2023-06-09T20:19:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a7effd700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a8006bd70 0x7f7a80140c10 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c490 tx=0x7f7a7000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a677fe700 1 -- 172.21.15.78:0/3657859366 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700052d0 con 0x7f7a8006bd70 2023-06-09T20:19:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a677fe700 1 -- 172.21.15.78:0/3657859366 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a70005450 con 0x7f7a8006bd70 2023-06-09T20:19:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a677fe700 1 -- 172.21.15.78:0/3657859366 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700038e0 con 0x7f7a8006bd70 2023-06-09T20:19:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8006b850 con 0x7f7a8006bd70 2023-06-09T20:19:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8006b570 con 0x7f7a8006bd70 2023-06-09T20:19:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.337+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8006eb20 con 0x7f7a8006bd70 2023-06-09T20:19:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.341+0000 7f7a677fe700 1 -- 172.21.15.78:0/3657859366 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a70003a40 con 0x7f7a8006bd70 2023-06-09T20:19:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.341+0000 7f7a677fe700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7a6c066320 0x7f7a6c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.341+0000 7f7a677fe700 1 -- 172.21.15.78:0/3657859366 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f7a700832e0 con 0x7f7a8006bd70 2023-06-09T20:19:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.341+0000 7f7a7e7fc700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7a6c066320 0x7f7a6c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:20.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.345+0000 7f7a7e7fc700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7a6c066320 0x7f7a6c0687d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7a740090b0 tx=0x7f7a74008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:20.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.349+0000 7f7a677fe700 1 -- 172.21.15.78:0/3657859366 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7a700505b0 con 0x7f7a8006bd70 2023-06-09T20:19:20.576 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-06-09T20:19:20.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:20.589+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7a801589e0 con 0x7f7a8006bd70 2023-06-09T20:19:21.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.225+0000 7f7a677fe700 1 -- 172.21.15.78:0/3657859366 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7a70053bd0 con 0x7f7a8006bd70 2023-06-09T20:19:21.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7a6c066320 msgr2=0x7f7a6c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:21.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7a6c066320 0x7f7a6c0687d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7a740090b0 tx=0x7f7a74008030 comp rx=0 tx=0).stop 2023-06-09T20:19:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a8006bd70 msgr2=0x7f7a80140c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a8006bd70 0x7f7a80140c10 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c490 tx=0x7f7a7000c7a0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 shutdown_connections 2023-06-09T20:19:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f7a6c066320 0x7f7a6c0687d0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a80142a50 0x7f7a800d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a8006e6a0 0x7f7a8015f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 --2- 172.21.15.78:0/3657859366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a8006bd70 0x7f7a80140c10 unknown :-1 s=CLOSED pgs=3252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 >> 172.21.15.78:0/3657859366 conn(0x7f7a800b5820 msgr2=0x7f7a80143580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 shutdown_connections 2023-06-09T20:19:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.229+0000 7f7a7ffff700 1 -- 172.21.15.78:0/3657859366 wait complete. 2023-06-09T20:19:21.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-09T20:19:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.437+0000 7ff65759e700 1 Processor -- start 2023-06-09T20:19:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.437+0000 7ff65759e700 1 -- start start 2023-06-09T20:19:21.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff65759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff65806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:21.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff65759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6580ce510 0x7ff65806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:21.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff65759e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65806e110 con 0x7ff65815aa80 2023-06-09T20:19:21.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff65759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65806b7b0 con 0x7ff6580ce510 2023-06-09T20:19:21.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff65759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65806efc0 con 0x7ff6580ce0c0 2023-06-09T20:19:21.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff655d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff65806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:21.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff656d9d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6580ce510 0x7ff65806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:21.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff655d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff65806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50108/0 (socket says 172.21.15.78:50108) 2023-06-09T20:19:21.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.441+0000 7ff655d9b700 1 -- 172.21.15.78:0/330078484 learned_addr learned my addr 172.21.15.78:0/330078484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:21.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff656d9d700 1 -- 172.21.15.78:0/330078484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 msgr2=0x7ff65806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff656d9d700 1 --2- 172.21.15.78:0/330078484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff65806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff656d9d700 1 -- 172.21.15.78:0/330078484 >> v1:172.21.15.187:6789/0 conn(0x7ff65815aa80 legacy=0x7ff65806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff656d9d700 1 -- 172.21.15.78:0/330078484 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65806a000 con 0x7ff6580ce510 2023-06-09T20:19:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff655d9b700 1 --2- 172.21.15.78:0/330078484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff65806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65559a700 1 -- 172.21.15.78:0/330078484 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812098945 0 0) 0x7ff65806e110 con 0x7ff65815aa80 2023-06-09T20:19:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff656d9d700 1 --2- 172.21.15.78:0/330078484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff65806dbd0 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7ff650009850 tx=0x7ff650009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9395611899dffd82 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:21.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65559a700 1 -- 172.21.15.78:0/330078484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650011830 con 0x7ff6580ce510 2023-06-09T20:19:21.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65559a700 1 -- 172.21.15.78:0/330078484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650011990 con 0x7ff6580ce510 2023-06-09T20:19:21.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65559a700 1 -- 172.21.15.78:0/330078484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650011d40 con 0x7ff6580ce510 2023-06-09T20:19:21.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 -- 172.21.15.78:0/330078484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 msgr2=0x7ff65806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:21.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 --2- 172.21.15.78:0/330078484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff65806dbd0 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7ff650009850 tx=0x7ff650009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:21.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 -- 172.21.15.78:0/330078484 shutdown_connections 2023-06-09T20:19:21.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 --2- 172.21.15.78:0/330078484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff65806dbd0 unknown :-1 s=CLOSED pgs=3254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 --2- 172.21.15.78:0/330078484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff65806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 -- 172.21.15.78:0/330078484 >> 172.21.15.78:0/330078484 conn(0x7ff6580b0780 msgr2=0x7ff6580b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:21.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 -- 172.21.15.78:0/330078484 shutdown_connections 2023-06-09T20:19:21.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.445+0000 7ff65759e700 1 -- 172.21.15.78:0/330078484 wait complete. 2023-06-09T20:19:21.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 Processor -- start 2023-06-09T20:19:21.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 -- start start 2023-06-09T20:19:21.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff6581f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:21.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff658159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:21.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65815aa80 0x7ff658147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:21.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff658149860 con 0x7ff6580ce510 2023-06-09T20:19:21.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6581468b0 con 0x7ff65815aa80 2023-06-09T20:19:21.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff65759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff658148be0 con 0x7ff6580ce0c0 2023-06-09T20:19:21.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.449+0000 7ff655d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff658159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:21.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff655d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff658159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54274/0 (socket says 172.21.15.78:54274) 2023-06-09T20:19:21.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff655d9b700 1 -- 172.21.15.78:0/3118189694 learned_addr learned my addr 172.21.15.78:0/3118189694 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:21.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff656d9d700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65815aa80 0x7ff658147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:21.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff65659c700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff6581f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:21.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff656d9d700 1 -- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 msgr2=0x7ff6581f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:21.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff656d9d700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff6581f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff656d9d700 1 -- 172.21.15.78:0/3118189694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 msgr2=0x7ff658159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:21.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff656d9d700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff658159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:21.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff656d9d700 1 -- 172.21.15.78:0/3118189694 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c009570 con 0x7ff65815aa80 2023-06-09T20:19:21.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff655d9b700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff658159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:21.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff656d9d700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65815aa80 0x7ff658147d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff650016000 tx=0x7ff650004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:21.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff646ffd700 1 -- 172.21.15.78:0/3118189694 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65001a990 con 0x7ff65815aa80 2023-06-09T20:19:21.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff646ffd700 1 -- 172.21.15.78:0/3118189694 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65001f070 con 0x7ff65815aa80 2023-06-09T20:19:21.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff646ffd700 1 -- 172.21.15.78:0/3118189694 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65001ad50 con 0x7ff65815aa80 2023-06-09T20:19:21.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6500094b0 con 0x7ff65815aa80 2023-06-09T20:19:21.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65806a5c0 con 0x7ff65815aa80 2023-06-09T20:19:21.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.453+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65806a2e0 con 0x7ff65815aa80 2023-06-09T20:19:21.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.473+0000 7ff646ffd700 1 -- 172.21.15.78:0/3118189694 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff65002e450 con 0x7ff65815aa80 2023-06-09T20:19:21.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.473+0000 7ff646ffd700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff6380662f0 0x7ff6380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:21.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.473+0000 7ff646ffd700 1 -- 172.21.15.78:0/3118189694 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ff6500850f0 con 0x7ff65815aa80 2023-06-09T20:19:21.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.477+0000 7ff65659c700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff6380662f0 0x7ff6380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:21.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.477+0000 7ff65659c700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff6380662f0 0x7ff6380687a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff648002230 tx=0x7ff648009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:21.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.481+0000 7ff646ffd700 1 -- 172.21.15.78:0/3118189694 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff6500525a0 con 0x7ff65815aa80 2023-06-09T20:19:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:21.657+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff65806a8a0 con 0x7ff65815aa80 2023-06-09T20:19:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.613+0000 7ff646ffd700 1 -- 172.21.15.78:0/3118189694 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff650055b80 con 0x7ff65815aa80 2023-06-09T20:19:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff6380662f0 msgr2=0x7ff6380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff6380662f0 0x7ff6380687a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff648002230 tx=0x7ff648009040 comp rx=0 tx=0).stop 2023-06-09T20:19:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65815aa80 msgr2=0x7ff658147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65815aa80 0x7ff658147d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff650016000 tx=0x7ff650004770 comp rx=0 tx=0).stop 2023-06-09T20:19:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 shutdown_connections 2023-06-09T20:19:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff6380662f0 0x7ff6380687a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65815aa80 0x7ff658147d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6580ce510 0x7ff658159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:22.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 --2- 172.21.15.78:0/3118189694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6580ce0c0 0x7ff6581f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 >> 172.21.15.78:0/3118189694 conn(0x7ff6580b0780 msgr2=0x7ff6581591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 shutdown_connections 2023-06-09T20:19:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.617+0000 7ff65759e700 1 -- 172.21.15.78:0/3118189694 wait complete. 2023-06-09T20:19:22.625 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-06-09T20:19:22.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-09T20:19:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe5953ce700 1 Processor -- start 2023-06-09T20:19:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe5953ce700 1 -- start start 2023-06-09T20:19:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe5953ce700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5901428c0 0x7fe59006a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe5953ce700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59006abc0 con 0x7fe5900b6a30 2023-06-09T20:19:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe5953ce700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59006ba00 con 0x7fe59006edb0 2023-06-09T20:19:22.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe5953ce700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59006adf0 con 0x7fe5901428c0 2023-06-09T20:19:22.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe58ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5901428c0 0x7fe59006a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:22.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe58f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe5900b6a30 0x7fe59006e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49404/0 (socket says 172.21.15.78:49404) 2023-06-09T20:19:22.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe58ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5901428c0 0x7fe59006a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54286/0 (socket says 172.21.15.78:54286) 2023-06-09T20:19:22.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.833+0000 7fe58f7fe700 1 -- 172.21.15.78:0/2507036425 learned_addr learned my addr 172.21.15.78:0/2507036425 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:22.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58ffff700 1 -- 172.21.15.78:0/2507036425 >> v1:172.21.15.187:6789/0 conn(0x7fe59006edb0 legacy=0x7fe5901431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:22.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58ffff700 1 -- 172.21.15.78:0/2507036425 >> v1:172.21.15.78:6789/0 conn(0x7fe5900b6a30 legacy=0x7fe59006e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:22.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58effd700 1 -- 172.21.15.78:0/2507036425 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293674043 0 0) 0x7fe59006abc0 con 0x7fe5900b6a30 2023-06-09T20:19:22.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58ffff700 1 -- 172.21.15.78:0/2507036425 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59006b0d0 con 0x7fe5901428c0 2023-06-09T20:19:22.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58ffff700 1 --2- 172.21.15.78:0/2507036425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe59006a680 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7fe580009850 tx=0x7fe580009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdda517198e3489 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:22.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58effd700 1 -- 172.21.15.78:0/2507036425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580011830 con 0x7fe5901428c0 2023-06-09T20:19:22.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58effd700 1 -- 172.21.15.78:0/2507036425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580011990 con 0x7fe5901428c0 2023-06-09T20:19:22.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe58effd700 1 -- 172.21.15.78:0/2507036425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580011d20 con 0x7fe5901428c0 2023-06-09T20:19:22.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe5953ce700 1 -- 172.21.15.78:0/2507036425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 msgr2=0x7fe59006a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:22.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe5953ce700 1 --2- 172.21.15.78:0/2507036425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe59006a680 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7fe580009850 tx=0x7fe580009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:22.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe5953ce700 1 -- 172.21.15.78:0/2507036425 shutdown_connections 2023-06-09T20:19:22.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe5953ce700 1 --2- 172.21.15.78:0/2507036425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe59006a680 unknown :-1 s=CLOSED pgs=3256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:22.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe5953ce700 1 -- 172.21.15.78:0/2507036425 >> 172.21.15.78:0/2507036425 conn(0x7fe5900b57d0 msgr2=0x7fe5900d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe5953ce700 1 -- 172.21.15.78:0/2507036425 shutdown_connections 2023-06-09T20:19:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.837+0000 7fe5953ce700 1 -- 172.21.15.78:0/2507036425 wait complete. 2023-06-09T20:19:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 Processor -- start 2023-06-09T20:19:22.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 -- start start 2023-06-09T20:19:22.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59006edb0 0x7fe59014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5900b6a30 0x7fe5900c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe5900c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900d13c0 con 0x7fe5901428c0 2023-06-09T20:19:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59014f7a0 con 0x7fe5900b6a30 2023-06-09T20:19:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe5953ce700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c8970 con 0x7fe59006edb0 2023-06-09T20:19:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe5900c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe58ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59006edb0 0x7fe59014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe5900c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54294/0 (socket says 172.21.15.78:54294) 2023-06-09T20:19:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 -- 172.21.15.78:0/714530994 learned_addr learned my addr 172.21.15.78:0/714530994 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe58f7fe700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5900b6a30 0x7fe5900c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 -- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59006edb0 msgr2=0x7fe59014f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59006edb0 0x7fe59014f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 -- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5900b6a30 msgr2=0x7fe5900c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5900b6a30 0x7fe5900c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.841+0000 7fe594bcd700 1 -- 172.21.15.78:0/714530994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800094b0 con 0x7fe5901428c0 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe594bcd700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe5900c8340 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 crypto rx=0x7fe58800cbc0 tx=0x7fe58800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe58cff9700 1 -- 172.21.15.78:0/714530994 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588003c20 con 0x7fe5901428c0 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe58cff9700 1 -- 172.21.15.78:0/714530994 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588003d80 con 0x7fe5901428c0 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe58cff9700 1 -- 172.21.15.78:0/714530994 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58800aae0 con 0x7fe5901428c0 2023-06-09T20:19:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59006b690 con 0x7fe5901428c0 2023-06-09T20:19:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59006b3b0 con 0x7fe5901428c0 2023-06-09T20:19:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5900b6eb0 con 0x7fe5901428c0 2023-06-09T20:19:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.845+0000 7fe58cff9700 1 -- 172.21.15.78:0/714530994 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe58800ac40 con 0x7fe5901428c0 2023-06-09T20:19:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.849+0000 7fe58cff9700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe57c0662f0 0x7fe57c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.849+0000 7fe58cff9700 1 -- 172.21.15.78:0/714530994 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5739+0+0 (secure 0 0 0) 0x7fe588083b90 con 0x7fe5901428c0 2023-06-09T20:19:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.849+0000 7fe58ffff700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe57c0662f0 0x7fe57c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.849+0000 7fe58ffff700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe57c0662f0 0x7fe57c0687a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe5800090b0 tx=0x7fe58001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:22.853+0000 7fe58cff9700 1 -- 172.21.15.78:0/714530994 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe588051140 con 0x7fe5901428c0 2023-06-09T20:19:23.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.097+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5900741c0 con 0x7fe5901428c0 2023-06-09T20:19:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.621+0000 7fe58cff9700 1 -- 172.21.15.78:0/714530994 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe588054760 con 0x7fe5901428c0 2023-06-09T20:19:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.629+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe57c0662f0 msgr2=0x7fe57c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.629+0000 7fe5953ce700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe57c0662f0 0x7fe57c0687a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe5800090b0 tx=0x7fe58001c040 comp rx=0 tx=0).stop 2023-06-09T20:19:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.629+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 msgr2=0x7fe5900c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.629+0000 7fe5953ce700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe5900c8340 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 crypto rx=0x7fe58800cbc0 tx=0x7fe58800ced0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 shutdown_connections 2023-06-09T20:19:23.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe57c0662f0 0x7fe57c0687a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5901428c0 0x7fe5900c8340 unknown :-1 s=CLOSED pgs=3257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5900b6a30 0x7fe5900c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 --2- 172.21.15.78:0/714530994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59006edb0 0x7fe59014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 >> 172.21.15.78:0/714530994 conn(0x7fe5900b57d0 msgr2=0x7fe590141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:23.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 shutdown_connections 2023-06-09T20:19:23.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.633+0000 7fe5953ce700 1 -- 172.21.15.78:0/714530994 wait complete. 2023-06-09T20:19:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-06-09T20:19:23.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-09T20:19:23.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.889+0000 7fdb8d1dc700 1 Processor -- start 2023-06-09T20:19:23.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.889+0000 7fdb8d1dc700 1 -- start start 2023-06-09T20:19:23.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.889+0000 7fdb8d1dc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdb880b6a60 0x7fdb8806a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.889+0000 7fdb8d1dc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdb88161100 0x7fdb88161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb87fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdb88070890 0x7fdb88070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49410/0 (socket says 172.21.15.78:49410) 2023-06-09T20:19:23.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb87fff700 1 -- 172.21.15.78:0/41063845 learned_addr learned my addr 172.21.15.78:0/41063845 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:23.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.889+0000 7fdb8d1dc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8806a8f0 con 0x7fdb88070890 2023-06-09T20:19:23.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/41063845 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb880b6ee0 con 0x7fdb880b6a60 2023-06-09T20:19:23.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/41063845 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8806abc0 con 0x7fdb88161100 2023-06-09T20:19:23.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb877fe700 1 --2- 172.21.15.78:0/41063845 >> v2:172.21.15.78:3300/0 conn(0x7fdb880b6a60 0x7fdb8806a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:23.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8c9db700 1 --2- 172.21.15.78:0/41063845 >> v2:172.21.15.187:3300/0 conn(0x7fdb88161100 0x7fdb88161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb86ffd700 1 -- 172.21.15.78:0/41063845 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558266043 0 0) 0x7fdb8806a8f0 con 0x7fdb88070890 2023-06-09T20:19:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb86ffd700 1 -- 172.21.15.78:0/41063845 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb700035d0 con 0x7fdb88070890 2023-06-09T20:19:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb877fe700 1 -- 172.21.15.78:0/41063845 >> v2:172.21.15.187:3300/0 conn(0x7fdb88161100 msgr2=0x7fdb88161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb877fe700 1 --2- 172.21.15.78:0/41063845 >> v2:172.21.15.187:3300/0 conn(0x7fdb88161100 0x7fdb88161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb877fe700 1 -- 172.21.15.78:0/41063845 >> v1:172.21.15.78:6789/0 conn(0x7fdb88070890 legacy=0x7fdb88070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb877fe700 1 -- 172.21.15.78:0/41063845 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8806aea0 con 0x7fdb880b6a60 2023-06-09T20:19:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb877fe700 1 --2- 172.21.15.78:0/41063845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb880b6a60 0x7fdb8806a3b0 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 crypto rx=0x7fdb8808e370 tx=0x7fdb7c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5b3c97e26606c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:23.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb86ffd700 1 -- 172.21.15.78:0/41063845 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c011830 con 0x7fdb880b6a60 2023-06-09T20:19:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb86ffd700 1 -- 172.21.15.78:0/41063845 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c011990 con 0x7fdb880b6a60 2023-06-09T20:19:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb86ffd700 1 -- 172.21.15.78:0/41063845 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c011d20 con 0x7fdb880b6a60 2023-06-09T20:19:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/41063845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb880b6a60 msgr2=0x7fdb8806a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/41063845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb880b6a60 0x7fdb8806a3b0 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 crypto rx=0x7fdb8808e370 tx=0x7fdb7c009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/41063845 shutdown_connections 2023-06-09T20:19:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/41063845 >> v2:172.21.15.187:3300/0 conn(0x7fdb88161100 0x7fdb88161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/41063845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb880b6a60 0x7fdb8806a3b0 unknown :-1 s=CLOSED pgs=3259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.893+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/41063845 >> 172.21.15.78:0/41063845 conn(0x7fdb880d2e10 msgr2=0x7fdb880d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:23.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.897+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/41063845 shutdown_connections 2023-06-09T20:19:23.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.897+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/41063845 wait complete. 2023-06-09T20:19:23.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.897+0000 7fdb8d1dc700 1 Processor -- start 2023-06-09T20:19:23.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8d1dc700 1 -- start start 2023-06-09T20:19:23.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8d1dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88070890 0x7fdb8815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8d1dc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb880b6a60 0x7fdb8815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8d1dc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb88161100 0x7fdb8815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8d1dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8815ed00 con 0x7fdb88070890 2023-06-09T20:19:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8d1dc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb880d17d0 con 0x7fdb880b6a60 2023-06-09T20:19:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8d1dc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8815bea0 con 0x7fdb88161100 2023-06-09T20:19:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8c9db700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb88161100 0x7fdb8815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8c9db700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb88161100 0x7fdb8815d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50132/0 (socket says 172.21.15.78:50132) 2023-06-09T20:19:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb8c9db700 1 -- 172.21.15.78:0/2166645036 learned_addr learned my addr 172.21.15.78:0/2166645036 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.901+0000 7fdb87fff700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88070890 0x7fdb8815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb87fff700 1 -- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb88161100 msgr2=0x7fdb8815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb87fff700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb88161100 0x7fdb8815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb87fff700 1 -- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb880b6a60 msgr2=0x7fdb8815cc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T20:19:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb87fff700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb880b6a60 0x7fdb8815cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb87fff700 1 -- 172.21.15.78:0/2166645036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0094b0 con 0x7fdb88070890 2023-06-09T20:19:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb87fff700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88070890 0x7fdb8815e7c0 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c410 tx=0x7fdb7800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:23.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb84ff9700 1 -- 172.21.15.78:0/2166645036 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78005d90 con 0x7fdb88070890 2023-06-09T20:19:23.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8806b460 con 0x7fdb88070890 2023-06-09T20:19:23.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8806b180 con 0x7fdb88070890 2023-06-09T20:19:23.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb84ff9700 1 -- 172.21.15.78:0/2166645036 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb780070d0 con 0x7fdb88070890 2023-06-09T20:19:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb84ff9700 1 -- 172.21.15.78:0/2166645036 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78005d90 con 0x7fdb88070890 2023-06-09T20:19:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.905+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb68005310 con 0x7fdb88070890 2023-06-09T20:19:23.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.909+0000 7fdb84ff9700 1 -- 172.21.15.78:0/2166645036 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb78007240 con 0x7fdb88070890 2023-06-09T20:19:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.909+0000 7fdb84ff9700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fdb74066380 0x7fdb74068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.909+0000 7fdb84ff9700 1 -- 172.21.15.78:0/2166645036 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdb78082520 con 0x7fdb88070890 2023-06-09T20:19:23.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.913+0000 7fdb877fe700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fdb74066380 0x7fdb74068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:23.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.913+0000 7fdb877fe700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fdb74066380 0x7fdb74068830 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fdb88140b60 tx=0x7fdb7c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:23.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:23.917+0000 7fdb84ff9700 1 -- 172.21.15.78:0/2166645036 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdb7804fd60 con 0x7fdb88070890 2023-06-09T20:19:24.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.201+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdb68005b40 con 0x7fdb88070890 2023-06-09T20:19:24.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.233+0000 7fdb84ff9700 1 -- 172.21.15.78:0/2166645036 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb78053380 con 0x7fdb88070890 2023-06-09T20:19:24.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.237+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fdb74066380 msgr2=0x7fdb74068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.237+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fdb74066380 0x7fdb74068830 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fdb88140b60 tx=0x7fdb7c008030 comp rx=0 tx=0).stop 2023-06-09T20:19:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.237+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88070890 msgr2=0x7fdb8815e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.237+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88070890 0x7fdb8815e7c0 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c410 tx=0x7fdb7800c720 comp rx=0 tx=0).stop 2023-06-09T20:19:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 shutdown_connections 2023-06-09T20:19:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fdb74066380 0x7fdb74068830 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb88161100 0x7fdb8815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb880b6a60 0x7fdb8815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 --2- 172.21.15.78:0/2166645036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88070890 0x7fdb8815e7c0 unknown :-1 s=CLOSED pgs=3260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 >> 172.21.15.78:0/2166645036 conn(0x7fdb880d2e10 msgr2=0x7fdb8806e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 shutdown_connections 2023-06-09T20:19:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.241+0000 7fdb8d1dc700 1 -- 172.21.15.78:0/2166645036 wait complete. 2023-06-09T20:19:24.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-09T20:19:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.433+0000 7f8b09b33700 1 Processor -- start 2023-06-09T20:19:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.433+0000 7f8b09b33700 1 -- start start 2023-06-09T20:19:24.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b040ae020 0x7f8b0406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:24.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8b0406aca0 0x7f8b04162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:24.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b040c5710 con 0x7f8b04158b60 2023-06-09T20:19:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b04158f30 con 0x7f8b0406aca0 2023-06-09T20:19:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0406b120 con 0x7f8b040ae020 2023-06-09T20:19:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b08b31700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8b04158b60 0x7f8b04070290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49414/0 (socket says 172.21.15.78:49414) 2023-06-09T20:19:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b08b31700 1 -- 172.21.15.78:0/2149182183 learned_addr learned my addr 172.21.15.78:0/2149182183 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09332700 1 --2- 172.21.15.78:0/2149182183 >> v2:172.21.15.187:3300/0 conn(0x7f8b0406aca0 0x7f8b04162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b03fff700 1 --2- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b040ae020 0x7f8b0406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b037fe700 1 -- 172.21.15.78:0/2149182183 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058389452 0 0) 0x7f8b040c5710 con 0x7f8b04158b60 2023-06-09T20:19:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b037fe700 1 -- 172.21.15.78:0/2149182183 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af40035d0 con 0x7f8b04158b60 2023-06-09T20:19:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09332700 1 -- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b040ae020 msgr2=0x7f8b0406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09332700 1 --2- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b040ae020 0x7f8b0406a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09332700 1 -- 172.21.15.78:0/2149182183 >> v1:172.21.15.78:6789/0 conn(0x7f8b04158b60 legacy=0x7f8b04070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09332700 1 -- 172.21.15.78:0/2149182183 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b040cd830 con 0x7f8b0406aca0 2023-06-09T20:19:24.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09332700 1 --2- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 0x7f8b04162600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00aea0 tx=0x7f8afc00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4de24ebfd1b859fd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b037fe700 1 -- 172.21.15.78:0/2149182183 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00f070 con 0x7f8b0406aca0 2023-06-09T20:19:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b037fe700 1 -- 172.21.15.78:0/2149182183 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00a2e0 con 0x7f8b0406aca0 2023-06-09T20:19:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b037fe700 1 -- 172.21.15.78:0/2149182183 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00cb30 con 0x7f8b0406aca0 2023-06-09T20:19:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 msgr2=0x7f8b04162600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 --2- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 0x7f8b04162600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00aea0 tx=0x7f8afc00c330 comp rx=0 tx=0).stop 2023-06-09T20:19:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- 172.21.15.78:0/2149182183 shutdown_connections 2023-06-09T20:19:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 --2- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 0x7f8b04162600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 --2- 172.21.15.78:0/2149182183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b040ae020 0x7f8b0406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- 172.21.15.78:0/2149182183 >> 172.21.15.78:0/2149182183 conn(0x7f8b040cf670 msgr2=0x7f8b040cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- 172.21.15.78:0/2149182183 shutdown_connections 2023-06-09T20:19:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.437+0000 7f8b09b33700 1 -- 172.21.15.78:0/2149182183 wait complete. 2023-06-09T20:19:24.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 Processor -- start 2023-06-09T20:19:24.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 -- start start 2023-06-09T20:19:24.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 0x7f8b040b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b040ae020 0x7f8b0414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b04158b60 0x7f8b040b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040b0920 con 0x7f8b040ae020 2023-06-09T20:19:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040ae890 con 0x7f8b0406aca0 2023-06-09T20:19:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040aeb70 con 0x7f8b04158b60 2023-06-09T20:19:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b040ae020 0x7f8b0414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b08b31700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 0x7f8b040b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:24.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b040ae020 0x7f8b0414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54336/0 (socket says 172.21.15.78:54336) 2023-06-09T20:19:24.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 -- 172.21.15.78:0/1234210184 learned_addr learned my addr 172.21.15.78:0/1234210184 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:24.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09332700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b04158b60 0x7f8b040b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 -- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b04158b60 msgr2=0x7f8b040b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b04158b60 0x7f8b040b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 -- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 msgr2=0x7f8b040b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 0x7f8b040b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 -- 172.21.15.78:0/1234210184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc00ab80 con 0x7f8b040ae020 2023-06-09T20:19:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b03fff700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b040ae020 0x7f8b0414fea0 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d800 tx=0x7f8af000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:24.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b017fa700 1 -- 172.21.15.78:0/1234210184 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00125f0 con 0x7f8b040ae020 2023-06-09T20:19:24.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b017fa700 1 -- 172.21.15.78:0/1234210184 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0012750 con 0x7f8b040ae020 2023-06-09T20:19:24.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b040cd550 con 0x7f8b040ae020 2023-06-09T20:19:24.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b017fa700 1 -- 172.21.15.78:0/1234210184 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0012ac0 con 0x7f8b040ae020 2023-06-09T20:19:24.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.441+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b040cd270 con 0x7f8b040ae020 2023-06-09T20:19:24.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.445+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b040c3f00 con 0x7f8b040ae020 2023-06-09T20:19:24.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.445+0000 7f8b017fa700 1 -- 172.21.15.78:0/1234210184 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8af0012c20 con 0x7f8b040ae020 2023-06-09T20:19:24.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.445+0000 7f8b017fa700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8ae80662f0 0x7f8ae80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:24.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.445+0000 7f8b017fa700 1 -- 172.21.15.78:0/1234210184 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8af0083b00 con 0x7f8b040ae020 2023-06-09T20:19:24.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.445+0000 7f8b08b31700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8ae80662f0 0x7f8ae80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.449+0000 7f8b08b31700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8ae80662f0 0x7f8ae80687a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8af8007fd0 tx=0x7f8af8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:24.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.449+0000 7f8b017fa700 1 -- 172.21.15.78:0/1234210184 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8af0085e60 con 0x7f8b040ae020 2023-06-09T20:19:24.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:24.785+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f8b040b06e0 con 0x7f8b040ae020 2023-06-09T20:19:25.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.649+0000 7f8b017fa700 1 -- 172.21.15.78:0/1234210184 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v16512) v1 ==== 144+0+0 (secure 0 0 0) 0x7f8af0051200 con 0x7f8b040ae020 2023-06-09T20:19:25.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8ae80662f0 msgr2=0x7f8ae80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:25.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8ae80662f0 0x7f8ae80687a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8af8007fd0 tx=0x7f8af8007de0 comp rx=0 tx=0).stop 2023-06-09T20:19:25.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b040ae020 msgr2=0x7f8b0414fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b040ae020 0x7f8b0414fea0 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d800 tx=0x7f8af000db10 comp rx=0 tx=0).stop 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 shutdown_connections 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8ae80662f0 0x7f8ae80687a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b04158b60 0x7f8b040b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b040ae020 0x7f8b0414fea0 unknown :-1 s=CLOSED pgs=3262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 --2- 172.21.15.78:0/1234210184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b0406aca0 0x7f8b040b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 >> 172.21.15.78:0/1234210184 conn(0x7f8b040cf670 msgr2=0x7f8b0406e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:25.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 shutdown_connections 2023-06-09T20:19:25.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:25.653+0000 7f8b09b33700 1 -- 172.21.15.78:0/1234210184 wait complete. 2023-06-09T20:19:25.682 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-06-09T20:19:25.683 INFO:tasks.cephfs_test_runner: 2023-06-09T20:19:25.683 INFO:tasks.cephfs_test_runner:====================================================================== 2023-06-09T20:19:25.683 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T20:19:25.684 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-06-09T20:19:25.684 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-06-09T20:19:25.684 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-06-09T20:19:25.684 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs/xfstests_dev.py", line 385, in run_generic_tests 2023-06-09T20:19:25.685 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs/xfstests_dev.py", line 377, in run_testdir 2023-06-09T20:19:25.685 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-06-09T20:19:25.685 INFO:tasks.cephfs_test_runner: 2023-06-09T20:19:25.685 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-06-09T20:19:25.686 INFO:tasks.cephfs_test_runner:Ran 1 test in 32803.466s 2023-06-09T20:19:25.686 INFO:tasks.cephfs_test_runner: 2023-06-09T20:19:25.686 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-06-09T20:19:25.686 INFO:tasks.cephfs_test_runner: 2023-06-09T20:19:25.687 INFO:tasks.cephfs_test_runner:====================================================================== 2023-06-09T20:19:25.687 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T20:19:25.687 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-06-09T20:19:25.687 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-06-09T20:19:25.688 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-06-09T20:19:25.688 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs/xfstests_dev.py", line 385, in run_generic_tests 2023-06-09T20:19:25.688 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs/xfstests_dev.py", line 377, in run_testdir 2023-06-09T20:19:25.688 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-06-09T20:19:25.689 INFO:tasks.cephfs_test_runner: 2023-06-09T20:19:25.689 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T20:19:25.755 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dcf1a1530664423180f01bb686913676 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_034108821cde95ca1c56d458dfccc7ef9e0d964d/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T20:19:25.757 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-06-09T20:19:25.766 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-06-09T20:19:25.789 INFO:tasks.kclient:Unmounting kernel clients... 2023-06-09T20:19:25.790 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T20:19:25.790 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:25.819 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352392k,nr_inodes=4088098,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-09T20:19:25.820 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-09T20:19:25.820 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:25.878 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352392k,nr_inodes=4088098,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-09T20:19:25.879 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T20:19:25.879 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:25.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352416k,nr_inodes=4088104,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2901 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T20:19:25.888 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-06-09T20:19:25.889 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T20:19:25.949 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352416k,nr_inodes=4088104,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2901 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T20:19:25.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:25.950 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-06-09T20:19:26.196 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-09T20:19:26.197 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T20:19:26.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T20:19:26.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T20:19:26.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-06-09T20:19:26.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.545 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-06-09T20:19:26.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-06-09T20:19:26.716 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-06-09T20:19:26.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T20:19:26.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.719 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-06-09T20:19:26.729 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-09T20:19:26.730 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-09T20:19:26.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-09T20:19:26.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.805 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T20:19:26.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:26.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-06-09T20:19:27.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:27.170 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-06-09T20:19:27.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T20:19:27.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-06-09T20:19:28.154 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-06-09T20:19:28.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T20:19:28.157 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-06-09T20:19:28.167 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-09T20:19:28.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T20:19:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc248a700 1 Processor -- start 2023-06-09T20:19:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc248a700 1 -- start start 2023-06-09T20:19:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc248a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4cbc1561a0 0x7f4cbc0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:28.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc248a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4cbc15ce60 0x7f4cbc070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc248a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cbc159c50 con 0x7f4cbc158c30 2023-06-09T20:19:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc248a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cbc159760 con 0x7f4cbc1561a0 2023-06-09T20:19:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc248a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cbc159970 con 0x7f4cbc15ce60 2023-06-09T20:19:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc0a27700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4cbc158c30 0x7f4cbc159050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58040/0 (socket says 172.21.15.78:58040) 2023-06-09T20:19:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cc0a27700 1 -- 172.21.15.78:0/617209348 learned_addr learned my addr 172.21.15.78:0/617209348 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.357+0000 7f4cbbfff700 1 --2- 172.21.15.78:0/617209348 >> v2:172.21.15.78:3300/0 conn(0x7f4cbc1561a0 0x7f4cbc0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbb7fe700 1 --2- 172.21.15.78:0/617209348 >> v2:172.21.15.187:3300/0 conn(0x7f4cbc15ce60 0x7f4cbc070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbbfff700 1 -- 172.21.15.78:0/617209348 >> v2:172.21.15.187:3300/0 conn(0x7f4cbc15ce60 msgr2=0x7f4cbc070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbbfff700 1 --2- 172.21.15.78:0/617209348 >> v2:172.21.15.187:3300/0 conn(0x7f4cbc15ce60 0x7f4cbc070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbbfff700 1 -- 172.21.15.78:0/617209348 >> v1:172.21.15.78:6789/0 conn(0x7f4cbc158c30 legacy=0x7f4cbc159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbbfff700 1 -- 172.21.15.78:0/617209348 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc15c380 con 0x7f4cbc1561a0 2023-06-09T20:19:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbbfff700 1 --2- 172.21.15.78:0/617209348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc0700d0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc06c220 tx=0x7f4cac00bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0da66fce1ed05f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbaffd700 1 -- 172.21.15.78:0/617209348 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00dc20 con 0x7f4cbc1561a0 2023-06-09T20:19:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbaffd700 1 -- 172.21.15.78:0/617209348 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac00dd80 con 0x7f4cbc1561a0 2023-06-09T20:19:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.361+0000 7f4cbaffd700 1 -- 172.21.15.78:0/617209348 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac004250 con 0x7f4cbc1561a0 2023-06-09T20:19:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 -- 172.21.15.78:0/617209348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 msgr2=0x7f4cbc0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 --2- 172.21.15.78:0/617209348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc0700d0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc06c220 tx=0x7f4cac00bde0 comp rx=0 tx=0).stop 2023-06-09T20:19:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 -- 172.21.15.78:0/617209348 shutdown_connections 2023-06-09T20:19:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 --2- 172.21.15.78:0/617209348 >> v2:172.21.15.187:3300/0 conn(0x7f4cbc15ce60 0x7f4cbc070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 --2- 172.21.15.78:0/617209348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc0700d0 unknown :-1 s=CLOSED pgs=3264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:28.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 -- 172.21.15.78:0/617209348 >> 172.21.15.78:0/617209348 conn(0x7f4cbc0cb460 msgr2=0x7f4cbc0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:28.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 -- 172.21.15.78:0/617209348 shutdown_connections 2023-06-09T20:19:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.365+0000 7f4cc248a700 1 -- 172.21.15.78:0/617209348 wait complete. 2023-06-09T20:19:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.369+0000 7f4cc248a700 1 Processor -- start 2023-06-09T20:19:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.369+0000 7f4cc248a700 1 -- start start 2023-06-09T20:19:28.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cc248a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:28.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cc248a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cbc158c30 0x7f4cbc147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:28.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cc248a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cbc15ce60 0x7f4cbc152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cc248a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc153020 con 0x7f4cbc1561a0 2023-06-09T20:19:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cc248a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc151f30 con 0x7f4cbc15ce60 2023-06-09T20:19:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cc248a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc148550 con 0x7f4cbc158c30 2023-06-09T20:19:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54496/0 (socket says 172.21.15.78:54496) 2023-06-09T20:19:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 -- 172.21.15.78:0/1602271365 learned_addr learned my addr 172.21.15.78:0/1602271365 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cc0a27700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cbc15ce60 0x7f4cbc152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbb7fe700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cbc158c30 0x7f4cbc147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 -- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cbc158c30 msgr2=0x7f4cbc147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cbc158c30 0x7f4cbc147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 -- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cbc15ce60 msgr2=0x7f4cbc152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cbc15ce60 0x7f4cbc152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:28.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 -- 172.21.15.78:0/1602271365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac00b760 con 0x7f4cbc1561a0 2023-06-09T20:19:28.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbbfff700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc150d40 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f4cac000c00 tx=0x7f4cac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:28.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cbb7fe700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cbc158c30 0x7f4cbc147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T20:19:28.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cb8ff9700 1 -- 172.21.15.78:0/1602271365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac006d10 con 0x7f4cbc1561a0 2023-06-09T20:19:28.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cb8ff9700 1 -- 172.21.15.78:0/1602271365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac006e90 con 0x7f4cbc1561a0 2023-06-09T20:19:28.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.373+0000 7f4cb8ff9700 1 -- 172.21.15.78:0/1602271365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac005c80 con 0x7f4cbc1561a0 2023-06-09T20:19:28.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.377+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cbc15c940 con 0x7f4cbc1561a0 2023-06-09T20:19:28.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.377+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cbc15c660 con 0x7f4cbc1561a0 2023-06-09T20:19:28.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.377+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cbc156570 con 0x7f4cbc1561a0 2023-06-09T20:19:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.381+0000 7f4cb8ff9700 1 -- 172.21.15.78:0/1602271365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4cac0036c0 con 0x7f4cbc1561a0 2023-06-09T20:19:28.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.381+0000 7f4cb8ff9700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4ca8066340 0x7f4ca80687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:28.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.381+0000 7f4cb8ff9700 1 -- 172.21.15.78:0/1602271365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4cac020070 con 0x7f4cbc1561a0 2023-06-09T20:19:28.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.381+0000 7f4cbb7fe700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4ca8066340 0x7f4ca80687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:28.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.381+0000 7f4cbb7fe700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4ca8066340 0x7f4ca80687f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0b2f00 tx=0x7f4cb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:28.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.389+0000 7f4cb8ff9700 1 -- 172.21.15.78:0/1602271365 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4cac051fb0 con 0x7f4cbc1561a0 2023-06-09T20:19:28.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:28.717+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cbc0741c0 con 0x7f4ca8066340 2023-06-09T20:19:29.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.549+0000 7f4cb8ff9700 1 -- 172.21.15.78:0/1602271365 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71438 (secure 0 0 0) 0x7f4cbc0741c0 con 0x7f4ca8066340 2023-06-09T20:19:29.558 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:29.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4ca8066340 msgr2=0x7f4ca80687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:29.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4ca8066340 0x7f4ca80687f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0b2f00 tx=0x7f4cb0008040 comp rx=0 tx=0).stop 2023-06-09T20:19:29.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 msgr2=0x7f4cbc150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:29.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc150d40 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f4cac000c00 tx=0x7f4cac004770 comp rx=0 tx=0).stop 2023-06-09T20:19:29.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 shutdown_connections 2023-06-09T20:19:29.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f4ca8066340 0x7f4ca80687f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cbc15ce60 0x7f4cbc152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cbc158c30 0x7f4cbc147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 --2- 172.21.15.78:0/1602271365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cbc1561a0 0x7f4cbc150d40 unknown :-1 s=CLOSED pgs=3265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 >> 172.21.15.78:0/1602271365 conn(0x7f4cbc0cb460 msgr2=0x7f4cbc06e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:29.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 shutdown_connections 2023-06-09T20:19:29.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.553+0000 7f4cc248a700 1 -- 172.21.15.78:0/1602271365 wait complete. 2023-06-09T20:19:29.562 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T20:19:29.577 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":16453,"stamp":"2023-06-09T20:19:26.828305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":48037308,"kb_used_data":40977980,"kb_used_omap":164701,"kb_used_meta":6894562,"kb_avail":706937412,"statfs":{"total":773094113280,"available":723903909888,"internally_reserved":0,"allocated":41961451520,"data_stored":41945656482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":168654543,"internal_metadata":7060031793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":110,"apply_latency_ms":110,"commit_latency_ns":110000000,"apply_latency_ns":110000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36526046105,"num_objects":-27300,"num_object_clones":0,"num_object_copies":-54600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27300,"num_whiteouts":0,"num_read":-1370902,"num_read_kb":-413493825,"num_write":-3519517,"num_write_kb":-590846652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.453937"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":476,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-09T20:19:19.727419+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T20:19:19.727419+0000","last_peered":"2023-06-09T20:19:19.727419+0000","last_clean":"2023-06-09T20:19:19.727419+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T20:19:19.727419+0000","last_undegraded":"2023-06-09T20:19:19.727419+0000","last_fullsized":"2023-06-09T20:19:19.727419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:07:25.603881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":315,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-09T20:19:19.726733+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T20:19:19.726733+0000","last_peered":"2023-06-09T20:19:19.726733+0000","last_clean":"2023-06-09T20:19:19.726733+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T20:19:19.726733+0000","last_undegraded":"2023-06-09T20:19:19.726733+0000","last_fullsized":"2023-06-09T20:19:19.726733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:16:25.362742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":320,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-09T20:19:19.725842+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T20:19:19.725842+0000","last_peered":"2023-06-09T20:19:19.725842+0000","last_clean":"2023-06-09T20:19:19.725842+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T20:19:19.725842+0000","last_undegraded":"2023-06-09T20:19:19.725842+0000","last_fullsized":"2023-06-09T20:19:19.725842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T17:43:10.128088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":312,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-09T20:19:19.432963+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T20:19:19.432963+0000","last_peered":"2023-06-09T20:19:19.432963+0000","last_clean":"2023-06-09T20:19:19.432963+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T20:19:19.432963+0000","last_undegraded":"2023-06-09T20:19:19.432963+0000","last_fullsized":"2023-06-09T20:19:19.432963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T19:35:30.121467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":315,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-09T20:19:19.690171+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T20:19:19.690171+0000","last_peered":"2023-06-09T20:19:19.690171+0000","last_clean":"2023-06-09T20:19:19.690171+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T20:19:19.690171+0000","last_undegraded":"2023-06-09T20:19:19.690171+0000","last_fullsized":"2023-06-09T20:19:19.690171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:36.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.161300+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T20:19:25.161300+0000","last_peered":"2023-06-09T20:19:25.161300+0000","last_clean":"2023-06-09T20:19:25.161300+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T20:19:25.161300+0000","last_undegraded":"2023-06-09T20:19:25.161300+0000","last_fullsized":"2023-06-09T20:19:25.161300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:01:51.521324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":309,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-09T20:19:19.726472+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T20:19:19.726472+0000","last_peered":"2023-06-09T20:19:19.726472+0000","last_clean":"2023-06-09T20:19:19.726472+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T20:19:19.726472+0000","last_undegraded":"2023-06-09T20:19:19.726472+0000","last_fullsized":"2023-06-09T20:19:19.726472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:20.018210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.164138+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T20:19:25.164138+0000","last_peered":"2023-06-09T20:19:25.164138+0000","last_clean":"2023-06-09T20:19:25.164138+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T20:19:25.164138+0000","last_undegraded":"2023-06-09T20:19:25.164138+0000","last_fullsized":"2023-06-09T20:19:25.164138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:18:47.506917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":297,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-09T20:19:19.727634+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T20:19:19.727634+0000","last_peered":"2023-06-09T20:19:19.727634+0000","last_clean":"2023-06-09T20:19:19.727634+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T20:19:19.727634+0000","last_undegraded":"2023-06-09T20:19:19.727634+0000","last_fullsized":"2023-06-09T20:19:19.727634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:18:13.857585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581406,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6473364,"kb_used_data":5723404,"kb_used_omap":15347,"kb_used_meta":734604,"kb_avail":87898476,"statfs":{"total":96636764160,"available":90008039424,"internally_reserved":0,"allocated":5860765696,"data_stored":5858488496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715521,"internal_metadata":752235327},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":1.661,"5min":6.6429999999999998,"15min":6.6429999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.76200000000000001,"15min":0.79700000000000004},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.84599999999999997,"5min":4.3700000000000001,"15min":6.9340000000000002},"last":0.621}]},{"osd":1,"last update":"Fri Jun 9 20:19:02 2023","interfaces":[{"interface":"back","average":{"1min":6.6509999999999998,"5min":1.964,"15min":1.2629999999999999},"min":{"1min":0.38,"5min":0.371,"15min":0.33500000000000002},"max":{"1min":106.97,"5min":106.97,"15min":106.97},"last":0.98699999999999999},{"interface":"front","average":{"1min":6.5869999999999997,"5min":1.966,"15min":1.284},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":107.06100000000001,"5min":107.06100000000001,"15min":107.06100000000001},"last":1.222}]},{"osd":2,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":0.92300000000000004},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.38700000000000001},"max":{"1min":3.2970000000000002,"5min":6.5330000000000004,"15min":11.923},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.92700000000000005,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6639999999999999,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":1.4219999999999999}]},{"osd":3,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":1.149},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.3319999999999999,"5min":4.1459999999999999,"15min":59.793999999999997},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.93899999999999995,"15min":1.167},"min":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"max":{"1min":1.486,"5min":3.6890000000000001,"15min":60.773000000000003},"last":1.458}]},{"osd":4,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":3.9700000000000002,"5min":1.5509999999999999,"15min":1.1499999999999999},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":54.104999999999997,"5min":54.104999999999997,"15min":54.104999999999997},"last":1.2729999999999999},{"interface":"front","average":{"1min":4.46,"5min":1.6619999999999999,"15min":1.194},"min":{"1min":0.52600000000000002,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":53.810000000000002,"5min":53.810000000000002,"15min":53.810000000000002},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":2.4769999999999999,"15min":1.5089999999999999},"min":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.42399999999999999},"max":{"1min":3.0449999999999999,"5min":131.97200000000001,"15min":131.97200000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":2.5800000000000001,"15min":1.6619999999999999},"min":{"1min":0.52400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":2.911,"5min":134.97499999999999,"15min":134.97499999999999},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0229999999999999,"15min":1.2569999999999999},"min":{"1min":0.627,"5min":0.55700000000000005,"15min":0.499},"max":{"1min":1.1859999999999999,"5min":4.4950000000000001,"15min":61.345999999999997},"last":1.891},{"interface":"front","average":{"1min":1.288,"5min":1.0980000000000001,"15min":1.2829999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":3.266,"5min":4.2569999999999997,"15min":60.165999999999997},"last":0.90200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834581406,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6352952,"kb_used_data":5202096,"kb_used_omap":10585,"kb_used_meta":1140262,"kb_avail":88018888,"statfs":{"total":96636764160,"available":90131341312,"internally_reserved":0,"allocated":5326946304,"data_stored":5324956177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10840012,"internal_metadata":1167628340},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70299999999999996,"15min":0.74399999999999999},"min":{"1min":0.34100000000000003,"5min":0.308,"15min":0.308},"max":{"1min":1.542,"5min":3.1760000000000002,"15min":7.4050000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":2.0049999999999999,"5min":0.94899999999999995,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":26.532,"5min":26.532,"15min":26.532},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":1.327},{"interface":"front","average":{"1min":1.143,"5min":0.86399999999999999,"15min":0.86699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.33700000000000002},"max":{"1min":7.5039999999999996,"5min":7.5039999999999996,"15min":7.5039999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":0.85999999999999999,"15min":0.91600000000000004},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":7.5259999999999998,"5min":7.5259999999999998,"15min":14.003},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":1.98,"5min":3.4390000000000001,"15min":6.4199999999999999},"last":1.369}]},{"osd":3,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.3260000000000001,"15min":1.0700000000000001},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.42199999999999999},"max":{"1min":2.008,"5min":39.442999999999998,"15min":39.442999999999998},"last":1.476},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.26,"15min":1.1279999999999999},"min":{"1min":0.47599999999999998,"5min":0.441,"15min":0.441},"max":{"1min":3.335,"5min":39.011000000000003,"15min":39.011000000000003},"last":0.95999999999999996}]},{"osd":4,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91400000000000003,"15min":1.5169999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33000000000000002},"max":{"1min":1.609,"5min":4.0659999999999998,"15min":162.25399999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.077,"5min":0.873,"15min":1.5940000000000001},"min":{"1min":0.52200000000000002,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":3.294,"5min":3.294,"15min":162.19900000000001},"last":1.0249999999999999}]},{"osd":5,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":3.2290000000000001,"5min":2.6589999999999998,"15min":1.5489999999999999},"min":{"1min":0.47499999999999998,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":47.223999999999997,"5min":126.22,"15min":126.22},"last":1.4079999999999999},{"interface":"front","average":{"1min":5.194,"5min":3.1179999999999999,"15min":1.714},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.38800000000000001},"max":{"1min":47.131,"5min":133.33000000000001,"15min":133.33000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.93200000000000005,"15min":1.738},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.907,"5min":3.907,"15min":96.753},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":1.756},"min":{"1min":0.51000000000000001,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":2.0350000000000001,"5min":3.4670000000000001,"15min":101.806},"last":1.446}]}]},{"osd":5,"up_from":13,"seq":55834581402,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8658896,"kb_used_data":7600776,"kb_used_omap":31576,"kb_used_meta":1026535,"kb_avail":85712944,"statfs":{"total":96636764160,"available":87770054656,"internally_reserved":0,"allocated":7783194624,"data_stored":7780556300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32334646,"internal_metadata":1051172042},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.75900000000000001,"15min":1.732},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.31},"max":{"1min":8.2210000000000001,"5min":8.2210000000000001,"15min":150.52699999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":1.8149999999999999},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.33000000000000002},"max":{"1min":2.669,"5min":4.1779999999999999,"15min":151.72900000000001},"last":1.2549999999999999}]},{"osd":1,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.5309999999999999,"15min":1.0609999999999999},"min":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":9.9000000000000004,"5min":53.021999999999998,"15min":53.021999999999998},"last":1.173},{"interface":"front","average":{"1min":1.389,"5min":1.8069999999999999,"15min":1.177},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.376},"max":{"1min":9.9800000000000004,"5min":53.197000000000003,"15min":53.197000000000003},"last":1.3740000000000001}]},{"osd":2,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":0.872,"15min":1.2},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":8.173,"5min":8.173,"15min":97.159999999999997},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":1.181},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0589999999999999,"5min":1.4790000000000001,"15min":97.531000000000006},"last":1.0389999999999999}]},{"osd":3,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.107,"15min":0.98599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.41499999999999998},"max":{"1min":8.2029999999999994,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.143},{"interface":"front","average":{"1min":1.377,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.54500000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.2889999999999997,"5min":8.2889999999999997,"15min":8.2889999999999997},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":2.4820000000000002,"15min":1.4690000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.36399999999999999},"max":{"1min":8.2569999999999997,"5min":136.20500000000001,"15min":136.20500000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.024,"5min":2.3559999999999999,"15min":1.4450000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36599999999999999},"max":{"1min":5.8079999999999998,"5min":135.35400000000001,"15min":135.35400000000001},"last":1.107}]},{"osd":6,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":2.028,"5min":1.272,"15min":1.073},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.41899999999999998},"max":{"1min":20.053999999999998,"5min":20.053999999999998,"15min":20.053999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.97099999999999997,"15min":1.0309999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.39800000000000002},"max":{"1min":3.9049999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":0.93000000000000005}]},{"osd":7,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.101,"15min":1.0760000000000001},"min":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.44400000000000001},"max":{"1min":1.9810000000000001,"5min":4.2229999999999999,"15min":6.0720000000000001},"last":1.002},{"interface":"front","average":{"1min":1.536,"5min":1.0940000000000001,"15min":1.1140000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.40899999999999997},"max":{"1min":11.916,"5min":11.916,"15min":11.916},"last":1.3160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834581404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5893400,"kb_used_data":5095888,"kb_used_omap":33020,"kb_used_meta":764483,"kb_avail":88478440,"statfs":{"total":96636764160,"available":90601922560,"internally_reserved":0,"allocated":5218189312,"data_stored":5216219459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33813444,"internal_metadata":782830652},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.79800000000000004,"15min":0.747},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.254},{"interface":"front","average":{"1min":2.2930000000000001,"5min":1.044,"15min":0.91500000000000004},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.37},"max":{"1min":15.125,"5min":15.125,"15min":15.125},"last":1.127}]},{"osd":1,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.085,"15min":1.375},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":10.677,"5min":10.677,"15min":121.21599999999999},"last":1.155},{"interface":"front","average":{"1min":1.833,"5min":1.0589999999999999,"15min":1.304},"min":{"1min":0.46300000000000002,"5min":0.376,"15min":0.35199999999999998},"max":{"1min":10.699,"5min":10.699,"15min":121.19799999999999},"last":1.3200000000000001}]},{"osd":2,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4399999999999999,"5min":1.456,"15min":1.405},"min":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.40300000000000002},"max":{"1min":32.298000000000002,"5min":32.298000000000002,"15min":120.88800000000001},"last":1.304},{"interface":"front","average":{"1min":2.657,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40300000000000002},"max":{"1min":31.983000000000001,"5min":31.983000000000001,"15min":122.483},"last":1.083}]},{"osd":3,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.92400000000000004,"15min":1.599},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.42699999999999999},"max":{"1min":4.6150000000000002,"5min":4.6150000000000002,"15min":119.94199999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.0649999999999999,"15min":1.673},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.45200000000000001},"max":{"1min":8.9939999999999998,"5min":8.9939999999999998,"15min":129.40199999999999},"last":1.226}]},{"osd":5,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":0.97099999999999997,"15min":1.319},"min":{"1min":0.42899999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":8.968,"5min":8.968,"15min":105.523},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.99199999999999999,"15min":1.357},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.40699999999999997},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":104.76300000000001},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.097,"15min":0.98099999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":9.0280000000000005,"5min":9.0280000000000005,"15min":9.0280000000000005},"last":1.038},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0669999999999999,"15min":1.071},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.47299999999999998},"max":{"1min":4.3319999999999999,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":2.9449999999999998,"15min":1.6850000000000001},"min":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.432},"max":{"1min":4.6500000000000004,"5min":196.364,"15min":196.364},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.5349999999999999,"5min":3.0630000000000002,"15min":1.663},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.44400000000000001},"max":{"1min":9.0600000000000005,"5min":192.33199999999999,"15min":192.33199999999999},"last":1.484}]}]},{"osd":3,"up_from":13,"seq":55834581394,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5448904,"kb_used_data":4664640,"kb_used_omap":17824,"kb_used_meta":766431,"kb_avail":88922936,"statfs":{"total":96636764160,"available":91057086464,"internally_reserved":0,"allocated":4776591360,"data_stored":4774776014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18251807,"internal_metadata":784826337},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.74099999999999999,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.29899999999999999,"15min":0.28100000000000003},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":1.133}]},{"osd":1,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":0.92900000000000005,"15min":0.83999999999999997},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.27900000000000003},"max":{"1min":6.0659999999999998,"5min":8.25,"15min":8.25},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.083,"5min":0.91400000000000003,"15min":0.86599999999999999},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.32000000000000001},"max":{"1min":4.9930000000000003,"5min":8.2040000000000006,"15min":8.2040000000000006},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.8200000000000001,"15min":1.1659999999999999},"min":{"1min":0.44700000000000001,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":6.1029999999999998,"5min":84.156000000000006,"15min":84.156000000000006},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.859,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.34799999999999998},"max":{"1min":5.0270000000000001,"5min":90.442999999999998,"15min":90.442999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.0109999999999999,"15min":0.92700000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.0449999999999999,"15min":0.98299999999999998},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":10.448,"5min":10.448,"15min":10.448},"last":1.411}]},{"osd":5,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.92600000000000005,"15min":1.167},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.48799999999999999},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":55.159999999999997},"last":1.651},{"interface":"front","average":{"1min":1.6160000000000001,"5min":0.997,"15min":1.1679999999999999},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":13.651999999999999,"5min":13.651999999999999,"15min":54.234999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.107,"15min":1.075},"min":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":5.8680000000000003,"5min":6.2869999999999999,"15min":6.2869999999999999},"last":1.839},{"interface":"front","average":{"1min":1.327,"5min":1.0049999999999999,"15min":1.0860000000000001},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":6.3780000000000001,"5min":6.3780000000000001,"15min":12.545999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.0640000000000001,"15min":1.627},"min":{"1min":0.70399999999999996,"5min":0.56000000000000005,"15min":0.53500000000000003},"max":{"1min":6.2569999999999997,"5min":6.2569999999999997,"15min":187.14099999999999},"last":0.746},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.0820000000000001,"15min":1.6419999999999999},"min":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":187.03},"last":1.7909999999999999}]}]},{"osd":2,"up_from":13,"seq":55834581399,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6155536,"kb_used_data":5810376,"kb_used_omap":11211,"kb_used_meta":333940,"kb_avail":88216304,"statfs":{"total":96636764160,"available":90333495296,"internally_reserved":0,"allocated":5949825024,"data_stored":5947513689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11481051,"internal_metadata":341954597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.4199999999999999,"5min":7.5730000000000004,"15min":7.8390000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":3.218,"5min":3.218,"15min":4.8700000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":0.88200000000000001,"15min":0.82499999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.27800000000000002},"max":{"1min":9.5899999999999999,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.749},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.86499999999999999,"15min":0.88900000000000001},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.309},"max":{"1min":2.746,"5min":7.5330000000000004,"15min":9.4930000000000003},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":0.96799999999999997,"15min":0.94199999999999995},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.35699999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.4809999999999999,"5min":7.4889999999999999,"15min":7.7690000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":2.7749999999999999,"5min":1.2230000000000001,"15min":1.0169999999999999},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.435},"max":{"1min":30.73,"5min":30.73,"15min":30.73},"last":0.84599999999999997},{"interface":"front","average":{"1min":3.0150000000000001,"5min":1.333,"15min":1.091},"min":{"1min":0.54000000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":30.786000000000001,"5min":30.786000000000001,"15min":30.786000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.0349999999999999,"15min":0.98099999999999998},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.9930000000000003,"5min":5.9930000000000003,"15min":7.806},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.98699999999999999,"15min":1.0169999999999999},"min":{"1min":0.55600000000000005,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":3.1859999999999999,"5min":4.4669999999999996,"15min":7.3650000000000002},"last":0.80000000000000004}]},{"osd":6,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.101,"15min":1.669},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":9.3339999999999996,"5min":9.3339999999999996,"15min":88.555999999999997},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.0369999999999999,"15min":1.6759999999999999},"min":{"1min":0.55000000000000004,"5min":0.51600000000000001,"15min":0.47299999999999998},"max":{"1min":5.117,"5min":5.117,"15min":88.912000000000006},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.0660000000000001,"15min":1.0489999999999999},"min":{"1min":0.63100000000000001,"5min":0.57299999999999995,"15min":0.52400000000000002},"max":{"1min":6.1779999999999999,"5min":6.1779999999999999,"15min":6.1779999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.1519999999999999,"15min":1.133},"min":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.51400000000000001},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.82799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834581409,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3314676,"kb_used_data":2236972,"kb_used_omap":24790,"kb_used_meta":1052905,"kb_avail":91057164,"statfs":{"total":96636764160,"available":93242535936,"internally_reserved":0,"allocated":2290659328,"data_stored":2289653977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25385484,"internal_metadata":1078175220},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.245},"max":{"1min":1.6120000000000001,"5min":1.8340000000000001,"15min":2.8530000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.748},"min":{"1min":0.32600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.653,"5min":2.3250000000000002,"15min":5.4880000000000004},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.70899999999999996},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.615,"15min":4.202},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.81699999999999995},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32300000000000001},"max":{"1min":1.492,"5min":2.2149999999999999,"15min":5.181},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":1.339,"5min":2.8039999999999998,"15min":5.4569999999999999},"last":0.628},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.749,"15min":0.82099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":1.292,"5min":2.367,"15min":5.4050000000000002},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.93799999999999994},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.694,"5min":4.0039999999999996,"15min":12.132},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.874,"5min":0.99299999999999999,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":1.407,"5min":4.952,"15min":11.561},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0029999999999999},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3580000000000001,"5min":4.29,"15min":5.9489999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.93400000000000005,"15min":0.98099999999999998},"min":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.501},"max":{"1min":1.49,"5min":4.0570000000000004,"15min":6.8209999999999997},"last":0.83899999999999997}]},{"osd":6,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1,"15min":1.048},"min":{"1min":0.59099999999999997,"5min":0.53600000000000003,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":4.1630000000000003,"15min":5.5720000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.014,"15min":1.038},"min":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5289999999999999,"5min":4.6710000000000003,"15min":5.625},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.1870000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50900000000000001},"max":{"1min":3.972,"5min":6.0599999999999996,"15min":41.878999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.98899999999999999,"15min":1.2350000000000001},"min":{"1min":0.65500000000000003,"5min":0.55600000000000005,"15min":0.54500000000000004},"max":{"1min":1.706,"5min":2.4710000000000001,"15min":41.908000000000001},"last":1.1040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834581399,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5739580,"kb_used_data":4643828,"kb_used_omap":20344,"kb_used_meta":1075399,"kb_avail":88632260,"statfs":{"total":96636764160,"available":90759434240,"internally_reserved":0,"allocated":4755279872,"data_stored":4753492370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20832578,"internal_metadata":1101209278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.522,"15min":0.97299999999999998},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":6.6630000000000003,"5min":65.247,"15min":65.247},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.5269999999999999,"15min":0.99099999999999999},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.718,"5min":63.713999999999999,"15min":63.713999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.9299999999999999,"5min":1.034,"15min":0.89000000000000001},"min":{"1min":0.318,"5min":0.312,"15min":0.31},"max":{"1min":17.765999999999998,"5min":17.765999999999998,"15min":17.765999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":2.3799999999999999,"5min":1.103,"15min":0.83999999999999997},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.32100000000000001},"max":{"1min":32.375,"5min":32.375,"15min":32.375},"last":0.502}]},{"osd":3,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.2609999999999999,"15min":1},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1319999999999997,"5min":35.847999999999999,"15min":35.847999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.3120000000000001,"15min":1.0189999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.38400000000000001},"max":{"1min":3.7330000000000001,"5min":35.762,"15min":35.762},"last":1.0669999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86299999999999999,"15min":1.4630000000000001},"min":{"1min":0.52200000000000002,"5min":0.45200000000000001,"15min":0.39600000000000002},"max":{"1min":1.46,"5min":2.8559999999999999,"15min":174.31299999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.91600000000000004,"15min":1.522},"min":{"1min":0.503,"5min":0.47599999999999998,"15min":0.44800000000000001},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":174.25299999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":2.9700000000000002,"5min":1.49,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":40.771000000000001,"5min":40.771000000000001,"15min":40.771000000000001},"last":1.03},{"interface":"front","average":{"1min":2.867,"5min":1.4810000000000001,"15min":1.1160000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":40.357999999999997,"5min":40.357999999999997,"15min":40.357999999999997},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.0409999999999999,"15min":1.03},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":4.165,"5min":4.165,"15min":8.9109999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.169,"15min":1.0880000000000001},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":1.107}]},{"osd":7,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.216,"15min":2.004},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.501},"max":{"1min":3.5059999999999998,"5min":5.2309999999999999,"15min":174.10499999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.0680000000000001,"15min":2.0470000000000002},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.194,"5min":4.194,"15min":174.35900000000001},"last":1.643}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T20:19:29.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T20:19:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.781+0000 7f18053ce700 1 Processor -- start 2023-06-09T20:19:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.781+0000 7f18053ce700 1 -- start start 2023-06-09T20:19:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.781+0000 7f18053ce700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f180015c880 0x7f180006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.781+0000 7f18053ce700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18000c7cb0 0x7f180006a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:29.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.781+0000 7f17fffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f180006fc80 0x7f1800070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58054/0 (socket says 172.21.15.78:58054) 2023-06-09T20:19:29.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f17ff7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f180015c880 0x7f180006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18000c7cb0 0x7f180006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f17ff7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f180015c880 0x7f180006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53806/0 (socket says 172.21.15.78:53806) 2023-06-09T20:19:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f18000c7cb0 0x7f180006a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54498/0 (socket says 172.21.15.78:54498) 2023-06-09T20:19:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 -- 172.21.15.78:0/1134897942 learned_addr learned my addr 172.21.15.78:0/1134897942 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000c87a0 con 0x7f180006fc80 2023-06-09T20:19:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000c81e0 con 0x7f18000c7cb0 2023-06-09T20:19:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000c84c0 con 0x7f180015c880 2023-06-09T20:19:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f17feffd700 1 -- 172.21.15.78:0/1134897942 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407861440 0 0) 0x7f18000c87a0 con 0x7f180006fc80 2023-06-09T20:19:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 -- 172.21.15.78:0/1134897942 >> v2:172.21.15.187:3300/0 conn(0x7f180015c880 msgr2=0x7f180006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 --2- 172.21.15.78:0/1134897942 >> v2:172.21.15.187:3300/0 conn(0x7f180015c880 0x7f180006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 -- 172.21.15.78:0/1134897942 >> v1:172.21.15.78:6789/0 conn(0x7f180006fc80 legacy=0x7f1800070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 -- 172.21.15.78:0/1134897942 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180006a070 con 0x7f18000c7cb0 2023-06-09T20:19:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f1804bcd700 1 --2- 172.21.15.78:0/1134897942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f180006a870 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009e50 tx=0x7f17f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b0564fa324fce5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f17feffd700 1 -- 172.21.15.78:0/1134897942 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800e070 con 0x7f18000c7cb0 2023-06-09T20:19:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f17feffd700 1 -- 172.21.15.78:0/1134897942 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800b8d0 con 0x7f18000c7cb0 2023-06-09T20:19:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f17feffd700 1 -- 172.21.15.78:0/1134897942 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800bc80 con 0x7f18000c7cb0 2023-06-09T20:19:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 msgr2=0x7f180006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.785+0000 7f18053ce700 1 --2- 172.21.15.78:0/1134897942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f180006a870 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009e50 tx=0x7f17f800b330 comp rx=0 tx=0).stop 2023-06-09T20:19:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 shutdown_connections 2023-06-09T20:19:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 --2- 172.21.15.78:0/1134897942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f180006a870 unknown :-1 s=CLOSED pgs=3267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 --2- 172.21.15.78:0/1134897942 >> v2:172.21.15.187:3300/0 conn(0x7f180015c880 0x7f180006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 >> 172.21.15.78:0/1134897942 conn(0x7f18000cf870 msgr2=0x7f18000cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 shutdown_connections 2023-06-09T20:19:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 -- 172.21.15.78:0/1134897942 wait complete. 2023-06-09T20:19:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 Processor -- start 2023-06-09T20:19:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.789+0000 7f18053ce700 1 -- start start 2023-06-09T20:19:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f180006fc80 0x7f18000ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f18000d1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180015c880 0x7f1800148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800149480 con 0x7f18000c7cb0 2023-06-09T20:19:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000cb190 con 0x7f180015c880 2023-06-09T20:19:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000cb470 con 0x7f180006fc80 2023-06-09T20:19:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f18000d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f18000d1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54510/0 (socket says 172.21.15.78:54510) 2023-06-09T20:19:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 -- 172.21.15.78:0/2937295514 learned_addr learned my addr 172.21.15.78:0/2937295514 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17fffff700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f180006fc80 0x7f18000ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f1804bcd700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180015c880 0x7f1800148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 -- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f180006fc80 msgr2=0x7f18000ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f180006fc80 0x7f18000ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 -- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180015c880 msgr2=0x7f1800148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180015c880 0x7f1800148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 -- 172.21.15.78:0/2937295514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009b30 con 0x7f18000c7cb0 2023-06-09T20:19:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17ff7fe700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f18000d1880 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7f17f400e840 tx=0x7f17f400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17fcff9700 1 -- 172.21.15.78:0/2937295514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f40095a0 con 0x7f18000c7cb0 2023-06-09T20:19:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17fcff9700 1 -- 172.21.15.78:0/2937295514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f4013680 con 0x7f18000c7cb0 2023-06-09T20:19:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f17fcff9700 1 -- 172.21.15.78:0/2937295514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f40139f0 con 0x7f18000c7cb0 2023-06-09T20:19:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 -- 172.21.15.78:0/2937295514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180006e490 con 0x7f18000c7cb0 2023-06-09T20:19:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 -- 172.21.15.78:0/2937295514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180006a350 con 0x7f18000c7cb0 2023-06-09T20:19:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.793+0000 7f18053ce700 1 -- 172.21.15.78:0/2937295514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18000741c0 con 0x7f18000c7cb0 2023-06-09T20:19:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.797+0000 7f17fcff9700 1 -- 172.21.15.78:0/2937295514 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17f4013b50 con 0x7f18000c7cb0 2023-06-09T20:19:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.801+0000 7f17fcff9700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f17ec0663c0 0x7f17ec068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.801+0000 7f17fcff9700 1 -- 172.21.15.78:0/2937295514 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f17f40838c0 con 0x7f18000c7cb0 2023-06-09T20:19:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.801+0000 7f17fffff700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f17ec0663c0 0x7f17ec068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.801+0000 7f17fffff700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f17ec0663c0 0x7f17ec068870 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f17f0000f60 tx=0x7f17f0007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:29.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:29.805+0000 7f17fcff9700 1 -- 172.21.15.78:0/2937295514 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f17f4054b60 con 0x7f18000c7cb0 2023-06-09T20:19:30.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.185+0000 7f18053ce700 1 -- 172.21.15.78:0/2937295514 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f180006ef40 con 0x7f17ec0663c0 2023-06-09T20:19:30.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.193+0000 7f17fcff9700 1 -- 172.21.15.78:0/2937295514 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71439 (secure 0 0 0) 0x7f180006ef40 con 0x7f17ec0663c0 2023-06-09T20:19:30.211 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 -- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f17ec0663c0 msgr2=0x7f17ec068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:30.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f17ec0663c0 0x7f17ec068870 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f17f0000f60 tx=0x7f17f0007c00 comp rx=0 tx=0).stop 2023-06-09T20:19:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 -- 172.21.15.78:0/2937295514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 msgr2=0x7f18000d1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f18000d1880 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7f17f400e840 tx=0x7f17f400eb50 comp rx=0 tx=0).stop 2023-06-09T20:19:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 -- 172.21.15.78:0/2937295514 shutdown_connections 2023-06-09T20:19:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f17ec0663c0 0x7f17ec068870 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180015c880 0x7f1800148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18000c7cb0 0x7f18000d1880 unknown :-1 s=CLOSED pgs=3268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 --2- 172.21.15.78:0/2937295514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f180006fc80 0x7f18000ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 -- 172.21.15.78:0/2937295514 >> 172.21.15.78:0/2937295514 conn(0x7f18000cf870 msgr2=0x7f180015b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 -- 172.21.15.78:0/2937295514 shutdown_connections 2023-06-09T20:19:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.209+0000 7f17e67fc700 1 -- 172.21.15.78:0/2937295514 wait complete. 2023-06-09T20:19:30.239 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T20:19:30.243 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":16454,"stamp":"2023-06-09T20:19:29.554160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35446672,"kb_used_data":28380816,"kb_used_omap":164701,"kb_used_meta":6901090,"kb_avail":719528048,"statfs":{"total":773094113280,"available":736796721152,"internally_reserved":0,"allocated":29061955584,"data_stored":29050173637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":168654543,"internal_metadata":7066716465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":585,"apply_latency_ms":585,"commit_latency_ns":585000000,"apply_latency_ns":585000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36526046105,"num_objects":-27300,"num_object_clones":0,"num_object_copies":-54600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27300,"num_whiteouts":0,"num_read":-1370902,"num_read_kb":-413493825,"num_write":-3519517,"num_write_kb":-590846652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.727114"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":480,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.432797+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T20:19:25.432797+0000","last_peered":"2023-06-09T20:19:25.432797+0000","last_clean":"2023-06-09T20:19:25.432797+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T20:19:25.432797+0000","last_undegraded":"2023-06-09T20:19:25.432797+0000","last_fullsized":"2023-06-09T20:19:25.432797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:35.276528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":319,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.882958+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T20:19:23.882958+0000","last_peered":"2023-06-09T20:19:23.882958+0000","last_clean":"2023-06-09T20:19:23.882958+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T20:19:23.882958+0000","last_undegraded":"2023-06-09T20:19:23.882958+0000","last_fullsized":"2023-06-09T20:19:23.882958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:45:26.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":324,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.432136+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T20:19:25.432136+0000","last_peered":"2023-06-09T20:19:25.432136+0000","last_clean":"2023-06-09T20:19:25.432136+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T20:19:25.432136+0000","last_undegraded":"2023-06-09T20:19:25.432136+0000","last_fullsized":"2023-06-09T20:19:25.432136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:03:32.866197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.630092+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T20:19:23.630092+0000","last_peered":"2023-06-09T20:19:23.630092+0000","last_clean":"2023-06-09T20:19:23.630092+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T20:19:23.630092+0000","last_undegraded":"2023-06-09T20:19:23.630092+0000","last_fullsized":"2023-06-09T20:19:23.630092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:53:46.570598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":319,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.882165+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T20:19:23.882165+0000","last_peered":"2023-06-09T20:19:23.882165+0000","last_clean":"2023-06-09T20:19:23.882165+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T20:19:23.882165+0000","last_undegraded":"2023-06-09T20:19:23.882165+0000","last_fullsized":"2023-06-09T20:19:23.882165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:02:34.231405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.161300+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T20:19:25.161300+0000","last_peered":"2023-06-09T20:19:25.161300+0000","last_clean":"2023-06-09T20:19:25.161300+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T20:19:25.161300+0000","last_undegraded":"2023-06-09T20:19:25.161300+0000","last_fullsized":"2023-06-09T20:19:25.161300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:01:51.521324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":313,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.441400+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T20:19:25.441400+0000","last_peered":"2023-06-09T20:19:25.441400+0000","last_clean":"2023-06-09T20:19:25.441400+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T20:19:25.441400+0000","last_undegraded":"2023-06-09T20:19:25.441400+0000","last_fullsized":"2023-06-09T20:19:25.441400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:36.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.164138+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T20:19:25.164138+0000","last_peered":"2023-06-09T20:19:25.164138+0000","last_clean":"2023-06-09T20:19:25.164138+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T20:19:25.164138+0000","last_undegraded":"2023-06-09T20:19:25.164138+0000","last_fullsized":"2023-06-09T20:19:25.164138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:18:47.506917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":301,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.418390+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T20:19:25.418390+0000","last_peered":"2023-06-09T20:19:25.418390+0000","last_clean":"2023-06-09T20:19:25.418390+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T20:19:25.418390+0000","last_undegraded":"2023-06-09T20:19:25.418390+0000","last_fullsized":"2023-06-09T20:19:25.418390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:40:02.219798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5169064,"kb_used_data":4415712,"kb_used_omap":15347,"kb_used_meta":737996,"kb_avail":89202776,"statfs":{"total":96636764160,"available":91343642624,"internally_reserved":0,"allocated":4521689088,"data_stored":4519821891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715521,"internal_metadata":755708735},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":103,"apply_latency_ms":103,"commit_latency_ns":103000000,"apply_latency_ns":103000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":1.661,"5min":6.6429999999999998,"15min":6.6429999999999998},"last":2.1880000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.76200000000000001,"15min":0.79700000000000004},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.84599999999999997,"5min":4.3700000000000001,"15min":6.9340000000000002},"last":2.3839999999999999}]},{"osd":1,"last update":"Fri Jun 9 20:19:02 2023","interfaces":[{"interface":"back","average":{"1min":6.6509999999999998,"5min":1.964,"15min":1.2629999999999999},"min":{"1min":0.38,"5min":0.371,"15min":0.33500000000000002},"max":{"1min":106.97,"5min":106.97,"15min":106.97},"last":0.92900000000000005},{"interface":"front","average":{"1min":6.5869999999999997,"5min":1.966,"15min":1.284},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":107.06100000000001,"5min":107.06100000000001,"15min":107.06100000000001},"last":1.107}]},{"osd":2,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":0.92300000000000004},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.38700000000000001},"max":{"1min":3.2970000000000002,"5min":6.5330000000000004,"15min":11.923},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.92700000000000005,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6639999999999999,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":1.149},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.3319999999999999,"5min":4.1459999999999999,"15min":59.793999999999997},"last":1.865},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.93899999999999995,"15min":1.167},"min":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"max":{"1min":1.486,"5min":3.6890000000000001,"15min":60.773000000000003},"last":1.754}]},{"osd":4,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":3.9700000000000002,"5min":1.5509999999999999,"15min":1.1499999999999999},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":54.104999999999997,"5min":54.104999999999997,"15min":54.104999999999997},"last":0.82199999999999995},{"interface":"front","average":{"1min":4.46,"5min":1.6619999999999999,"15min":1.194},"min":{"1min":0.52600000000000002,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":53.810000000000002,"5min":53.810000000000002,"15min":53.810000000000002},"last":1.083}]},{"osd":5,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":2.4769999999999999,"15min":1.5089999999999999},"min":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.42399999999999999},"max":{"1min":3.0449999999999999,"5min":131.97200000000001,"15min":131.97200000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":2.5800000000000001,"15min":1.6619999999999999},"min":{"1min":0.52400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":2.911,"5min":134.97499999999999,"15min":134.97499999999999},"last":1.2749999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0229999999999999,"15min":1.2569999999999999},"min":{"1min":0.627,"5min":0.55700000000000005,"15min":0.499},"max":{"1min":1.1859999999999999,"5min":4.4950000000000001,"15min":61.345999999999997},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.0980000000000001,"15min":1.2829999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":3.266,"5min":4.2569999999999997,"15min":60.165999999999997},"last":1.1719999999999999}]}]},{"osd":6,"up_from":13,"seq":55834581407,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5127356,"kb_used_data":3969396,"kb_used_omap":10585,"kb_used_meta":1147366,"kb_avail":89244484,"statfs":{"total":96636764160,"available":91386351616,"internally_reserved":0,"allocated":4064661504,"data_stored":4063081755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10840012,"internal_metadata":1174902836},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":92,"apply_latency_ms":92,"commit_latency_ns":92000000,"apply_latency_ns":92000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70299999999999996,"15min":0.74399999999999999},"min":{"1min":0.34100000000000003,"5min":0.308,"15min":0.308},"max":{"1min":1.542,"5min":3.1760000000000002,"15min":7.4050000000000002},"last":1.3839999999999999},{"interface":"front","average":{"1min":2.0049999999999999,"5min":0.94899999999999995,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":26.532,"5min":26.532,"15min":26.532},"last":1.101}]},{"osd":1,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":1.446},{"interface":"front","average":{"1min":1.143,"5min":0.86399999999999999,"15min":0.86699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.33700000000000002},"max":{"1min":7.5039999999999996,"5min":7.5039999999999996,"15min":7.5039999999999996},"last":1.5}]},{"osd":2,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":0.85999999999999999,"15min":0.91600000000000004},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":7.5259999999999998,"5min":7.5259999999999998,"15min":14.003},"last":1.286},{"interface":"front","average":{"1min":0.878,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":1.98,"5min":3.4390000000000001,"15min":6.4199999999999999},"last":1.2150000000000001}]},{"osd":3,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.3260000000000001,"15min":1.0700000000000001},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.42199999999999999},"max":{"1min":2.008,"5min":39.442999999999998,"15min":39.442999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.26,"15min":1.1279999999999999},"min":{"1min":0.47599999999999998,"5min":0.441,"15min":0.441},"max":{"1min":3.335,"5min":39.011000000000003,"15min":39.011000000000003},"last":1.615}]},{"osd":4,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91400000000000003,"15min":1.5169999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33000000000000002},"max":{"1min":1.609,"5min":4.0659999999999998,"15min":162.25399999999999},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.077,"5min":0.873,"15min":1.5940000000000001},"min":{"1min":0.52200000000000002,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":3.294,"5min":3.294,"15min":162.19900000000001},"last":1.4650000000000001}]},{"osd":5,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":3.2290000000000001,"5min":2.6589999999999998,"15min":1.5489999999999999},"min":{"1min":0.47499999999999998,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":47.223999999999997,"5min":126.22,"15min":126.22},"last":1.573},{"interface":"front","average":{"1min":5.194,"5min":3.1179999999999999,"15min":1.714},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.38800000000000001},"max":{"1min":47.131,"5min":133.33000000000001,"15min":133.33000000000001},"last":1.5940000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.93200000000000005,"15min":1.738},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.907,"5min":3.907,"15min":96.753},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":1.756},"min":{"1min":0.51000000000000001,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":2.0350000000000001,"5min":3.4670000000000001,"15min":101.806},"last":1.52}]}]},{"osd":5,"up_from":13,"seq":55834581403,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4856048,"kb_used_data":3793128,"kb_used_omap":31576,"kb_used_meta":1031335,"kb_avail":89515792,"statfs":{"total":96636764160,"available":91664171008,"internally_reserved":0,"allocated":3884163072,"data_stored":3882635961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32334646,"internal_metadata":1056087242},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":110,"apply_latency_ms":110,"commit_latency_ns":110000000,"apply_latency_ns":110000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.75900000000000001,"15min":1.732},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.31},"max":{"1min":8.2210000000000001,"5min":8.2210000000000001,"15min":150.52699999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":1.8149999999999999},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.33000000000000002},"max":{"1min":2.669,"5min":4.1779999999999999,"15min":151.72900000000001},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.5309999999999999,"15min":1.0609999999999999},"min":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":9.9000000000000004,"5min":53.021999999999998,"15min":53.021999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.389,"5min":1.8069999999999999,"15min":1.177},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.376},"max":{"1min":9.9800000000000004,"5min":53.197000000000003,"15min":53.197000000000003},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":0.872,"15min":1.2},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":8.173,"5min":8.173,"15min":97.159999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":1.181},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0589999999999999,"5min":1.4790000000000001,"15min":97.531000000000006},"last":1.1479999999999999}]},{"osd":3,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.107,"15min":0.98599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.41499999999999998},"max":{"1min":8.2029999999999994,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.006},{"interface":"front","average":{"1min":1.377,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.54500000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.2889999999999997,"5min":8.2889999999999997,"15min":8.2889999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":2.4820000000000002,"15min":1.4690000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.36399999999999999},"max":{"1min":8.2569999999999997,"5min":136.20500000000001,"15min":136.20500000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.024,"5min":2.3559999999999999,"15min":1.4450000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36599999999999999},"max":{"1min":5.8079999999999998,"5min":135.35400000000001,"15min":135.35400000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":2.028,"5min":1.272,"15min":1.073},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.41899999999999998},"max":{"1min":20.053999999999998,"5min":20.053999999999998,"15min":20.053999999999998},"last":1.054},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.97099999999999997,"15min":1.0309999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.39800000000000002},"max":{"1min":3.9049999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":1.115}]},{"osd":7,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.101,"15min":1.0760000000000001},"min":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.44400000000000001},"max":{"1min":1.9810000000000001,"5min":4.2229999999999999,"15min":6.0720000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.0940000000000001,"15min":1.1140000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.40899999999999997},"max":{"1min":11.916,"5min":11.916,"15min":11.916},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834581404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5893400,"kb_used_data":5095888,"kb_used_omap":33020,"kb_used_meta":764483,"kb_avail":88478440,"statfs":{"total":96636764160,"available":90601922560,"internally_reserved":0,"allocated":5218189312,"data_stored":5216219459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33813444,"internal_metadata":782830652},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.79800000000000004,"15min":0.747},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.254},{"interface":"front","average":{"1min":2.2930000000000001,"5min":1.044,"15min":0.91500000000000004},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.37},"max":{"1min":15.125,"5min":15.125,"15min":15.125},"last":1.127}]},{"osd":1,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.085,"15min":1.375},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":10.677,"5min":10.677,"15min":121.21599999999999},"last":1.155},{"interface":"front","average":{"1min":1.833,"5min":1.0589999999999999,"15min":1.304},"min":{"1min":0.46300000000000002,"5min":0.376,"15min":0.35199999999999998},"max":{"1min":10.699,"5min":10.699,"15min":121.19799999999999},"last":1.3200000000000001}]},{"osd":2,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4399999999999999,"5min":1.456,"15min":1.405},"min":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.40300000000000002},"max":{"1min":32.298000000000002,"5min":32.298000000000002,"15min":120.88800000000001},"last":1.304},{"interface":"front","average":{"1min":2.657,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40300000000000002},"max":{"1min":31.983000000000001,"5min":31.983000000000001,"15min":122.483},"last":1.083}]},{"osd":3,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.92400000000000004,"15min":1.599},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.42699999999999999},"max":{"1min":4.6150000000000002,"5min":4.6150000000000002,"15min":119.94199999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.0649999999999999,"15min":1.673},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.45200000000000001},"max":{"1min":8.9939999999999998,"5min":8.9939999999999998,"15min":129.40199999999999},"last":1.226}]},{"osd":5,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":0.97099999999999997,"15min":1.319},"min":{"1min":0.42899999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":8.968,"5min":8.968,"15min":105.523},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.99199999999999999,"15min":1.357},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.40699999999999997},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":104.76300000000001},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.097,"15min":0.98099999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":9.0280000000000005,"5min":9.0280000000000005,"15min":9.0280000000000005},"last":1.038},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0669999999999999,"15min":1.071},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.47299999999999998},"max":{"1min":4.3319999999999999,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":2.9449999999999998,"15min":1.6850000000000001},"min":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.432},"max":{"1min":4.6500000000000004,"5min":196.364,"15min":196.364},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.5349999999999999,"5min":3.0630000000000002,"15min":1.663},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.44400000000000001},"max":{"1min":9.0600000000000005,"5min":192.33199999999999,"15min":192.33199999999999},"last":1.484}]}]},{"osd":3,"up_from":13,"seq":55834581394,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5448904,"kb_used_data":4664640,"kb_used_omap":17824,"kb_used_meta":766431,"kb_avail":88922936,"statfs":{"total":96636764160,"available":91057086464,"internally_reserved":0,"allocated":4776591360,"data_stored":4774776014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18251807,"internal_metadata":784826337},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.74099999999999999,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.29899999999999999,"15min":0.28100000000000003},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":1.133}]},{"osd":1,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":0.92900000000000005,"15min":0.83999999999999997},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.27900000000000003},"max":{"1min":6.0659999999999998,"5min":8.25,"15min":8.25},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.083,"5min":0.91400000000000003,"15min":0.86599999999999999},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.32000000000000001},"max":{"1min":4.9930000000000003,"5min":8.2040000000000006,"15min":8.2040000000000006},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.8200000000000001,"15min":1.1659999999999999},"min":{"1min":0.44700000000000001,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":6.1029999999999998,"5min":84.156000000000006,"15min":84.156000000000006},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.859,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.34799999999999998},"max":{"1min":5.0270000000000001,"5min":90.442999999999998,"15min":90.442999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.0109999999999999,"15min":0.92700000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.0449999999999999,"15min":0.98299999999999998},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":10.448,"5min":10.448,"15min":10.448},"last":1.411}]},{"osd":5,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.92600000000000005,"15min":1.167},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.48799999999999999},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":55.159999999999997},"last":1.651},{"interface":"front","average":{"1min":1.6160000000000001,"5min":0.997,"15min":1.1679999999999999},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":13.651999999999999,"5min":13.651999999999999,"15min":54.234999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.107,"15min":1.075},"min":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":5.8680000000000003,"5min":6.2869999999999999,"15min":6.2869999999999999},"last":1.839},{"interface":"front","average":{"1min":1.327,"5min":1.0049999999999999,"15min":1.0860000000000001},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":6.3780000000000001,"5min":6.3780000000000001,"15min":12.545999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.0640000000000001,"15min":1.627},"min":{"1min":0.70399999999999996,"5min":0.56000000000000005,"15min":0.53500000000000003},"max":{"1min":6.2569999999999997,"5min":6.2569999999999997,"15min":187.14099999999999},"last":0.746},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.0820000000000001,"15min":1.6419999999999999},"min":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":187.03},"last":1.7909999999999999}]}]},{"osd":2,"up_from":13,"seq":55834581400,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2878976,"kb_used_data":2546744,"kb_used_omap":11211,"kb_used_meta":321012,"kb_avail":91492864,"statfs":{"total":96636764160,"available":93688692736,"internally_reserved":0,"allocated":2607865856,"data_stored":2606679757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11481051,"internal_metadata":328716325},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":93,"apply_latency_ms":93,"commit_latency_ns":93000000,"apply_latency_ns":93000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.4199999999999999,"5min":7.5730000000000004,"15min":7.8390000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":3.218,"5min":3.218,"15min":4.8700000000000001},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":0.88200000000000001,"15min":0.82499999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.27800000000000002},"max":{"1min":9.5899999999999999,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.86499999999999999,"15min":0.88900000000000001},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.309},"max":{"1min":2.746,"5min":7.5330000000000004,"15min":9.4930000000000003},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":0.96799999999999997,"15min":0.94199999999999995},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.35699999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.4809999999999999,"5min":7.4889999999999999,"15min":7.7690000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":2.7749999999999999,"5min":1.2230000000000001,"15min":1.0169999999999999},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.435},"max":{"1min":30.73,"5min":30.73,"15min":30.73},"last":0.47299999999999998},{"interface":"front","average":{"1min":3.0150000000000001,"5min":1.333,"15min":1.091},"min":{"1min":0.54000000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":30.786000000000001,"5min":30.786000000000001,"15min":30.786000000000001},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.0349999999999999,"15min":0.98099999999999998},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.9930000000000003,"5min":5.9930000000000003,"15min":7.806},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.98699999999999999,"15min":1.0169999999999999},"min":{"1min":0.55600000000000005,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":3.1859999999999999,"5min":4.4669999999999996,"15min":7.3650000000000002},"last":0.438}]},{"osd":6,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.101,"15min":1.669},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":9.3339999999999996,"5min":9.3339999999999996,"15min":88.555999999999997},"last":30.975999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.0369999999999999,"15min":1.6759999999999999},"min":{"1min":0.55000000000000004,"5min":0.51600000000000001,"15min":0.47299999999999998},"max":{"1min":5.117,"5min":5.117,"15min":88.912000000000006},"last":29.460999999999999}]},{"osd":7,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.0660000000000001,"15min":1.0489999999999999},"min":{"1min":0.63100000000000001,"5min":0.57299999999999995,"15min":0.52400000000000002},"max":{"1min":6.1779999999999999,"5min":6.1779999999999999,"15min":6.1779999999999999},"last":29.219999999999999},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.1519999999999999,"15min":1.133},"min":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.51400000000000001},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":29.265000000000001}]}]},{"osd":1,"up_from":13,"seq":55834581409,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3314676,"kb_used_data":2236972,"kb_used_omap":24790,"kb_used_meta":1052905,"kb_avail":91057164,"statfs":{"total":96636764160,"available":93242535936,"internally_reserved":0,"allocated":2290659328,"data_stored":2289653977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25385484,"internal_metadata":1078175220},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.245},"max":{"1min":1.6120000000000001,"5min":1.8340000000000001,"15min":2.8530000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.748},"min":{"1min":0.32600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.653,"5min":2.3250000000000002,"15min":5.4880000000000004},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.70899999999999996},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.615,"15min":4.202},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.81699999999999995},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32300000000000001},"max":{"1min":1.492,"5min":2.2149999999999999,"15min":5.181},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":1.339,"5min":2.8039999999999998,"15min":5.4569999999999999},"last":0.628},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.749,"15min":0.82099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":1.292,"5min":2.367,"15min":5.4050000000000002},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.93799999999999994},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.694,"5min":4.0039999999999996,"15min":12.132},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.874,"5min":0.99299999999999999,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":1.407,"5min":4.952,"15min":11.561},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0029999999999999},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3580000000000001,"5min":4.29,"15min":5.9489999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.93400000000000005,"15min":0.98099999999999998},"min":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.501},"max":{"1min":1.49,"5min":4.0570000000000004,"15min":6.8209999999999997},"last":0.83899999999999997}]},{"osd":6,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1,"15min":1.048},"min":{"1min":0.59099999999999997,"5min":0.53600000000000003,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":4.1630000000000003,"15min":5.5720000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.014,"15min":1.038},"min":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5289999999999999,"5min":4.6710000000000003,"15min":5.625},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.1870000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50900000000000001},"max":{"1min":3.972,"5min":6.0599999999999996,"15min":41.878999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.98899999999999999,"15min":1.2350000000000001},"min":{"1min":0.65500000000000003,"5min":0.55600000000000005,"15min":0.54500000000000004},"max":{"1min":1.706,"5min":2.4710000000000001,"15min":41.908000000000001},"last":1.1040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834581400,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2758248,"kb_used_data":1658336,"kb_used_omap":20344,"kb_used_meta":1079559,"kb_avail":91613592,"statfs":{"total":96636764160,"available":93812318208,"internally_reserved":0,"allocated":1698136064,"data_stored":1697304823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20832578,"internal_metadata":1105469118},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.522,"15min":0.97299999999999998},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":6.6630000000000003,"5min":65.247,"15min":65.247},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.5269999999999999,"15min":0.99099999999999999},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.718,"5min":63.713999999999999,"15min":63.713999999999999},"last":1.206}]},{"osd":2,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.9299999999999999,"5min":1.034,"15min":0.89000000000000001},"min":{"1min":0.318,"5min":0.312,"15min":0.31},"max":{"1min":17.765999999999998,"5min":17.765999999999998,"15min":17.765999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":2.3799999999999999,"5min":1.103,"15min":0.83999999999999997},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.32100000000000001},"max":{"1min":32.375,"5min":32.375,"15min":32.375},"last":1.095}]},{"osd":3,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.2609999999999999,"15min":1},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1319999999999997,"5min":35.847999999999999,"15min":35.847999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.3120000000000001,"15min":1.0189999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.38400000000000001},"max":{"1min":3.7330000000000001,"5min":35.762,"15min":35.762},"last":1.518}]},{"osd":4,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86299999999999999,"15min":1.4630000000000001},"min":{"1min":0.52200000000000002,"5min":0.45200000000000001,"15min":0.39600000000000002},"max":{"1min":1.46,"5min":2.8559999999999999,"15min":174.31299999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.91600000000000004,"15min":1.522},"min":{"1min":0.503,"5min":0.47599999999999998,"15min":0.44800000000000001},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":174.25299999999999},"last":1.617}]},{"osd":5,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":2.9700000000000002,"5min":1.49,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":40.771000000000001,"5min":40.771000000000001,"15min":40.771000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":2.867,"5min":1.4810000000000001,"15min":1.1160000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":40.357999999999997,"5min":40.357999999999997,"15min":40.357999999999997},"last":1.839}]},{"osd":6,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.0409999999999999,"15min":1.03},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":4.165,"5min":4.165,"15min":8.9109999999999996},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.169,"15min":1.0880000000000001},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":1.581}]},{"osd":7,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.216,"15min":2.004},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.501},"max":{"1min":3.5059999999999998,"5min":5.2309999999999999,"15min":174.10499999999999},"last":1.9039999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.0680000000000001,"15min":2.0470000000000002},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.194,"5min":4.194,"15min":174.35900000000001},"last":1.7929999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T20:19:30.245 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-09T20:19:30.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T20:19:30.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed313e700 1 Processor -- start 2023-06-09T20:19:30.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed313e700 1 -- start start 2023-06-09T20:19:30.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed313e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ecc1561a0 0x7f0ecc0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:30.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed313e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc159340 0x7f0ecc070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:30.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed313e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ecc159c50 con 0x7f0ecc15ce60 2023-06-09T20:19:30.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed313e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc159760 con 0x7f0ecc1561a0 2023-06-09T20:19:30.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed313e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc159970 con 0x7f0ecc159340 2023-06-09T20:19:30.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed193b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0ecc15ce60 0x7f0ecc158c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:53010/0 (socket says 172.21.15.78:53010) 2023-06-09T20:19:30.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed193b700 1 -- 172.21.15.78:0/2692079960 learned_addr learned my addr 172.21.15.78:0/2692079960 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:30.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.553+0000 7f0ed293d700 1 --2- 172.21.15.78:0/2692079960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc159340 0x7f0ecc070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:30.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.557+0000 7f0ed293d700 1 -- 172.21.15.78:0/2692079960 >> v2:172.21.15.78:3300/0 conn(0x7f0ecc1561a0 msgr2=0x7f0ecc0700d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T20:19:30.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.557+0000 7f0ed213c700 1 --2- 172.21.15.78:0/2692079960 >> v2:172.21.15.78:3300/0 conn(0x7f0ecc1561a0 0x7f0ecc0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:30.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.557+0000 7f0ed293d700 1 --2- 172.21.15.78:0/2692079960 >> v2:172.21.15.78:3300/0 conn(0x7f0ecc1561a0 0x7f0ecc0700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.557+0000 7f0ed293d700 1 -- 172.21.15.78:0/2692079960 >> v1:172.21.15.187:6789/0 conn(0x7f0ecc15ce60 legacy=0x7f0ecc158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:30.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.557+0000 7f0ed293d700 1 -- 172.21.15.78:0/2692079960 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc15c380 con 0x7f0ecc159340 2023-06-09T20:19:30.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.557+0000 7f0ed213c700 1 --2- 172.21.15.78:0/2692079960 >> v2:172.21.15.78:3300/0 conn(0x7f0ecc1561a0 0x7f0ecc0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T20:19:30.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.557+0000 7f0ed293d700 1 --2- 172.21.15.78:0/2692079960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc159340 0x7f0ecc070610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009850 tx=0x7f0ec8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bd849eb7a7c818 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:30.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.565+0000 7f0ed113a700 1 -- 172.21.15.78:0/2692079960 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8004230 con 0x7f0ecc159340 2023-06-09T20:19:30.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.565+0000 7f0ed113a700 1 -- 172.21.15.78:0/2692079960 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec8004390 con 0x7f0ecc159340 2023-06-09T20:19:30.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.565+0000 7f0ed313e700 1 -- 172.21.15.78:0/2692079960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc159340 msgr2=0x7f0ecc070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:30.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.565+0000 7f0ed313e700 1 --2- 172.21.15.78:0/2692079960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc159340 0x7f0ecc070610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009850 tx=0x7f0ec8009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:30.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.565+0000 7f0ed313e700 1 -- 172.21.15.78:0/2692079960 shutdown_connections 2023-06-09T20:19:30.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.565+0000 7f0ed313e700 1 --2- 172.21.15.78:0/2692079960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc159340 0x7f0ecc070610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.565+0000 7f0ed313e700 1 --2- 172.21.15.78:0/2692079960 >> v2:172.21.15.78:3300/0 conn(0x7f0ecc1561a0 0x7f0ecc0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.569+0000 7f0ed313e700 1 -- 172.21.15.78:0/2692079960 >> 172.21.15.78:0/2692079960 conn(0x7f0ecc0cb460 msgr2=0x7f0ecc0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:30.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.573+0000 7f0ed313e700 1 -- 172.21.15.78:0/2692079960 shutdown_connections 2023-06-09T20:19:30.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.573+0000 7f0ed313e700 1 -- 172.21.15.78:0/2692079960 wait complete. 2023-06-09T20:19:30.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.573+0000 7f0ed313e700 1 Processor -- start 2023-06-09T20:19:30.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed313e700 1 -- start start 2023-06-09T20:19:30.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed313e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc1561a0 0x7f0ecc158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:30.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed313e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ecc159340 0x7f0ecc156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:30.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed313e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc15ce60 0x7f0ecc145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:30.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed213c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc1561a0 0x7f0ecc158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:30.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed213c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc1561a0 0x7f0ecc158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40806/0 (socket says 172.21.15.78:40806) 2023-06-09T20:19:30.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ecc159340 0x7f0ecc156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:30.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ecc159340 0x7f0ecc156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53820/0 (socket says 172.21.15.78:53820) 2023-06-09T20:19:30.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed213c700 1 -- 172.21.15.78:0/1086088978 learned_addr learned my addr 172.21.15.78:0/1086088978 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:30.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc156db0 con 0x7f0ecc15ce60 2023-06-09T20:19:30.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc1465f0 con 0x7f0ecc159340 2023-06-09T20:19:30.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc145c40 con 0x7f0ecc1561a0 2023-06-09T20:19:30.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed293d700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc15ce60 0x7f0ecc145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 -- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc1561a0 msgr2=0x7f0ecc158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc1561a0 0x7f0ecc158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 -- 172.21.15.78:0/1086088978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc15ce60 msgr2=0x7f0ecc145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc15ce60 0x7f0ecc145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80094b0 con 0x7f0ecc159340 2023-06-09T20:19:30.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.577+0000 7f0ed193b700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ecc159340 0x7f0ecc156870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400ca40 tx=0x7f0ec400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:30.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.585+0000 7f0ec2ffd700 1 -- 172.21.15.78:0/1086088978 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400a7d0 con 0x7f0ecc159340 2023-06-09T20:19:30.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.585+0000 7f0ec2ffd700 1 -- 172.21.15.78:0/1086088978 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec400a950 con 0x7f0ecc159340 2023-06-09T20:19:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.585+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc15c940 con 0x7f0ecc159340 2023-06-09T20:19:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.585+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc15c660 con 0x7f0ecc159340 2023-06-09T20:19:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.585+0000 7f0ec2ffd700 1 -- 172.21.15.78:0/1086088978 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400ad00 con 0x7f0ecc159340 2023-06-09T20:19:30.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.593+0000 7f0ec2ffd700 1 -- 172.21.15.78:0/1086088978 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ec401c3b0 con 0x7f0ecc159340 2023-06-09T20:19:30.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.597+0000 7f0ec2ffd700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0eb0066340 0x7f0eb00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:30.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.597+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb4005310 con 0x7f0ecc159340 2023-06-09T20:19:30.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.597+0000 7f0ed213c700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0eb0066340 0x7f0eb00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:30.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.597+0000 7f0ed213c700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0eb0066340 0x7f0eb00687f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc006bc0 tx=0x7f0ebc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:30.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.613+0000 7f0ec2ffd700 1 -- 172.21.15.78:0/1086088978 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0ec4058630 con 0x7f0ecc159340 2023-06-09T20:19:30.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.621+0000 7f0ec2ffd700 1 -- 172.21.15.78:0/1086088978 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0ec4018020 con 0x7f0ecc159340 2023-06-09T20:19:31.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:30.997+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0eb4000bc0 con 0x7f0eb0066340 2023-06-09T20:19:31.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.001+0000 7f0ec2ffd700 1 -- 172.21.15.78:0/1086088978 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71439 (secure 0 0 0) 0x7f0eb4000bc0 con 0x7f0eb0066340 2023-06-09T20:19:31.010 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:31.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0eb0066340 msgr2=0x7f0eb00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0eb0066340 0x7f0eb00687f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc006bc0 tx=0x7f0ebc008040 comp rx=0 tx=0).stop 2023-06-09T20:19:31.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ecc159340 msgr2=0x7f0ecc156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ecc159340 0x7f0ecc156870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400ca40 tx=0x7f0ec400cd50 comp rx=0 tx=0).stop 2023-06-09T20:19:31.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 shutdown_connections 2023-06-09T20:19:31.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f0eb0066340 0x7f0eb00687f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ecc15ce60 0x7f0ecc145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ecc159340 0x7f0ecc156870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 --2- 172.21.15.78:0/1086088978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ecc1561a0 0x7f0ecc158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 >> 172.21.15.78:0/1086088978 conn(0x7f0ecc0cb460 msgr2=0x7f0ecc0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:31.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 shutdown_connections 2023-06-09T20:19:31.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.009+0000 7f0ed313e700 1 -- 172.21.15.78:0/1086088978 wait complete. 2023-06-09T20:19:31.021 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T20:19:31.044 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":16454,"stamp":"2023-06-09T20:19:29.554160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35446672,"kb_used_data":28380816,"kb_used_omap":164701,"kb_used_meta":6901090,"kb_avail":719528048,"statfs":{"total":773094113280,"available":736796721152,"internally_reserved":0,"allocated":29061955584,"data_stored":29050173637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":168654543,"internal_metadata":7066716465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":585,"apply_latency_ms":585,"commit_latency_ns":585000000,"apply_latency_ns":585000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36526046105,"num_objects":-27300,"num_object_clones":0,"num_object_copies":-54600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27300,"num_whiteouts":0,"num_read":-1370902,"num_read_kb":-413493825,"num_write":-3519517,"num_write_kb":-590846652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.727114"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":480,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.432797+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T20:19:25.432797+0000","last_peered":"2023-06-09T20:19:25.432797+0000","last_clean":"2023-06-09T20:19:25.432797+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T20:19:25.432797+0000","last_undegraded":"2023-06-09T20:19:25.432797+0000","last_fullsized":"2023-06-09T20:19:25.432797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:35.276528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":319,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.882958+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T20:19:23.882958+0000","last_peered":"2023-06-09T20:19:23.882958+0000","last_clean":"2023-06-09T20:19:23.882958+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T20:19:23.882958+0000","last_undegraded":"2023-06-09T20:19:23.882958+0000","last_fullsized":"2023-06-09T20:19:23.882958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:45:26.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":324,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.432136+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T20:19:25.432136+0000","last_peered":"2023-06-09T20:19:25.432136+0000","last_clean":"2023-06-09T20:19:25.432136+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T20:19:25.432136+0000","last_undegraded":"2023-06-09T20:19:25.432136+0000","last_fullsized":"2023-06-09T20:19:25.432136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:03:32.866197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.630092+0000","last_change":"2023-06-09T11:12:03.353838+0000","last_active":"2023-06-09T20:19:23.630092+0000","last_peered":"2023-06-09T20:19:23.630092+0000","last_clean":"2023-06-09T20:19:23.630092+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T20:19:23.630092+0000","last_undegraded":"2023-06-09T20:19:23.630092+0000","last_fullsized":"2023-06-09T20:19:23.630092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:53:46.570598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":319,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.882165+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T20:19:23.882165+0000","last_peered":"2023-06-09T20:19:23.882165+0000","last_clean":"2023-06-09T20:19:23.882165+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T20:19:23.882165+0000","last_undegraded":"2023-06-09T20:19:23.882165+0000","last_fullsized":"2023-06-09T20:19:23.882165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:02:34.231405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.161300+0000","last_change":"2023-06-09T11:12:03.352126+0000","last_active":"2023-06-09T20:19:25.161300+0000","last_peered":"2023-06-09T20:19:25.161300+0000","last_clean":"2023-06-09T20:19:25.161300+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T20:19:25.161300+0000","last_undegraded":"2023-06-09T20:19:25.161300+0000","last_fullsized":"2023-06-09T20:19:25.161300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:01:51.521324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":313,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.441400+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T20:19:25.441400+0000","last_peered":"2023-06-09T20:19:25.441400+0000","last_clean":"2023-06-09T20:19:25.441400+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T20:19:25.441400+0000","last_undegraded":"2023-06-09T20:19:25.441400+0000","last_fullsized":"2023-06-09T20:19:25.441400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:36.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.164138+0000","last_change":"2023-06-09T11:12:03.198729+0000","last_active":"2023-06-09T20:19:25.164138+0000","last_peered":"2023-06-09T20:19:25.164138+0000","last_clean":"2023-06-09T20:19:25.164138+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T20:19:25.164138+0000","last_undegraded":"2023-06-09T20:19:25.164138+0000","last_fullsized":"2023-06-09T20:19:25.164138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:18:47.506917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":301,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.418390+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T20:19:25.418390+0000","last_peered":"2023-06-09T20:19:25.418390+0000","last_clean":"2023-06-09T20:19:25.418390+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T20:19:25.418390+0000","last_undegraded":"2023-06-09T20:19:25.418390+0000","last_fullsized":"2023-06-09T20:19:25.418390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:40:02.219798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5169064,"kb_used_data":4415712,"kb_used_omap":15347,"kb_used_meta":737996,"kb_avail":89202776,"statfs":{"total":96636764160,"available":91343642624,"internally_reserved":0,"allocated":4521689088,"data_stored":4519821891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715521,"internal_metadata":755708735},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":103,"apply_latency_ms":103,"commit_latency_ns":103000000,"apply_latency_ns":103000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81799999999999995,"15min":0.78700000000000003},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":1.661,"5min":6.6429999999999998,"15min":6.6429999999999998},"last":2.1880000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.76200000000000001,"15min":0.79700000000000004},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.316},"max":{"1min":0.84599999999999997,"5min":4.3700000000000001,"15min":6.9340000000000002},"last":2.3839999999999999}]},{"osd":1,"last update":"Fri Jun 9 20:19:02 2023","interfaces":[{"interface":"back","average":{"1min":6.6509999999999998,"5min":1.964,"15min":1.2629999999999999},"min":{"1min":0.38,"5min":0.371,"15min":0.33500000000000002},"max":{"1min":106.97,"5min":106.97,"15min":106.97},"last":0.92900000000000005},{"interface":"front","average":{"1min":6.5869999999999997,"5min":1.966,"15min":1.284},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":107.06100000000001,"5min":107.06100000000001,"15min":107.06100000000001},"last":1.107}]},{"osd":2,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96399999999999997,"15min":0.92300000000000004},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.38700000000000001},"max":{"1min":3.2970000000000002,"5min":6.5330000000000004,"15min":11.923},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.92700000000000005,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6639999999999999,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96599999999999997,"15min":1.149},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.3319999999999999,"5min":4.1459999999999999,"15min":59.793999999999997},"last":1.865},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.93899999999999995,"15min":1.167},"min":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"max":{"1min":1.486,"5min":3.6890000000000001,"15min":60.773000000000003},"last":1.754}]},{"osd":4,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":3.9700000000000002,"5min":1.5509999999999999,"15min":1.1499999999999999},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":54.104999999999997,"5min":54.104999999999997,"15min":54.104999999999997},"last":0.82199999999999995},{"interface":"front","average":{"1min":4.46,"5min":1.6619999999999999,"15min":1.194},"min":{"1min":0.52600000000000002,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":53.810000000000002,"5min":53.810000000000002,"15min":53.810000000000002},"last":1.083}]},{"osd":5,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":2.4769999999999999,"15min":1.5089999999999999},"min":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.42399999999999999},"max":{"1min":3.0449999999999999,"5min":131.97200000000001,"15min":131.97200000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":2.5800000000000001,"15min":1.6619999999999999},"min":{"1min":0.52400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":2.911,"5min":134.97499999999999,"15min":134.97499999999999},"last":1.2749999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0229999999999999,"15min":1.2569999999999999},"min":{"1min":0.627,"5min":0.55700000000000005,"15min":0.499},"max":{"1min":1.1859999999999999,"5min":4.4950000000000001,"15min":61.345999999999997},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.0980000000000001,"15min":1.2829999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":3.266,"5min":4.2569999999999997,"15min":60.165999999999997},"last":1.1719999999999999}]}]},{"osd":6,"up_from":13,"seq":55834581407,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5127356,"kb_used_data":3969396,"kb_used_omap":10585,"kb_used_meta":1147366,"kb_avail":89244484,"statfs":{"total":96636764160,"available":91386351616,"internally_reserved":0,"allocated":4064661504,"data_stored":4063081755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10840012,"internal_metadata":1174902836},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":92,"apply_latency_ms":92,"commit_latency_ns":92000000,"apply_latency_ns":92000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70299999999999996,"15min":0.74399999999999999},"min":{"1min":0.34100000000000003,"5min":0.308,"15min":0.308},"max":{"1min":1.542,"5min":3.1760000000000002,"15min":7.4050000000000002},"last":1.3839999999999999},{"interface":"front","average":{"1min":2.0049999999999999,"5min":0.94899999999999995,"15min":0.90000000000000002},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":26.532,"5min":26.532,"15min":26.532},"last":1.101}]},{"osd":1,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.86899999999999999,"15min":0.87},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":1.446},{"interface":"front","average":{"1min":1.143,"5min":0.86399999999999999,"15min":0.86699999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.33700000000000002},"max":{"1min":7.5039999999999996,"5min":7.5039999999999996,"15min":7.5039999999999996},"last":1.5}]},{"osd":2,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":0.85999999999999999,"15min":0.91600000000000004},"min":{"1min":0.497,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":7.5259999999999998,"5min":7.5259999999999998,"15min":14.003},"last":1.286},{"interface":"front","average":{"1min":0.878,"5min":0.84199999999999997,"15min":0.86599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":1.98,"5min":3.4390000000000001,"15min":6.4199999999999999},"last":1.2150000000000001}]},{"osd":3,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.3260000000000001,"15min":1.0700000000000001},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.42199999999999999},"max":{"1min":2.008,"5min":39.442999999999998,"15min":39.442999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.26,"15min":1.1279999999999999},"min":{"1min":0.47599999999999998,"5min":0.441,"15min":0.441},"max":{"1min":3.335,"5min":39.011000000000003,"15min":39.011000000000003},"last":1.615}]},{"osd":4,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91400000000000003,"15min":1.5169999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33000000000000002},"max":{"1min":1.609,"5min":4.0659999999999998,"15min":162.25399999999999},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.077,"5min":0.873,"15min":1.5940000000000001},"min":{"1min":0.52200000000000002,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":3.294,"5min":3.294,"15min":162.19900000000001},"last":1.4650000000000001}]},{"osd":5,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":3.2290000000000001,"5min":2.6589999999999998,"15min":1.5489999999999999},"min":{"1min":0.47499999999999998,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":47.223999999999997,"5min":126.22,"15min":126.22},"last":1.573},{"interface":"front","average":{"1min":5.194,"5min":3.1179999999999999,"15min":1.714},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.38800000000000001},"max":{"1min":47.131,"5min":133.33000000000001,"15min":133.33000000000001},"last":1.5940000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.93200000000000005,"15min":1.738},"min":{"1min":0.52100000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.907,"5min":3.907,"15min":96.753},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0269999999999999,"15min":1.756},"min":{"1min":0.51000000000000001,"5min":0.48199999999999998,"15min":0.47299999999999998},"max":{"1min":2.0350000000000001,"5min":3.4670000000000001,"15min":101.806},"last":1.52}]}]},{"osd":5,"up_from":13,"seq":55834581403,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4856048,"kb_used_data":3793128,"kb_used_omap":31576,"kb_used_meta":1031335,"kb_avail":89515792,"statfs":{"total":96636764160,"available":91664171008,"internally_reserved":0,"allocated":3884163072,"data_stored":3882635961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32334646,"internal_metadata":1056087242},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":110,"apply_latency_ms":110,"commit_latency_ns":110000000,"apply_latency_ns":110000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.75900000000000001,"15min":1.732},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.31},"max":{"1min":8.2210000000000001,"5min":8.2210000000000001,"15min":150.52699999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":1.8149999999999999},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.33000000000000002},"max":{"1min":2.669,"5min":4.1779999999999999,"15min":151.72900000000001},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.5309999999999999,"15min":1.0609999999999999},"min":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":9.9000000000000004,"5min":53.021999999999998,"15min":53.021999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.389,"5min":1.8069999999999999,"15min":1.177},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.376},"max":{"1min":9.9800000000000004,"5min":53.197000000000003,"15min":53.197000000000003},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":0.872,"15min":1.2},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":8.173,"5min":8.173,"15min":97.159999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":1.181},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0589999999999999,"5min":1.4790000000000001,"15min":97.531000000000006},"last":1.1479999999999999}]},{"osd":3,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.107,"15min":0.98599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.41499999999999998},"max":{"1min":8.2029999999999994,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.006},{"interface":"front","average":{"1min":1.377,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.54500000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.2889999999999997,"5min":8.2889999999999997,"15min":8.2889999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":2.4820000000000002,"15min":1.4690000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.36399999999999999},"max":{"1min":8.2569999999999997,"5min":136.20500000000001,"15min":136.20500000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.024,"5min":2.3559999999999999,"15min":1.4450000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36599999999999999},"max":{"1min":5.8079999999999998,"5min":135.35400000000001,"15min":135.35400000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":2.028,"5min":1.272,"15min":1.073},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.41899999999999998},"max":{"1min":20.053999999999998,"5min":20.053999999999998,"15min":20.053999999999998},"last":1.054},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.97099999999999997,"15min":1.0309999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.39800000000000002},"max":{"1min":3.9049999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":1.115}]},{"osd":7,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.101,"15min":1.0760000000000001},"min":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.44400000000000001},"max":{"1min":1.9810000000000001,"5min":4.2229999999999999,"15min":6.0720000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.0940000000000001,"15min":1.1140000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.40899999999999997},"max":{"1min":11.916,"5min":11.916,"15min":11.916},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834581404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5893400,"kb_used_data":5095888,"kb_used_omap":33020,"kb_used_meta":764483,"kb_avail":88478440,"statfs":{"total":96636764160,"available":90601922560,"internally_reserved":0,"allocated":5218189312,"data_stored":5216219459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33813444,"internal_metadata":782830652},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.79800000000000004,"15min":0.747},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.254},{"interface":"front","average":{"1min":2.2930000000000001,"5min":1.044,"15min":0.91500000000000004},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.37},"max":{"1min":15.125,"5min":15.125,"15min":15.125},"last":1.127}]},{"osd":1,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.085,"15min":1.375},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39900000000000002},"max":{"1min":10.677,"5min":10.677,"15min":121.21599999999999},"last":1.155},{"interface":"front","average":{"1min":1.833,"5min":1.0589999999999999,"15min":1.304},"min":{"1min":0.46300000000000002,"5min":0.376,"15min":0.35199999999999998},"max":{"1min":10.699,"5min":10.699,"15min":121.19799999999999},"last":1.3200000000000001}]},{"osd":2,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":3.4399999999999999,"5min":1.456,"15min":1.405},"min":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.40300000000000002},"max":{"1min":32.298000000000002,"5min":32.298000000000002,"15min":120.88800000000001},"last":1.304},{"interface":"front","average":{"1min":2.657,"5min":1.3280000000000001,"15min":1.4690000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40300000000000002},"max":{"1min":31.983000000000001,"5min":31.983000000000001,"15min":122.483},"last":1.083}]},{"osd":3,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.92400000000000004,"15min":1.599},"min":{"1min":0.47599999999999998,"5min":0.44500000000000001,"15min":0.42699999999999999},"max":{"1min":4.6150000000000002,"5min":4.6150000000000002,"15min":119.94199999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.0649999999999999,"15min":1.673},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.45200000000000001},"max":{"1min":8.9939999999999998,"5min":8.9939999999999998,"15min":129.40199999999999},"last":1.226}]},{"osd":5,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":0.97099999999999997,"15min":1.319},"min":{"1min":0.42899999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":8.968,"5min":8.968,"15min":105.523},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.99199999999999999,"15min":1.357},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.40699999999999997},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":104.76300000000001},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.097,"15min":0.98099999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":9.0280000000000005,"5min":9.0280000000000005,"15min":9.0280000000000005},"last":1.038},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0669999999999999,"15min":1.071},"min":{"1min":0.53400000000000003,"5min":0.499,"15min":0.47299999999999998},"max":{"1min":4.3319999999999999,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":1.1910000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:41 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":2.9449999999999998,"15min":1.6850000000000001},"min":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.432},"max":{"1min":4.6500000000000004,"5min":196.364,"15min":196.364},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.5349999999999999,"5min":3.0630000000000002,"15min":1.663},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.44400000000000001},"max":{"1min":9.0600000000000005,"5min":192.33199999999999,"15min":192.33199999999999},"last":1.484}]}]},{"osd":3,"up_from":13,"seq":55834581394,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5448904,"kb_used_data":4664640,"kb_used_omap":17824,"kb_used_meta":766431,"kb_avail":88922936,"statfs":{"total":96636764160,"available":91057086464,"internally_reserved":0,"allocated":4776591360,"data_stored":4774776014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18251807,"internal_metadata":784826337},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.74099999999999999,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.29899999999999999,"15min":0.28100000000000003},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":1.133}]},{"osd":1,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":0.92900000000000005,"15min":0.83999999999999997},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.27900000000000003},"max":{"1min":6.0659999999999998,"5min":8.25,"15min":8.25},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.083,"5min":0.91400000000000003,"15min":0.86599999999999999},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.32000000000000001},"max":{"1min":4.9930000000000003,"5min":8.2040000000000006,"15min":8.2040000000000006},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.8200000000000001,"15min":1.1659999999999999},"min":{"1min":0.44700000000000001,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":6.1029999999999998,"5min":84.156000000000006,"15min":84.156000000000006},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.859,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.34799999999999998},"max":{"1min":5.0270000000000001,"5min":90.442999999999998,"15min":90.442999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.0109999999999999,"15min":0.92700000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.0449999999999999,"15min":0.98299999999999998},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":10.448,"5min":10.448,"15min":10.448},"last":1.411}]},{"osd":5,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.92600000000000005,"15min":1.167},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.48799999999999999},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":55.159999999999997},"last":1.651},{"interface":"front","average":{"1min":1.6160000000000001,"5min":0.997,"15min":1.1679999999999999},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":13.651999999999999,"5min":13.651999999999999,"15min":54.234999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.107,"15min":1.075},"min":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":5.8680000000000003,"5min":6.2869999999999999,"15min":6.2869999999999999},"last":1.839},{"interface":"front","average":{"1min":1.327,"5min":1.0049999999999999,"15min":1.0860000000000001},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":6.3780000000000001,"5min":6.3780000000000001,"15min":12.545999999999999},"last":1.575}]},{"osd":7,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.0640000000000001,"15min":1.627},"min":{"1min":0.70399999999999996,"5min":0.56000000000000005,"15min":0.53500000000000003},"max":{"1min":6.2569999999999997,"5min":6.2569999999999997,"15min":187.14099999999999},"last":0.746},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.0820000000000001,"15min":1.6419999999999999},"min":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":187.03},"last":1.7909999999999999}]}]},{"osd":2,"up_from":13,"seq":55834581400,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2878976,"kb_used_data":2546744,"kb_used_omap":11211,"kb_used_meta":321012,"kb_avail":91492864,"statfs":{"total":96636764160,"available":93688692736,"internally_reserved":0,"allocated":2607865856,"data_stored":2606679757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11481051,"internal_metadata":328716325},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":93,"apply_latency_ms":93,"commit_latency_ns":93000000,"apply_latency_ns":93000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.4199999999999999,"5min":7.5730000000000004,"15min":7.8390000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":3.218,"5min":3.218,"15min":4.8700000000000001},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":0.88200000000000001,"15min":0.82499999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.27800000000000002},"max":{"1min":9.5899999999999999,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.86499999999999999,"15min":0.88900000000000001},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.309},"max":{"1min":2.746,"5min":7.5330000000000004,"15min":9.4930000000000003},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":0.96799999999999997,"15min":0.94199999999999995},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.35699999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.4809999999999999,"5min":7.4889999999999999,"15min":7.7690000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":2.7749999999999999,"5min":1.2230000000000001,"15min":1.0169999999999999},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.435},"max":{"1min":30.73,"5min":30.73,"15min":30.73},"last":0.47299999999999998},{"interface":"front","average":{"1min":3.0150000000000001,"5min":1.333,"15min":1.091},"min":{"1min":0.54000000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":30.786000000000001,"5min":30.786000000000001,"15min":30.786000000000001},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.0349999999999999,"15min":0.98099999999999998},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.9930000000000003,"5min":5.9930000000000003,"15min":7.806},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.98699999999999999,"15min":1.0169999999999999},"min":{"1min":0.55600000000000005,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":3.1859999999999999,"5min":4.4669999999999996,"15min":7.3650000000000002},"last":0.438}]},{"osd":6,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.101,"15min":1.669},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":9.3339999999999996,"5min":9.3339999999999996,"15min":88.555999999999997},"last":30.975999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.0369999999999999,"15min":1.6759999999999999},"min":{"1min":0.55000000000000004,"5min":0.51600000000000001,"15min":0.47299999999999998},"max":{"1min":5.117,"5min":5.117,"15min":88.912000000000006},"last":29.460999999999999}]},{"osd":7,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.0660000000000001,"15min":1.0489999999999999},"min":{"1min":0.63100000000000001,"5min":0.57299999999999995,"15min":0.52400000000000002},"max":{"1min":6.1779999999999999,"5min":6.1779999999999999,"15min":6.1779999999999999},"last":29.219999999999999},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.1519999999999999,"15min":1.133},"min":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.51400000000000001},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":29.265000000000001}]}]},{"osd":1,"up_from":13,"seq":55834581409,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3314676,"kb_used_data":2236972,"kb_used_omap":24790,"kb_used_meta":1052905,"kb_avail":91057164,"statfs":{"total":96636764160,"available":93242535936,"internally_reserved":0,"allocated":2290659328,"data_stored":2289653977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25385484,"internal_metadata":1078175220},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.245},"max":{"1min":1.6120000000000001,"5min":1.8340000000000001,"15min":2.8530000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.67800000000000005,"15min":0.748},"min":{"1min":0.32600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.653,"5min":2.3250000000000002,"15min":5.4880000000000004},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.70899999999999996},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":1.002,"5min":1.615,"15min":4.202},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.81699999999999995},"min":{"1min":0.39100000000000001,"5min":0.373,"15min":0.32300000000000001},"max":{"1min":1.492,"5min":2.2149999999999999,"15min":5.181},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":1.339,"5min":2.8039999999999998,"15min":5.4569999999999999},"last":0.628},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.749,"15min":0.82099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":1.292,"5min":2.367,"15min":5.4050000000000002},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.93799999999999994},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.694,"5min":4.0039999999999996,"15min":12.132},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.874,"5min":0.99299999999999999,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":1.407,"5min":4.952,"15min":11.561},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94399999999999995,"15min":1.0029999999999999},"min":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3580000000000001,"5min":4.29,"15min":5.9489999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.93400000000000005,"15min":0.98099999999999998},"min":{"1min":0.55300000000000005,"5min":0.51000000000000001,"15min":0.501},"max":{"1min":1.49,"5min":4.0570000000000004,"15min":6.8209999999999997},"last":0.83899999999999997}]},{"osd":6,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1,"15min":1.048},"min":{"1min":0.59099999999999997,"5min":0.53600000000000003,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":4.1630000000000003,"15min":5.5720000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":1.014,"15min":1.038},"min":{"1min":0.57199999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5289999999999999,"5min":4.6710000000000003,"15min":5.625},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:18:31 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0609999999999999,"15min":1.1870000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.50900000000000001},"max":{"1min":3.972,"5min":6.0599999999999996,"15min":41.878999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.98899999999999999,"15min":1.2350000000000001},"min":{"1min":0.65500000000000003,"5min":0.55600000000000005,"15min":0.54500000000000004},"max":{"1min":1.706,"5min":2.4710000000000001,"15min":41.908000000000001},"last":1.1040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834581400,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2758248,"kb_used_data":1658336,"kb_used_omap":20344,"kb_used_meta":1079559,"kb_avail":91613592,"statfs":{"total":96636764160,"available":93812318208,"internally_reserved":0,"allocated":1698136064,"data_stored":1697304823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20832578,"internal_metadata":1105469118},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.522,"15min":0.97299999999999998},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":6.6630000000000003,"5min":65.247,"15min":65.247},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.5269999999999999,"15min":0.99099999999999999},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.718,"5min":63.713999999999999,"15min":63.713999999999999},"last":1.206}]},{"osd":2,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.9299999999999999,"5min":1.034,"15min":0.89000000000000001},"min":{"1min":0.318,"5min":0.312,"15min":0.31},"max":{"1min":17.765999999999998,"5min":17.765999999999998,"15min":17.765999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":2.3799999999999999,"5min":1.103,"15min":0.83999999999999997},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.32100000000000001},"max":{"1min":32.375,"5min":32.375,"15min":32.375},"last":1.095}]},{"osd":3,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.2609999999999999,"15min":1},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1319999999999997,"5min":35.847999999999999,"15min":35.847999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.3120000000000001,"15min":1.0189999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.38400000000000001},"max":{"1min":3.7330000000000001,"5min":35.762,"15min":35.762},"last":1.518}]},{"osd":4,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86299999999999999,"15min":1.4630000000000001},"min":{"1min":0.52200000000000002,"5min":0.45200000000000001,"15min":0.39600000000000002},"max":{"1min":1.46,"5min":2.8559999999999999,"15min":174.31299999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.91600000000000004,"15min":1.522},"min":{"1min":0.503,"5min":0.47599999999999998,"15min":0.44800000000000001},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":174.25299999999999},"last":1.617}]},{"osd":5,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":2.9700000000000002,"5min":1.49,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":40.771000000000001,"5min":40.771000000000001,"15min":40.771000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":2.867,"5min":1.4810000000000001,"15min":1.1160000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":40.357999999999997,"5min":40.357999999999997,"15min":40.357999999999997},"last":1.839}]},{"osd":6,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.0409999999999999,"15min":1.03},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":4.165,"5min":4.165,"15min":8.9109999999999996},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.169,"15min":1.0880000000000001},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":1.581}]},{"osd":7,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.216,"15min":2.004},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.501},"max":{"1min":3.5059999999999998,"5min":5.2309999999999999,"15min":174.10499999999999},"last":1.9039999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.0680000000000001,"15min":2.0470000000000002},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.194,"5min":4.194,"15min":174.35900000000001},"last":1.7929999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T20:19:31.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T20:19:31.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.321+0000 7f08d16c4700 1 Processor -- start 2023-06-09T20:19:31.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.321+0000 7f08d16c4700 1 -- start start 2023-06-09T20:19:31.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08d16c4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08cc15c880 0x7f08cc06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:31.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08d16c4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc0c87a0 con 0x7f08cc06fc80 2023-06-09T20:19:31.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08d16c4700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc0c81e0 con 0x7f08cc0c7cb0 2023-06-09T20:19:31.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08d16c4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0c84c0 con 0x7f08cc15c880 2023-06-09T20:19:31.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08d0ec3700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f08cc0c7cb0 0x7f08cc06a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:53014/0 (socket says 172.21.15.78:53014) 2023-06-09T20:19:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08d0ec3700 1 -- 172.21.15.78:0/3655890920 learned_addr learned my addr 172.21.15.78:0/3655890920 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08cb7fe700 1 --2- 172.21.15.78:0/3655890920 >> v2:172.21.15.78:3300/0 conn(0x7f08cc15c880 0x7f08cc06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359187989 0 0) 0x7f08cc0c81e0 con 0x7f08cc0c7cb0 2023-06-09T20:19:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b40035d0 con 0x7f08cc0c7cb0 2023-06-09T20:19:31.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.325+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210594697 0 0) 0x7f08cc0c87a0 con 0x7f08cc06fc80 2023-06-09T20:19:31.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08cc0c81e0 con 0x7f08cc06fc80 2023-06-09T20:19:31.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576667217 0 0) 0x7f08b40035d0 con 0x7f08cc0c7cb0 2023-06-09T20:19:31.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08cb7fe700 1 -- 172.21.15.78:0/3655890920 >> v1:172.21.15.187:6789/0 conn(0x7f08cc0c7cb0 legacy=0x7f08cc06a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08cb7fe700 1 -- 172.21.15.78:0/3655890920 >> v1:172.21.15.78:6789/0 conn(0x7f08cc06fc80 legacy=0x7f08cc070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08cb7fe700 1 -- 172.21.15.78:0/3655890920 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc06a070 con 0x7f08cc15c880 2023-06-09T20:19:31.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08cb7fe700 1 --2- 172.21.15.78:0/3655890920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc06df50 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009800 tx=0x7f08c0009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c348bcc4abacfab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:31.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40019f0 con 0x7f08cc15c880 2023-06-09T20:19:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0004030 con 0x7f08cc15c880 2023-06-09T20:19:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08caffd700 1 -- 172.21.15.78:0/3655890920 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c00043e0 con 0x7f08cc15c880 2023-06-09T20:19:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08d16c4700 1 -- 172.21.15.78:0/3655890920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 msgr2=0x7f08cc06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08d16c4700 1 --2- 172.21.15.78:0/3655890920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc06df50 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009800 tx=0x7f08c0009b10 comp rx=0 tx=0).stop 2023-06-09T20:19:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08d16c4700 1 -- 172.21.15.78:0/3655890920 shutdown_connections 2023-06-09T20:19:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08d16c4700 1 --2- 172.21.15.78:0/3655890920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc06df50 unknown :-1 s=CLOSED pgs=3270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08d16c4700 1 -- 172.21.15.78:0/3655890920 >> 172.21.15.78:0/3655890920 conn(0x7f08cc0cf870 msgr2=0x7f08cc0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08d16c4700 1 -- 172.21.15.78:0/3655890920 shutdown_connections 2023-06-09T20:19:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.329+0000 7f08d16c4700 1 -- 172.21.15.78:0/3655890920 wait complete. 2023-06-09T20:19:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.333+0000 7f08d16c4700 1 Processor -- start 2023-06-09T20:19:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.333+0000 7f08d16c4700 1 -- start start 2023-06-09T20:19:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d16c4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08cc06fc80 0x7f08cc0cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d16c4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc0c7cb0 0x7f08cc06a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08cbfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08cc06fc80 0x7f08cc0cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08cbfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08cc06fc80 0x7f08cc0cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40818/0 (socket says 172.21.15.78:40818) 2023-06-09T20:19:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc0c7cb0 0x7f08cc06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc0c7cb0 0x7f08cc06a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53826/0 (socket says 172.21.15.78:53826) 2023-06-09T20:19:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d16c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:31.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:31.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54540/0 (socket says 172.21.15.78:54540) 2023-06-09T20:19:31.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08cbfff700 1 -- 172.21.15.78:0/1864432723 learned_addr learned my addr 172.21.15.78:0/1864432723 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:31.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15f5d0 con 0x7f08cc15c880 2023-06-09T20:19:31.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0cb810 con 0x7f08cc0c7cb0 2023-06-09T20:19:31.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0cb530 con 0x7f08cc06fc80 2023-06-09T20:19:31.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 -- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08cc06fc80 msgr2=0x7f08cc0cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08cc06fc80 0x7f08cc0cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 -- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc0c7cb0 msgr2=0x7f08cc06a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc0c7cb0 0x7f08cc06a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00094b0 con 0x7f08cc15c880 2023-06-09T20:19:31.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.337+0000 7f08d0ec3700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc159550 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f08c4001700 tx=0x7f08c400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:31.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.341+0000 7f08c8ff9700 1 -- 172.21.15.78:0/1864432723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400aa30 con 0x7f08cc15c880 2023-06-09T20:19:31.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.341+0000 7f08c8ff9700 1 -- 172.21.15.78:0/1864432723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400ab90 con 0x7f08cc15c880 2023-06-09T20:19:31.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.341+0000 7f08c8ff9700 1 -- 172.21.15.78:0/1864432723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40070d0 con 0x7f08cc15c880 2023-06-09T20:19:31.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.341+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc06e490 con 0x7f08cc15c880 2023-06-09T20:19:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.341+0000 7f08c8ff9700 1 -- 172.21.15.78:0/1864432723 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08c4007230 con 0x7f08cc15c880 2023-06-09T20:19:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.345+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc06a350 con 0x7f08cc15c880 2023-06-09T20:19:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.345+0000 7f08c8ff9700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08b8066340 0x7f08b80687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.345+0000 7f08c8ff9700 1 -- 172.21.15.78:0/1864432723 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f08c40834b0 con 0x7f08cc15c880 2023-06-09T20:19:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.345+0000 7f08cbfff700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08b8066340 0x7f08b80687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.345+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc15f740 con 0x7f08cc15c880 2023-06-09T20:19:31.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.345+0000 7f08cbfff700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08b8066340 0x7f08b80687f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0011e0 tx=0x7f08bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:31.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.353+0000 7f08c8ff9700 1 -- 172.21.15.78:0/1864432723 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f08c4088020 con 0x7f08cc15c880 2023-06-09T20:19:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.545+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08cc0741c0 con 0x7f08cc15c880 2023-06-09T20:19:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.545+0000 7f08c8ff9700 1 -- 172.21.15.78:0/1864432723 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+14734 (secure 0 0 0) 0x7f08c4018030 con 0x7f08cc15c880 2023-06-09T20:19:31.553 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:31.554 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":42,"fsid":"a733ef11-cd5d-4be5-8773-23eabcf05e48","created":"2023-06-09T11:11:41.406952+0000","modified":"2023-06-09T20:19:23.608914+0000","last_up_change":"2023-06-09T11:11:54.987613+0000","last_in_change":"2023-06-09T11:11:45.185617+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T11:11:55.689491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T11:12:01.668945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"49233b9f-5c75-4539-964b-c60157693d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6801","nonce":1561635544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6803","nonce":1561635544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6808","nonce":1561635544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":1561635544},{"type":"v1","addr":"172.21.15.78:6805","nonce":1561635544}]},"public_addr":"172.21.15.78:6801/1561635544","cluster_addr":"172.21.15.78:6803/1561635544","heartbeat_back_addr":"172.21.15.78:6808/1561635544","heartbeat_front_addr":"172.21.15.78:6805/1561635544","state":["exists","up"]},{"osd":1,"uuid":"6a598b89-7602-426f-b6b1-605d49b36c2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6820","nonce":80014187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6824","nonce":80014187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6831","nonce":80014187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6827","nonce":80014187},{"type":"v1","addr":"172.21.15.78:6829","nonce":80014187}]},"public_addr":"172.21.15.78:6820/80014187","cluster_addr":"172.21.15.78:6824/80014187","heartbeat_back_addr":"172.21.15.78:6831/80014187","heartbeat_front_addr":"172.21.15.78:6829/80014187","state":["exists","up"]},{"osd":2,"uuid":"fe20b37f-0996-498b-a1cd-e9b1ccb6c218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6818","nonce":1132416136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6819","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6821","nonce":1132416136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6828","nonce":1132416136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6823","nonce":1132416136},{"type":"v1","addr":"172.21.15.78:6825","nonce":1132416136}]},"public_addr":"172.21.15.78:6818/1132416136","cluster_addr":"172.21.15.78:6821/1132416136","heartbeat_back_addr":"172.21.15.78:6828/1132416136","heartbeat_front_addr":"172.21.15.78:6825/1132416136","state":["exists","up"]},{"osd":3,"uuid":"c29c757a-5e70-44c0-b09d-0d47603e9b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6807","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6809","nonce":358574958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6811","nonce":358574958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6815","nonce":358574958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":358574958},{"type":"v1","addr":"172.21.15.78:6813","nonce":358574958}]},"public_addr":"172.21.15.78:6809/358574958","cluster_addr":"172.21.15.78:6811/358574958","heartbeat_back_addr":"172.21.15.78:6815/358574958","heartbeat_front_addr":"172.21.15.78:6813/358574958","state":["exists","up"]},{"osd":4,"uuid":"0d4ffc37-9318-4d59-aa09-a2ce589977a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6809","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6812","nonce":225897659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6816","nonce":225897659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6823","nonce":225897659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":225897659},{"type":"v1","addr":"172.21.15.187:6820","nonce":225897659}]},"public_addr":"172.21.15.187:6812/225897659","cluster_addr":"172.21.15.187:6816/225897659","heartbeat_back_addr":"172.21.15.187:6823/225897659","heartbeat_front_addr":"172.21.15.187:6820/225897659","state":["exists","up"]},{"osd":5,"uuid":"ba87aac5-fca3-4fd6-9f3e-0cdc5dfaa994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6825","nonce":3523281429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6827","nonce":3523281429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6831","nonce":3523281429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3523281429},{"type":"v1","addr":"172.21.15.187:6829","nonce":3523281429}]},"public_addr":"172.21.15.187:6825/3523281429","cluster_addr":"172.21.15.187:6827/3523281429","heartbeat_back_addr":"172.21.15.187:6831/3523281429","heartbeat_front_addr":"172.21.15.187:6829/3523281429","state":["exists","up"]},{"osd":6,"uuid":"6d5e6997-f8f0-4a38-b2b9-8d71a78d3823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6801","nonce":2841984916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6803","nonce":2841984916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6807","nonce":2841984916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2841984916},{"type":"v1","addr":"172.21.15.187:6805","nonce":2841984916}]},"public_addr":"172.21.15.187:6801/2841984916","cluster_addr":"172.21.15.187:6803/2841984916","heartbeat_back_addr":"172.21.15.187:6807/2841984916","heartbeat_front_addr":"172.21.15.187:6805/2841984916","state":["exists","up"]},{"osd":7,"uuid":"2b62e2aa-642d-4d7a-9943-dfb57c5fe1b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6810","nonce":3928672602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6813","nonce":3928672602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6822","nonce":3928672602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":3928672602},{"type":"v1","addr":"172.21.15.187:6817","nonce":3928672602}]},"public_addr":"172.21.15.187:6810/3928672602","cluster_addr":"172.21.15.187:6813/3928672602","heartbeat_back_addr":"172.21.15.187:6822/3928672602","heartbeat_front_addr":"172.21.15.187:6817/3928672602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.170724+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.287348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.163874+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.180353+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:51.000824+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.979519+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.844133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T11:11:50.877733+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.187:6835/1349991607":"2023-06-10T20:19:19.124264+0000","172.21.15.187:6834/1349991607":"2023-06-10T20:19:19.124264+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T20:19:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08b8066340 msgr2=0x7f08b80687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08b8066340 0x7f08b80687f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0011e0 tx=0x7f08bc009040 comp rx=0 tx=0).stop 2023-06-09T20:19:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 msgr2=0x7f08cc159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc159550 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f08c4001700 tx=0x7f08c400cf50 comp rx=0 tx=0).stop 2023-06-09T20:19:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 shutdown_connections 2023-06-09T20:19:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f08b8066340 0x7f08b80687f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08cc15c880 0x7f08cc159550 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08cc0c7cb0 0x7f08cc06a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 --2- 172.21.15.78:0/1864432723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08cc06fc80 0x7f08cc0cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 >> 172.21.15.78:0/1864432723 conn(0x7f08cc0cf870 msgr2=0x7f08cc070050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 shutdown_connections 2023-06-09T20:19:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:31.549+0000 7f08d16c4700 1 -- 172.21.15.78:0/1864432723 wait complete. 2023-06-09T20:19:32.574 INFO:tasks.ceph:Scrubbing osd.0 2023-06-09T20:19:32.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:32.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.745+0000 7fa2f52d8700 1 Processor -- start 2023-06-09T20:19:32.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.745+0000 7fa2f52d8700 1 -- start start 2023-06-09T20:19:32.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2f52d8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2f0159930 0x7fa2f0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2f52d8700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2f00ccb20 0x7fa2f015d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2f52d8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f006fa40 con 0x7fa2f015d990 2023-06-09T20:19:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2f52d8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f015ae00 con 0x7fa2f0159930 2023-06-09T20:19:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2f52d8700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f015a560 con 0x7fa2f00ccb20 2023-06-09T20:19:32.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2eeffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa2f0159930 0x7fa2f0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:32.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2ef7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2f015d990 0x7fa2f006fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58064/0 (socket says 172.21.15.78:58064) 2023-06-09T20:19:32.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/86690808 learned_addr learned my addr 172.21.15.78:0/86690808 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:32.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/86690808 >> v2:172.21.15.187:3300/0 conn(0x7fa2f00ccb20 0x7fa2f015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:32.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2eeffd700 1 -- 172.21.15.78:0/86690808 >> v2:172.21.15.187:3300/0 conn(0x7fa2f00ccb20 msgr2=0x7fa2f015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2eeffd700 1 --2- 172.21.15.78:0/86690808 >> v2:172.21.15.187:3300/0 conn(0x7fa2f00ccb20 0x7fa2f015d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2eeffd700 1 -- 172.21.15.78:0/86690808 >> v1:172.21.15.78:6789/0 conn(0x7fa2f015d990 legacy=0x7fa2f006fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2eeffd700 1 -- 172.21.15.78:0/86690808 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f015a840 con 0x7fa2f0159930 2023-06-09T20:19:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2edffb700 1 -- 172.21.15.78:0/86690808 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800978645 0 0) 0x7fa2f006fa40 con 0x7fa2f015d990 2023-06-09T20:19:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2eeffd700 1 --2- 172.21.15.78:0/86690808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 0x7fa2f0159d00 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7fa2f006dcc0 tx=0x7fa2e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9cb1cca849cae9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2edffb700 1 -- 172.21.15.78:0/86690808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0011830 con 0x7fa2f0159930 2023-06-09T20:19:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2edffb700 1 -- 172.21.15.78:0/86690808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0011990 con 0x7fa2f0159930 2023-06-09T20:19:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2edffb700 1 -- 172.21.15.78:0/86690808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0011d20 con 0x7fa2f0159930 2023-06-09T20:19:32.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2f52d8700 1 -- 172.21.15.78:0/86690808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 msgr2=0x7fa2f0159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.749+0000 7fa2f52d8700 1 --2- 172.21.15.78:0/86690808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 0x7fa2f0159d00 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7fa2f006dcc0 tx=0x7fa2e0009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- 172.21.15.78:0/86690808 shutdown_connections 2023-06-09T20:19:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 --2- 172.21.15.78:0/86690808 >> v2:172.21.15.187:3300/0 conn(0x7fa2f00ccb20 0x7fa2f015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 --2- 172.21.15.78:0/86690808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 0x7fa2f0159d00 unknown :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:32.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- 172.21.15.78:0/86690808 >> 172.21.15.78:0/86690808 conn(0x7fa2f00d0140 msgr2=0x7fa2f00cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:32.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- 172.21.15.78:0/86690808 shutdown_connections 2023-06-09T20:19:32.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- 172.21.15.78:0/86690808 wait complete. 2023-06-09T20:19:32.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 Processor -- start 2023-06-09T20:19:32.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- start start 2023-06-09T20:19:32.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f00ccb20 0x7fa2f014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 0x7fa2f0155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f015d990 0x7fa2f00b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00b3e60 con 0x7fa2f0159930 2023-06-09T20:19:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00b4280 con 0x7fa2f00ccb20 2023-06-09T20:19:32.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.753+0000 7fa2f52d8700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f014d0d0 con 0x7fa2f015d990 2023-06-09T20:19:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f00ccb20 0x7fa2f014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2ee7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 0x7fa2f0155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f00ccb20 0x7fa2f014cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53856/0 (socket says 172.21.15.78:53856) 2023-06-09T20:19:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 -- 172.21.15.78:0/2334998875 learned_addr learned my addr 172.21.15.78:0/2334998875 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:32.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2ef7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f015d990 0x7fa2f00b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:32.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 -- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f015d990 msgr2=0x7fa2f00b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:32.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f015d990 0x7fa2f00b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:32.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 -- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 msgr2=0x7fa2f0155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:32.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 0x7fa2f0155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:32.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 -- 172.21.15.78:0/2334998875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00094b0 con 0x7fa2f00ccb20 2023-06-09T20:19:32.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2f0159930 0x7fa2f0155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:32.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2eeffd700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f00ccb20 0x7fa2f014cb90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00090b0 tx=0x7fa2e0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0004480 con 0x7fa2f00ccb20 2023-06-09T20:19:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e001f070 con 0x7fa2f00ccb20 2023-06-09T20:19:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f0070df0 con 0x7fa2f00ccb20 2023-06-09T20:19:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0003900 con 0x7fa2f00ccb20 2023-06-09T20:19:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f015ab20 con 0x7fa2f00ccb20 2023-06-09T20:19:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.757+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2f015a240 con 0x7fa2f00ccb20 2023-06-09T20:19:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2e0021030 con 0x7fa2f00ccb20 2023-06-09T20:19:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2d77fe700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa2dc066320 0x7fa2dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa2e0084dd0 con 0x7fa2f00ccb20 2023-06-09T20:19:32.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa2dc066320 0x7fa2dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:32.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2d77fe700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7fa2dc06c790 0x7fa2dc06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 --> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2dc06f250 con 0x7fa2dc06c790 2023-06-09T20:19:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2e0088020 con 0x7fa2f00ccb20 2023-06-09T20:19:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2ef7fe700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7fa2dc06c790 0x7fa2dc06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2ee7fc700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa2dc066320 0x7fa2dc0687d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00b1b80 tx=0x7fa2e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:32.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.761+0000 7fa2ef7fe700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7fa2dc06c790 0x7fa2dc06eba0 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:32.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.909+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== osd.0 v2:172.21.15.78:6800/1561635544 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa2dc06f250 con 0x7fa2dc06c790 2023-06-09T20:19:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.925+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 --> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa2f00b3fa0 con 0x7fa2dc06c790 2023-06-09T20:19:32.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2d77fe700 1 -- 172.21.15.78:0/2334998875 <== osd.0 v2:172.21.15.78:6800/1561635544 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa2f00b3fa0 con 0x7fa2dc06c790 2023-06-09T20:19:32.972 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:32.973 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:32.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7fa2dc06c790 msgr2=0x7fa2dc06eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.78:6800/1561635544,v1:172.21.15.78:6801/1561635544] conn(0x7fa2dc06c790 0x7fa2dc06eba0 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa2dc066320 msgr2=0x7fa2dc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fa2dc066320 0x7fa2dc0687d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00b1b80 tx=0x7fa2e4008040 comp rx=0 tx=0).stop 2023-06-09T20:19:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f00ccb20 msgr2=0x7fa2f014cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:32.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 --2- 172.21.15.78:0/2334998875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f00ccb20 0x7fa2f014cb90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00090b0 tx=0x7fa2e0004770 comp rx=0 tx=0).stop 2023-06-09T20:19:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2ef7fe700 1 -- 172.21.15.78:0/2334998875 reap_dead start 2023-06-09T20:19:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 shutdown_connections 2023-06-09T20:19:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 >> 172.21.15.78:0/2334998875 conn(0x7fa2f00d0140 msgr2=0x7fa2f00c98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 shutdown_connections 2023-06-09T20:19:32.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:32.965+0000 7fa2f52d8700 1 -- 172.21.15.78:0/2334998875 wait complete. 2023-06-09T20:19:32.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-06-09T20:19:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.153+0000 7f895e468700 1 Processor -- start 2023-06-09T20:19:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.153+0000 7f895e468700 1 -- start start 2023-06-09T20:19:33.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.153+0000 7f895e468700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f895806a5e0 0x7f89580ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.153+0000 7f895e468700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580cb520 con 0x7f89580ca5c0 2023-06-09T20:19:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.153+0000 7f895e468700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580caa40 con 0x7f8958159530 2023-06-09T20:19:33.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.153+0000 7f895e468700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89580cca40 con 0x7f895806a5e0 2023-06-09T20:19:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f89577fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f895806a5e0 0x7f89580ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f8957fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f8958159530 0x7f8958069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:53024/0 (socket says 172.21.15.78:53024) 2023-06-09T20:19:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f8957fff700 1 -- 172.21.15.78:0/3424626096 learned_addr learned my addr 172.21.15.78:0/3424626096 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895ca05700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f89580ca5c0 0x7f89580cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58076/0 (socket says 172.21.15.78:58076) 2023-06-09T20:19:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f89577fe700 1 -- 172.21.15.78:0/3424626096 >> v1:172.21.15.187:6789/0 conn(0x7f8958159530 legacy=0x7f8958069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f89577fe700 1 -- 172.21.15.78:0/3424626096 >> v1:172.21.15.78:6789/0 conn(0x7f89580ca5c0 legacy=0x7f89580cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f89577fe700 1 -- 172.21.15.78:0/3424626096 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580cac80 con 0x7f895806a5e0 2023-06-09T20:19:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f8956ffd700 1 -- 172.21.15.78:0/3424626096 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148064681 0 0) 0x7f8948001110 con 0x7f8958159530 2023-06-09T20:19:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f89577fe700 1 --2- 172.21.15.78:0/3424626096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f895806a5e0 0x7f89580ca080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f894c009850 tx=0x7f894c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fcd96b9e5912f3a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f8956ffd700 1 -- 172.21.15.78:0/3424626096 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c004230 con 0x7f895806a5e0 2023-06-09T20:19:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f8956ffd700 1 -- 172.21.15.78:0/3424626096 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c004390 con 0x7f895806a5e0 2023-06-09T20:19:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f8956ffd700 1 -- 172.21.15.78:0/3424626096 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0036c0 con 0x7f895806a5e0 2023-06-09T20:19:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895e468700 1 -- 172.21.15.78:0/3424626096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f895806a5e0 msgr2=0x7f89580ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895e468700 1 --2- 172.21.15.78:0/3424626096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f895806a5e0 0x7f89580ca080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f894c009850 tx=0x7f894c009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895e468700 1 -- 172.21.15.78:0/3424626096 shutdown_connections 2023-06-09T20:19:33.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895e468700 1 --2- 172.21.15.78:0/3424626096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f895806a5e0 0x7f89580ca080 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895e468700 1 -- 172.21.15.78:0/3424626096 >> 172.21.15.78:0/3424626096 conn(0x7f89580b1480 msgr2=0x7f89580cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:33.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895e468700 1 -- 172.21.15.78:0/3424626096 shutdown_connections 2023-06-09T20:19:33.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.157+0000 7f895e468700 1 -- 172.21.15.78:0/3424626096 wait complete. 2023-06-09T20:19:33.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 Processor -- start 2023-06-09T20:19:33.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 -- start start 2023-06-09T20:19:33.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f895806a5e0 0x7f895814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89580ca5c0 0x7f89580abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8958159530 0x7f89580ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89580ae360 con 0x7f8958159530 2023-06-09T20:19:33.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895814b970 con 0x7f89580ca5c0 2023-06-09T20:19:33.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895e468700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89580b31c0 con 0x7f895806a5e0 2023-06-09T20:19:33.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f89577fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89580ca5c0 0x7f89580abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895ca05700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8958159530 0x7f89580ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f8957fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f895806a5e0 0x7f895814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f89577fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89580ca5c0 0x7f89580abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53866/0 (socket says 172.21.15.78:53866) 2023-06-09T20:19:33.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f89577fe700 1 -- 172.21.15.78:0/2479029671 learned_addr learned my addr 172.21.15.78:0/2479029671 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895ca05700 1 -- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f895806a5e0 msgr2=0x7f895814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895ca05700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f895806a5e0 0x7f895814b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895ca05700 1 -- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89580ca5c0 msgr2=0x7f89580abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895ca05700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89580ca5c0 0x7f89580abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895ca05700 1 -- 172.21.15.78:0/2479029671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0094b0 con 0x7f8958159530 2023-06-09T20:19:33.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f89577fe700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89580ca5c0 0x7f89580abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:33.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f895ca05700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8958159530 0x7f89580ac1d0 secure :-1 s=READY pgs=3275 cs=0 l=1 rev1=1 crypto rx=0x7f8950001fd0 tx=0x7f895000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.161+0000 7f8954ff9700 1 -- 172.21.15.78:0/2479029671 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000acd0 con 0x7f8958159530 2023-06-09T20:19:33.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.165+0000 7f8954ff9700 1 -- 172.21.15.78:0/2479029671 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000ae30 con 0x7f8958159530 2023-06-09T20:19:33.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.165+0000 7f8954ff9700 1 -- 172.21.15.78:0/2479029671 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950007310 con 0x7f8958159530 2023-06-09T20:19:33.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.165+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89580cb240 con 0x7f8958159530 2023-06-09T20:19:33.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.165+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89580caf60 con 0x7f8958159530 2023-06-09T20:19:33.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.165+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895815d3b0 con 0x7f8958159530 2023-06-09T20:19:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.165+0000 7f8954ff9700 1 -- 172.21.15.78:0/2479029671 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8950007470 con 0x7f8958159530 2023-06-09T20:19:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.169+0000 7f8954ff9700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89440662f0 0x7f89440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.169+0000 7f8954ff9700 1 -- 172.21.15.78:0/2479029671 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f89500833f0 con 0x7f8958159530 2023-06-09T20:19:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.169+0000 7f8957fff700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89440662f0 0x7f89440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.169+0000 7f8957fff700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89440662f0 0x7f89440687a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8948000f60 tx=0x7f8948007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.173+0000 7f8954ff9700 1 -- 172.21.15.78:0/2479029671 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8950050af0 con 0x7f8958159530 2023-06-09T20:19:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.341+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f89580cb520 con 0x7f89440662f0 2023-06-09T20:19:33.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.469+0000 7f8954ff9700 1 -- 172.21.15.78:0/2479029671 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f89580cb520 con 0x7f89440662f0 2023-06-09T20:19:33.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.469+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89440662f0 msgr2=0x7f89440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.469+0000 7f895e468700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89440662f0 0x7f89440687a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8948000f60 tx=0x7f8948007d00 comp rx=0 tx=0).stop 2023-06-09T20:19:33.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.469+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8958159530 msgr2=0x7f89580ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.469+0000 7f895e468700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8958159530 0x7f89580ac1d0 secure :-1 s=READY pgs=3275 cs=0 l=1 rev1=1 crypto rx=0x7f8950001fd0 tx=0x7f895000a340 comp rx=0 tx=0).stop 2023-06-09T20:19:33.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.469+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 shutdown_connections 2023-06-09T20:19:33.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.469+0000 7f895e468700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f89440662f0 0x7f89440687a0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.473+0000 7f895e468700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8958159530 0x7f89580ac1d0 unknown :-1 s=CLOSED pgs=3275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.473+0000 7f895e468700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89580ca5c0 0x7f89580abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.473+0000 7f895e468700 1 --2- 172.21.15.78:0/2479029671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f895806a5e0 0x7f895814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.473+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 >> 172.21.15.78:0/2479029671 conn(0x7f89580b1480 msgr2=0x7f895814f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:33.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.473+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 shutdown_connections 2023-06-09T20:19:33.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.473+0000 7f895e468700 1 -- 172.21.15.78:0/2479029671 wait complete. 2023-06-09T20:19:33.482 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2023-06-09T20:19:33.502 INFO:tasks.ceph:Scrubbing osd.1 2023-06-09T20:19:33.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:33.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaf5491700 1 Processor -- start 2023-06-09T20:19:33.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaf5491700 1 -- start start 2023-06-09T20:19:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaf5491700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbaf00c9250 0x7fbaf015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaf5491700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf015f2e0 con 0x7fbaf015a730 2023-06-09T20:19:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaf5491700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf00c98a0 con 0x7fbaf006b800 2023-06-09T20:19:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaf5491700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00c9b80 con 0x7fbaf00c9250 2023-06-09T20:19:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbae7fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fbaf006b800 0x7fbaf00701b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:53034/0 (socket says 172.21.15.78:53034) 2023-06-09T20:19:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaeeffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbaf015a730 0x7fbaf006b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58084/0 (socket says 172.21.15.78:58084) 2023-06-09T20:19:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbae7fff700 1 -- 172.21.15.78:0/2475585015 learned_addr learned my addr 172.21.15.78:0/2475585015 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaef7fe700 1 --2- 172.21.15.78:0/2475585015 >> v2:172.21.15.187:3300/0 conn(0x7fbaf00c9250 0x7fbaf015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.677+0000 7fbaee7fc700 1 -- 172.21.15.78:0/2475585015 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614253696 0 0) 0x7fbaf00c98a0 con 0x7fbaf006b800 2023-06-09T20:19:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaee7fc700 1 -- 172.21.15.78:0/2475585015 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbadc0035d0 con 0x7fbaf006b800 2023-06-09T20:19:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaef7fe700 1 -- 172.21.15.78:0/2475585015 >> v1:172.21.15.187:6789/0 conn(0x7fbaf006b800 legacy=0x7fbaf00701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaef7fe700 1 -- 172.21.15.78:0/2475585015 >> v1:172.21.15.78:6789/0 conn(0x7fbaf015a730 legacy=0x7fbaf006b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaee7fc700 1 -- 172.21.15.78:0/2475585015 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266369783 0 0) 0x7fbae0001110 con 0x7fbaf015a730 2023-06-09T20:19:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaef7fe700 1 -- 172.21.15.78:0/2475585015 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf006f9b0 con 0x7fbaf00c9250 2023-06-09T20:19:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaef7fe700 1 --2- 172.21.15.78:0/2475585015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf00c9250 0x7fbaf015eda0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009d90 tx=0x7fbae800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7a573afa008f862 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaee7fc700 1 -- 172.21.15.78:0/2475585015 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800e070 con 0x7fbaf00c9250 2023-06-09T20:19:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaee7fc700 1 -- 172.21.15.78:0/2475585015 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae800bb20 con 0x7fbaf00c9250 2023-06-09T20:19:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaee7fc700 1 -- 172.21.15.78:0/2475585015 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800bed0 con 0x7fbaf00c9250 2023-06-09T20:19:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaf5491700 1 -- 172.21.15.78:0/2475585015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf00c9250 msgr2=0x7fbaf015eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaf5491700 1 --2- 172.21.15.78:0/2475585015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf00c9250 0x7fbaf015eda0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009d90 tx=0x7fbae800b330 comp rx=0 tx=0).stop 2023-06-09T20:19:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaf5491700 1 -- 172.21.15.78:0/2475585015 shutdown_connections 2023-06-09T20:19:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaf5491700 1 --2- 172.21.15.78:0/2475585015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf00c9250 0x7fbaf015eda0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaf5491700 1 -- 172.21.15.78:0/2475585015 >> 172.21.15.78:0/2475585015 conn(0x7fbaf00cf860 msgr2=0x7fbaf00cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaf5491700 1 -- 172.21.15.78:0/2475585015 shutdown_connections 2023-06-09T20:19:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.681+0000 7fbaf5491700 1 -- 172.21.15.78:0/2475585015 wait complete. 2023-06-09T20:19:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.685+0000 7fbaf5491700 1 Processor -- start 2023-06-09T20:19:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.685+0000 7fbaf5491700 1 -- start start 2023-06-09T20:19:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf006b800 0x7fbaf015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaf00c9250 0x7fbaf0154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbaf015a730 0x7fbaf0069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf0154fa0 con 0x7fbaf00c9250 2023-06-09T20:19:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf015ac20 con 0x7fbaf006b800 2023-06-09T20:19:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf015af00 con 0x7fbaf015a730 2023-06-09T20:19:33.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf006b800 0x7fbaf015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbae7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaf00c9250 0x7fbaf0154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaef7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbaf015a730 0x7fbaf0069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf006b800 0x7fbaf015bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53876/0 (socket says 172.21.15.78:53876) 2023-06-09T20:19:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 -- 172.21.15.78:0/792551438 learned_addr learned my addr 172.21.15.78:0/792551438 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 -- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbaf015a730 msgr2=0x7fbaf0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbaf015a730 0x7fbaf0069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 -- 172.21.15.78:0/792551438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaf00c9250 msgr2=0x7fbaf0154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaf00c9250 0x7fbaf0154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 -- 172.21.15.78:0/792551438 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8009a70 con 0x7fbaf006b800 2023-06-09T20:19:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaef7fe700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbaf015a730 0x7fbaf0069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaeeffd700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf006b800 0x7fbaf015bcc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c750 tx=0x7fbae000ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0004ca0 con 0x7fbaf006b800 2023-06-09T20:19:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0004e00 con 0x7fbaf006b800 2023-06-09T20:19:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0007310 con 0x7fbaf006b800 2023-06-09T20:19:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf00c9e60 con 0x7fbaf006b800 2023-06-09T20:19:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.689+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf006fc90 con 0x7fbaf006b800 2023-06-09T20:19:33.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.693+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbaf00b1af0 con 0x7fbaf006b800 2023-06-09T20:19:33.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.693+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbae0007470 con 0x7fbaf006b800 2023-06-09T20:19:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbae77fe700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbad00662f0 0x7fbad00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbae00837d0 con 0x7fbaf006b800 2023-06-09T20:19:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbae7fff700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbad00662f0 0x7fbad00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbae77fe700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7fbad006c760 0x7fbad006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 --> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbad006f220 con 0x7fbad006c760 2023-06-09T20:19:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbae0083b40 con 0x7fbaf006b800 2023-06-09T20:19:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbaef7fe700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7fbad006c760 0x7fbad006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbae7fff700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbad00662f0 0x7fbad00687a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0158630 tx=0x7fbad8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.697+0000 7fbaef7fe700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7fbad006c760 0x7fbad006eb70 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.721+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== osd.1 v2:172.21.15.78:6817/80014187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbad006f220 con 0x7fbad006c760 2023-06-09T20:19:33.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.741+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 --> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbaf015b070 con 0x7fbad006c760 2023-06-09T20:19:33.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbae77fe700 1 -- 172.21.15.78:0/792551438 <== osd.1 v2:172.21.15.78:6817/80014187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbaf015b070 con 0x7fbad006c760 2023-06-09T20:19:33.769 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:33.769 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:33.770 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:33.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7fbad006c760 msgr2=0x7fbad006eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.78:6817/80014187,v1:172.21.15.78:6820/80014187] conn(0x7fbad006c760 0x7fbad006eb70 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbad00662f0 msgr2=0x7fbad00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fbad00662f0 0x7fbad00687a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0158630 tx=0x7fbad8007de0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf006b800 msgr2=0x7fbaf015bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 --2- 172.21.15.78:0/792551438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbaf006b800 0x7fbaf015bcc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c750 tx=0x7fbae000ca60 comp rx=0 tx=0).stop 2023-06-09T20:19:33.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaef7fe700 1 -- 172.21.15.78:0/792551438 reap_dead start 2023-06-09T20:19:33.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 shutdown_connections 2023-06-09T20:19:33.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 >> 172.21.15.78:0/792551438 conn(0x7fbaf00cf860 msgr2=0x7fbaf006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:33.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 shutdown_connections 2023-06-09T20:19:33.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.761+0000 7fbaf5491700 1 -- 172.21.15.78:0/792551438 wait complete. 2023-06-09T20:19:33.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-06-09T20:19:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.965+0000 7f84c993e700 1 Processor -- start 2023-06-09T20:19:33.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.965+0000 7f84c993e700 1 -- start start 2023-06-09T20:19:33.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.965+0000 7f84c993e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c4160940 0x7f84c40ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.965+0000 7f84c993e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84c406f2a0 0x7f84c41644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.965+0000 7f84c993e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c40adb00 con 0x7f84c406f880 2023-06-09T20:19:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.965+0000 7f84c993e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c41653a0 con 0x7f84c406f2a0 2023-06-09T20:19:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.965+0000 7f84c993e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c406ba70 con 0x7f84c4160940 2023-06-09T20:19:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c913d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f84c406f880 0x7f84c406dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58100/0 (socket says 172.21.15.78:58100) 2023-06-09T20:19:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c913d700 1 -- 172.21.15.78:0/839217006 learned_addr learned my addr 172.21.15.78:0/839217006 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c893c700 1 --2- 172.21.15.78:0/839217006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c4160940 0x7f84c40ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c3fff700 1 --2- 172.21.15.78:0/839217006 >> v2:172.21.15.78:3300/0 conn(0x7f84c406f2a0 0x7f84c41644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c37fe700 1 -- 172.21.15.78:0/839217006 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484972548 0 0) 0x7f84c40adb00 con 0x7f84c406f880 2023-06-09T20:19:33.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c37fe700 1 -- 172.21.15.78:0/839217006 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b40035d0 con 0x7f84c406f880 2023-06-09T20:19:33.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c3fff700 1 -- 172.21.15.78:0/839217006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c4160940 msgr2=0x7f84c40ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:33.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c3fff700 1 --2- 172.21.15.78:0/839217006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c4160940 0x7f84c40ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c3fff700 1 -- 172.21.15.78:0/839217006 >> v1:172.21.15.78:6789/0 conn(0x7f84c406f880 legacy=0x7f84c406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c3fff700 1 -- 172.21.15.78:0/839217006 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40ccb10 con 0x7f84c406f2a0 2023-06-09T20:19:33.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c893c700 1 --2- 172.21.15.78:0/839217006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c4160940 0x7f84c40ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:33.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c3fff700 1 --2- 172.21.15.78:0/839217006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c406f2a0 0x7f84c41644f0 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009850 tx=0x7f84b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d906d49d3ac97d22 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c37fe700 1 -- 172.21.15.78:0/839217006 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011830 con 0x7f84c406f2a0 2023-06-09T20:19:33.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c37fe700 1 -- 172.21.15.78:0/839217006 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b0011990 con 0x7f84c406f2a0 2023-06-09T20:19:33.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c37fe700 1 -- 172.21.15.78:0/839217006 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011d40 con 0x7f84c406f2a0 2023-06-09T20:19:33.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 -- 172.21.15.78:0/839217006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c406f2a0 msgr2=0x7f84c41644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 --2- 172.21.15.78:0/839217006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c406f2a0 0x7f84c41644f0 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009850 tx=0x7f84b0009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:33.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 -- 172.21.15.78:0/839217006 shutdown_connections 2023-06-09T20:19:33.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 --2- 172.21.15.78:0/839217006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c406f2a0 0x7f84c41644f0 unknown :-1 s=CLOSED pgs=3278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 --2- 172.21.15.78:0/839217006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c4160940 0x7f84c40ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 -- 172.21.15.78:0/839217006 >> 172.21.15.78:0/839217006 conn(0x7f84c40cf670 msgr2=0x7f84c40cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:33.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 -- 172.21.15.78:0/839217006 shutdown_connections 2023-06-09T20:19:33.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.969+0000 7f84c993e700 1 -- 172.21.15.78:0/839217006 wait complete. 2023-06-09T20:19:33.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.973+0000 7f84c993e700 1 Processor -- start 2023-06-09T20:19:33.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.973+0000 7f84c993e700 1 -- start start 2023-06-09T20:19:33.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c406f2a0 0x7f84c40b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c406f880 0x7f84c406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4160940 0x7f84c4070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41556c0 con 0x7f84c4160940 2023-06-09T20:19:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40b3ed0 con 0x7f84c406f2a0 2023-06-09T20:19:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40b41b0 con 0x7f84c406f880 2023-06-09T20:19:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4160940 0x7f84c4070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4160940 0x7f84c4070210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54600/0 (socket says 172.21.15.78:54600) 2023-06-09T20:19:33.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 -- 172.21.15.78:0/3648511352 learned_addr learned my addr 172.21.15.78:0/3648511352 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:33.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c893c700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c406f2a0 0x7f84c40b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c3fff700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c406f880 0x7f84c406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 -- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c406f880 msgr2=0x7f84c406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c406f880 0x7f84c406fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 -- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c406f2a0 msgr2=0x7f84c40b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c406f2a0 0x7f84c40b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 -- 172.21.15.78:0/3648511352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b80094b0 con 0x7f84c4160940 2023-06-09T20:19:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c913d700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4160940 0x7f84c4070210 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00cbb0 tx=0x7f84bc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c17fa700 1 -- 172.21.15.78:0/3648511352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00a9e0 con 0x7f84c4160940 2023-06-09T20:19:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c17fa700 1 -- 172.21.15.78:0/3648511352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc00ab40 con 0x7f84c4160940 2023-06-09T20:19:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c17fa700 1 -- 172.21.15.78:0/3648511352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00ce70 con 0x7f84c4160940 2023-06-09T20:19:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00094b0 con 0x7f84c4160940 2023-06-09T20:19:33.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.977+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c41650c0 con 0x7f84c4160940 2023-06-09T20:19:33.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.981+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c40add50 con 0x7f84c4160940 2023-06-09T20:19:33.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.981+0000 7f84c17fa700 1 -- 172.21.15.78:0/3648511352 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84bc01b3b0 con 0x7f84c4160940 2023-06-09T20:19:33.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.981+0000 7f84c17fa700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f84a8066320 0x7f84a80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:33.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.981+0000 7f84c17fa700 1 -- 172.21.15.78:0/3648511352 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f84bc083310 con 0x7f84c4160940 2023-06-09T20:19:33.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.981+0000 7f84c893c700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f84a8066320 0x7f84a80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:33.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.985+0000 7f84c893c700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f84a8066320 0x7f84a80687d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009c70 tx=0x7f84b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:33.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:33.989+0000 7f84c17fa700 1 -- 172.21.15.78:0/3648511352 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f84bc050bd0 con 0x7f84c4160940 2023-06-09T20:19:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.161+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f84c4161d20 con 0x7f84a8066320 2023-06-09T20:19:34.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.209+0000 7f84c17fa700 1 -- 172.21.15.78:0/3648511352 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f84c4161d20 con 0x7f84a8066320 2023-06-09T20:19:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f84a8066320 msgr2=0x7f84a80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f84a8066320 0x7f84a80687d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009c70 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2023-06-09T20:19:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4160940 msgr2=0x7f84c4070210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4160940 0x7f84c4070210 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00cbb0 tx=0x7f84bc00cc90 comp rx=0 tx=0).stop 2023-06-09T20:19:34.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 shutdown_connections 2023-06-09T20:19:34.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f84a8066320 0x7f84a80687d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84c4160940 0x7f84c4070210 unknown :-1 s=CLOSED pgs=3279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84c406f880 0x7f84c406fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 --2- 172.21.15.78:0/3648511352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84c406f2a0 0x7f84c40b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 >> 172.21.15.78:0/3648511352 conn(0x7f84c40cf670 msgr2=0x7f84c40cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 shutdown_connections 2023-06-09T20:19:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.213+0000 7f84c993e700 1 -- 172.21.15.78:0/3648511352 wait complete. 2023-06-09T20:19:34.224 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2023-06-09T20:19:34.244 INFO:tasks.ceph:Scrubbing osd.2 2023-06-09T20:19:34.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.417+0000 7effe56c3700 1 Processor -- start 2023-06-09T20:19:34.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.417+0000 7effe56c3700 1 -- start start 2023-06-09T20:19:34.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe015c6d0 0x7effe006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7effe00cf080 0x7effe006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7effe00d1560 0x7effe006f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe00c8350 con 0x7effe00cf080 2023-06-09T20:19:34.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe00ce550 con 0x7effe00d1560 2023-06-09T20:19:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe00ce830 con 0x7effe015c6d0 2023-06-09T20:19:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effdeffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe015c6d0 0x7effe006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effdf7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7effe00d1560 0x7effe006f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effde7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7effe00cf080 0x7effe006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effdeffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe015c6d0 0x7effe006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40860/0 (socket says 172.21.15.78:40860) 2023-06-09T20:19:34.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effdeffd700 1 -- 172.21.15.78:0/626666925 learned_addr learned my addr 172.21.15.78:0/626666925 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:34.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effde7fc700 1 -- 172.21.15.78:0/626666925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe015c6d0 msgr2=0x7effe006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:34.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effde7fc700 1 --2- 172.21.15.78:0/626666925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe015c6d0 0x7effe006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effde7fc700 1 -- 172.21.15.78:0/626666925 >> v2:172.21.15.187:3300/0 conn(0x7effe00d1560 msgr2=0x7effe006f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:34.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effde7fc700 1 --2- 172.21.15.78:0/626666925 >> v2:172.21.15.187:3300/0 conn(0x7effe00d1560 0x7effe006f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effde7fc700 1 -- 172.21.15.78:0/626666925 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00ceb10 con 0x7effe00cf080 2023-06-09T20:19:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effdf7fe700 1 --2- 172.21.15.78:0/626666925 >> v2:172.21.15.187:3300/0 conn(0x7effe00d1560 0x7effe006f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effde7fc700 1 --2- 172.21.15.78:0/626666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe00cf080 0x7effe006dd10 secure :-1 s=READY pgs=3280 cs=0 l=1 rev1=1 crypto rx=0x7effe00d2e20 tx=0x7effd4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad243ecd98c53dc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effddffb700 1 -- 172.21.15.78:0/626666925 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4011830 con 0x7effe00cf080 2023-06-09T20:19:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effddffb700 1 -- 172.21.15.78:0/626666925 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4011990 con 0x7effe00cf080 2023-06-09T20:19:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effddffb700 1 -- 172.21.15.78:0/626666925 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4011d20 con 0x7effe00cf080 2023-06-09T20:19:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 -- 172.21.15.78:0/626666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe00cf080 msgr2=0x7effe006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.421+0000 7effe56c3700 1 --2- 172.21.15.78:0/626666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe00cf080 0x7effe006dd10 secure :-1 s=READY pgs=3280 cs=0 l=1 rev1=1 crypto rx=0x7effe00d2e20 tx=0x7effd4009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.425+0000 7effe56c3700 1 -- 172.21.15.78:0/626666925 shutdown_connections 2023-06-09T20:19:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.425+0000 7effe56c3700 1 --2- 172.21.15.78:0/626666925 >> v2:172.21.15.187:3300/0 conn(0x7effe00d1560 0x7effe006f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.425+0000 7effe56c3700 1 --2- 172.21.15.78:0/626666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe00cf080 0x7effe006dd10 unknown :-1 s=CLOSED pgs=3280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.425+0000 7effe56c3700 1 --2- 172.21.15.78:0/626666925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe015c6d0 0x7effe006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.425+0000 7effe56c3700 1 -- 172.21.15.78:0/626666925 >> 172.21.15.78:0/626666925 conn(0x7effe00b4c00 msgr2=0x7effe00b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.425+0000 7effe56c3700 1 -- 172.21.15.78:0/626666925 shutdown_connections 2023-06-09T20:19:34.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.425+0000 7effe56c3700 1 -- 172.21.15.78:0/626666925 wait complete. 2023-06-09T20:19:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 Processor -- start 2023-06-09T20:19:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 -- start start 2023-06-09T20:19:34.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe00cf080 0x7effe00b8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe00d1560 0x7effe0152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe015c6d0 0x7effe0152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe01531f0 con 0x7effe015c6d0 2023-06-09T20:19:34.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe01f9ee0 con 0x7effe00cf080 2023-06-09T20:19:34.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effe56c3700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe0156620 con 0x7effe00d1560 2023-06-09T20:19:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effde7fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe00d1560 0x7effe0152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe015c6d0 0x7effe0152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effde7fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe00d1560 0x7effe0152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40862/0 (socket says 172.21.15.78:40862) 2023-06-09T20:19:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe00cf080 0x7effe00b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effde7fc700 1 -- 172.21.15.78:0/2662801967 learned_addr learned my addr 172.21.15.78:0/2662801967 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:34.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdeffd700 1 -- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe00d1560 msgr2=0x7effe0152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdeffd700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe00d1560 0x7effe0152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdeffd700 1 -- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe015c6d0 msgr2=0x7effe0152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdeffd700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe015c6d0 0x7effe0152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdeffd700 1 -- 172.21.15.78:0/2662801967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8009a70 con 0x7effe00cf080 2023-06-09T20:19:34.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effde7fc700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effe00d1560 0x7effe0152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:34.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdf7fe700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effe015c6d0 0x7effe0152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:34.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effdeffd700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe00cf080 0x7effe00b8730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effd000e870 tx=0x7effd000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:34.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0013680 con 0x7effe00cf080 2023-06-09T20:19:34.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd00137e0 con 0x7effe00cf080 2023-06-09T20:19:34.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.429+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0013b50 con 0x7effe00cf080 2023-06-09T20:19:34.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.433+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd40094b0 con 0x7effe00cf080 2023-06-09T20:19:34.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.433+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe015caa0 con 0x7effe00cf080 2023-06-09T20:19:34.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.433+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effe00c85a0 con 0x7effe00cf080 2023-06-09T20:19:34.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.433+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7effd0013cb0 con 0x7effe00cf080 2023-06-09T20:19:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effc77fe700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7effcc0662f0 0x7effcc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7effd00836d0 con 0x7effe00cf080 2023-06-09T20:19:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effde7fc700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7effcc0662f0 0x7effcc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effc77fe700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7effcc06c760 0x7effcc06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 --> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effcc06f220 con 0x7effcc06c760 2023-06-09T20:19:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7effd0085cb0 con 0x7effe00cf080 2023-06-09T20:19:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effdf7fe700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7effcc06c760 0x7effcc06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effde7fc700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7effcc0662f0 0x7effcc0687a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7effe00cb730 tx=0x7effd4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.437+0000 7effdf7fe700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7effcc06c760 0x7effcc06eb70 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:34.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.457+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== osd.2 v2:172.21.15.78:6816/1132416136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7effcc06f220 con 0x7effcc06c760 2023-06-09T20:19:34.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.477+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 --> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7effe00ce200 con 0x7effcc06c760 2023-06-09T20:19:34.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effc77fe700 1 -- 172.21.15.78:0/2662801967 <== osd.2 v2:172.21.15.78:6816/1132416136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7effe00ce200 con 0x7effcc06c760 2023-06-09T20:19:34.511 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:34.511 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:34.512 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:34.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7effcc06c760 msgr2=0x7effcc06eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.78:6816/1132416136,v1:172.21.15.78:6818/1132416136] conn(0x7effcc06c760 0x7effcc06eb70 crc :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7effcc0662f0 msgr2=0x7effcc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7effcc0662f0 0x7effcc0687a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7effe00cb730 tx=0x7effd4008030 comp rx=0 tx=0).stop 2023-06-09T20:19:34.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe00cf080 msgr2=0x7effe00b8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 --2- 172.21.15.78:0/2662801967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effe00cf080 0x7effe00b8730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effd000e870 tx=0x7effd000eb80 comp rx=0 tx=0).stop 2023-06-09T20:19:34.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effdf7fe700 1 -- 172.21.15.78:0/2662801967 reap_dead start 2023-06-09T20:19:34.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 shutdown_connections 2023-06-09T20:19:34.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 >> 172.21.15.78:0/2662801967 conn(0x7effe00b4c00 msgr2=0x7effe015ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:34.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 shutdown_connections 2023-06-09T20:19:34.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.505+0000 7effe56c3700 1 -- 172.21.15.78:0/2662801967 wait complete. 2023-06-09T20:19:34.536 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-06-09T20:19:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.713+0000 7f332108a700 1 Processor -- start 2023-06-09T20:19:34.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.713+0000 7f332108a700 1 -- start start 2023-06-09T20:19:34.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.713+0000 7f332108a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f331c15c920 0x7f331c0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.713+0000 7f332108a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c06b0f0 0x7f331c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.713+0000 7f332108a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331c06ba70 con 0x7f331c070400 2023-06-09T20:19:34.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.713+0000 7f332108a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331c15ccf0 con 0x7f331c15c920 2023-06-09T20:19:34.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.713+0000 7f332108a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c0d14d0 con 0x7f331c06b0f0 2023-06-09T20:19:34.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331ad9d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f331c15c920 0x7f331c0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331a59c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f331c070400 0x7f331c160de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:58112/0 (socket says 172.21.15.78:58112) 2023-06-09T20:19:34.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331a59c700 1 -- 172.21.15.78:0/2255969193 learned_addr learned my addr 172.21.15.78:0/2255969193 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:34.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331b59e700 1 --2- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c06b0f0 0x7f331c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331ad9d700 1 -- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c06b0f0 msgr2=0x7f331c06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:34.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331ad9d700 1 --2- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c06b0f0 0x7f331c06b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331ad9d700 1 -- 172.21.15.78:0/2255969193 >> v1:172.21.15.78:6789/0 conn(0x7f331c070400 legacy=0x7f331c160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331ad9d700 1 -- 172.21.15.78:0/2255969193 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0d17b0 con 0x7f331c15c920 2023-06-09T20:19:34.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f331ad9d700 1 --2- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c15c920 0x7f331c0d0ec0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f330c009850 tx=0x7f330c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f17f5399f83452 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:34.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f3319d9b700 1 -- 172.21.15.78:0/2255969193 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c011830 con 0x7f331c15c920 2023-06-09T20:19:34.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f3319d9b700 1 -- 172.21.15.78:0/2255969193 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c011990 con 0x7f331c15c920 2023-06-09T20:19:34.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f3319d9b700 1 -- 172.21.15.78:0/2255969193 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c011d20 con 0x7f331c15c920 2023-06-09T20:19:34.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 -- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c15c920 msgr2=0x7f331c0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 --2- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c15c920 0x7f331c0d0ec0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f330c009850 tx=0x7f330c009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:34.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 -- 172.21.15.78:0/2255969193 shutdown_connections 2023-06-09T20:19:34.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 --2- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c06b0f0 0x7f331c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 --2- 172.21.15.78:0/2255969193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c15c920 0x7f331c0d0ec0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 -- 172.21.15.78:0/2255969193 >> 172.21.15.78:0/2255969193 conn(0x7f331c0d3c10 msgr2=0x7f331c0cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:34.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 -- 172.21.15.78:0/2255969193 shutdown_connections 2023-06-09T20:19:34.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.717+0000 7f332108a700 1 -- 172.21.15.78:0/2255969193 wait complete. 2023-06-09T20:19:34.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.721+0000 7f332108a700 1 Processor -- start 2023-06-09T20:19:34.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.721+0000 7f332108a700 1 -- start start 2023-06-09T20:19:34.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c06b0f0 0x7f331c14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f331c070400 0x7f331c14ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c15c920 0x7f331c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c14f890 con 0x7f331c070400 2023-06-09T20:19:34.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c15ebb0 con 0x7f331c06b0f0 2023-06-09T20:19:34.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c1525a0 con 0x7f331c15c920 2023-06-09T20:19:34.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f331c070400 0x7f331c14ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c06b0f0 0x7f331c14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331b59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c15c920 0x7f331c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c06b0f0 0x7f331c14ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53916/0 (socket says 172.21.15.78:53916) 2023-06-09T20:19:34.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 -- 172.21.15.78:0/3494332901 learned_addr learned my addr 172.21.15.78:0/3494332901 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:34.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 -- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c15c920 msgr2=0x7f331c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c15c920 0x7f331c152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 -- 172.21.15.78:0/3494332901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f331c070400 msgr2=0x7f331c14ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f331c070400 0x7f331c14ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 -- 172.21.15.78:0/3494332901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0094b0 con 0x7f331c06b0f0 2023-06-09T20:19:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f331ad9d700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c06b0f0 0x7f331c14ff90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f330c014040 tx=0x7f330c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f33037fe700 1 -- 172.21.15.78:0/3494332901 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c004610 con 0x7f331c06b0f0 2023-06-09T20:19:34.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f33037fe700 1 -- 172.21.15.78:0/3494332901 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c01e070 con 0x7f331c06b0f0 2023-06-09T20:19:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c06fc00 con 0x7f331c06b0f0 2023-06-09T20:19:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f33037fe700 1 -- 172.21.15.78:0/3494332901 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c003920 con 0x7f331c06b0f0 2023-06-09T20:19:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.725+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c06f920 con 0x7f331c06b0f0 2023-06-09T20:19:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.729+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c06fee0 con 0x7f331c06b0f0 2023-06-09T20:19:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.729+0000 7f33037fe700 1 -- 172.21.15.78:0/3494332901 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f330c003a80 con 0x7f331c06b0f0 2023-06-09T20:19:34.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.729+0000 7f33037fe700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3308066320 0x7f33080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:34.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.729+0000 7f33037fe700 1 -- 172.21.15.78:0/3494332901 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f330c084840 con 0x7f331c06b0f0 2023-06-09T20:19:34.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.729+0000 7f331a59c700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3308066320 0x7f33080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:34.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.733+0000 7f331a59c700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3308066320 0x7f33080687d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f331c14fdb0 tx=0x7f3310009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:34.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.733+0000 7f33037fe700 1 -- 172.21.15.78:0/3494332901 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f330c051f50 con 0x7f331c06b0f0 2023-06-09T20:19:34.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.905+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f331c152760 con 0x7f3308066320 2023-06-09T20:19:34.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.929+0000 7f33037fe700 1 -- 172.21.15.78:0/3494332901 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f331c152760 con 0x7f3308066320 2023-06-09T20:19:34.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3308066320 msgr2=0x7f33080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3308066320 0x7f33080687d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f331c14fdb0 tx=0x7f3310009040 comp rx=0 tx=0).stop 2023-06-09T20:19:34.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c06b0f0 msgr2=0x7f331c14ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:34.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c06b0f0 0x7f331c14ff90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f330c014040 tx=0x7f330c004770 comp rx=0 tx=0).stop 2023-06-09T20:19:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 shutdown_connections 2023-06-09T20:19:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f3308066320 0x7f33080687d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331c15c920 0x7f331c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f331c070400 0x7f331c14ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 --2- 172.21.15.78:0/3494332901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f331c06b0f0 0x7f331c14ff90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 >> 172.21.15.78:0/3494332901 conn(0x7f331c0d3c10 msgr2=0x7f331c0b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 shutdown_connections 2023-06-09T20:19:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:34.933+0000 7f332108a700 1 -- 172.21.15.78:0/3494332901 wait complete. 2023-06-09T20:19:34.943 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2023-06-09T20:19:34.963 INFO:tasks.ceph:Scrubbing osd.3 2023-06-09T20:19:34.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:35.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.137+0000 7f884151e700 1 Processor -- start 2023-06-09T20:19:35.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.137+0000 7f884151e700 1 -- start start 2023-06-09T20:19:35.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f884151e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f883c1428c0 0x7f883c06a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f884151e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 0x7f883c1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f884151e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c06abc0 con 0x7f883c0b6a30 2023-06-09T20:19:35.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f884151e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c06ba00 con 0x7f883c1428c0 2023-06-09T20:19:35.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f884151e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c06adf0 con 0x7f883c06edb0 2023-06-09T20:19:35.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f883affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f883c1428c0 0x7f883c06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f883affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f883c1428c0 0x7f883c06a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33532/0 (socket says 172.21.15.78:33532) 2023-06-09T20:19:35.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f883affd700 1 -- 172.21.15.78:0/2129018351 learned_addr learned my addr 172.21.15.78:0/2129018351 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:35.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.141+0000 7f883b7fe700 1 --2- 172.21.15.78:0/2129018351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 0x7f883c1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f883affd700 1 -- 172.21.15.78:0/2129018351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 msgr2=0x7f883c1431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:35.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f883affd700 1 --2- 172.21.15.78:0/2129018351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 0x7f883c1431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f883affd700 1 -- 172.21.15.78:0/2129018351 >> v1:172.21.15.187:6789/0 conn(0x7f883c0b6a30 legacy=0x7f883c06e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f883affd700 1 -- 172.21.15.78:0/2129018351 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c06b0d0 con 0x7f883c1428c0 2023-06-09T20:19:35.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f8839ffb700 1 -- 172.21.15.78:0/2129018351 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249457422 0 0) 0x7f883c06abc0 con 0x7f883c0b6a30 2023-06-09T20:19:35.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f883affd700 1 --2- 172.21.15.78:0/2129018351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c1428c0 0x7f883c06a680 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 crypto rx=0x7f882c009910 tx=0x7f882c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28f1ecf7a266e8a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f8839ffb700 1 -- 172.21.15.78:0/2129018351 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c011830 con 0x7f883c1428c0 2023-06-09T20:19:35.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f8839ffb700 1 -- 172.21.15.78:0/2129018351 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c011990 con 0x7f883c1428c0 2023-06-09T20:19:35.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f8839ffb700 1 -- 172.21.15.78:0/2129018351 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c011d40 con 0x7f883c1428c0 2023-06-09T20:19:35.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 -- 172.21.15.78:0/2129018351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c1428c0 msgr2=0x7f883c06a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 --2- 172.21.15.78:0/2129018351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c1428c0 0x7f883c06a680 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 crypto rx=0x7f882c009910 tx=0x7f882c009c20 comp rx=0 tx=0).stop 2023-06-09T20:19:35.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 -- 172.21.15.78:0/2129018351 shutdown_connections 2023-06-09T20:19:35.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 --2- 172.21.15.78:0/2129018351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 0x7f883c1431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 --2- 172.21.15.78:0/2129018351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c1428c0 0x7f883c06a680 unknown :-1 s=CLOSED pgs=3282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 -- 172.21.15.78:0/2129018351 >> 172.21.15.78:0/2129018351 conn(0x7f883c0b57d0 msgr2=0x7f883c0d2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 -- 172.21.15.78:0/2129018351 shutdown_connections 2023-06-09T20:19:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.145+0000 7f884151e700 1 -- 172.21.15.78:0/2129018351 wait complete. 2023-06-09T20:19:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 Processor -- start 2023-06-09T20:19:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 -- start start 2023-06-09T20:19:35.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 0x7f883c142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c0b6a30 0x7f883c13c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f883c1428c0 0x7f883c13f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c139a90 con 0x7f883c0b6a30 2023-06-09T20:19:35.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c13b240 con 0x7f883c1428c0 2023-06-09T20:19:35.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f884151e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c13b520 con 0x7f883c06edb0 2023-06-09T20:19:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.149+0000 7f883a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c0b6a30 0x7f883c13c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c0b6a30 0x7f883c13c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33534/0 (socket says 172.21.15.78:33534) 2023-06-09T20:19:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 -- 172.21.15.78:0/3816628397 learned_addr learned my addr 172.21.15.78:0/3816628397 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883affd700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 0x7f883c142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883b7fe700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f883c1428c0 0x7f883c13f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 -- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 msgr2=0x7f883c142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f883c06edb0 0x7f883c142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 -- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f883c1428c0 msgr2=0x7f883c13f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f883c1428c0 0x7f883c13f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 -- 172.21.15.78:0/3816628397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009570 con 0x7f883c0b6a30 2023-06-09T20:19:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f883a7fc700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c0b6a30 0x7f883c13c2e0 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 crypto rx=0x7f88300011e0 tx=0x7f883000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300054e0 con 0x7f883c0b6a30 2023-06-09T20:19:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88300036a0 con 0x7f883c0b6a30 2023-06-09T20:19:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830003a50 con 0x7f883c0b6a30 2023-06-09T20:19:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c06b690 con 0x7f883c0b6a30 2023-06-09T20:19:35.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c06b3b0 con 0x7f883c0b6a30 2023-06-09T20:19:35.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.153+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f883c0b6eb0 con 0x7f883c0b6a30 2023-06-09T20:19:35.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8830003bb0 con 0x7f883c0b6a30 2023-06-09T20:19:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f88237fe700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88280662f0 0x7f88280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8830082f70 con 0x7f883c0b6a30 2023-06-09T20:19:35.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f88237fe700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7f882806c760 0x7f882806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 --> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f882806f220 con 0x7f882806c760 2023-06-09T20:19:35.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f883affd700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88280662f0 0x7f88280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8830088500 con 0x7f883c0b6a30 2023-06-09T20:19:35.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.157+0000 7f883b7fe700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7f882806c760 0x7f882806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.161+0000 7f883affd700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88280662f0 0x7f88280687a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f882c014040 tx=0x7f882c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.161+0000 7f883b7fe700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7f882806c760 0x7f882806eb70 crc :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.185+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== osd.3 v2:172.21.15.78:6807/358574958 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f882806f220 con 0x7f882806c760 2023-06-09T20:19:35.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.205+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 --> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f883c0741c0 con 0x7f882806c760 2023-06-09T20:19:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.213+0000 7f88237fe700 1 -- 172.21.15.78:0/3816628397 <== osd.3 v2:172.21.15.78:6807/358574958 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f883c0741c0 con 0x7f882806c760 2023-06-09T20:19:35.223 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:35.223 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:35.223 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:35.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7f882806c760 msgr2=0x7f882806eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:6807/358574958,v1:172.21.15.78:6809/358574958] conn(0x7f882806c760 0x7f882806eb70 crc :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88280662f0 msgr2=0x7f88280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f88280662f0 0x7f88280687a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f882c014040 tx=0x7f882c008030 comp rx=0 tx=0).stop 2023-06-09T20:19:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c0b6a30 msgr2=0x7f883c13c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 --2- 172.21.15.78:0/3816628397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f883c0b6a30 0x7f883c13c2e0 secure :-1 s=READY pgs=3283 cs=0 l=1 rev1=1 crypto rx=0x7f88300011e0 tx=0x7f883000ca30 comp rx=0 tx=0).stop 2023-06-09T20:19:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f883b7fe700 1 -- 172.21.15.78:0/3816628397 reap_dead start 2023-06-09T20:19:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 shutdown_connections 2023-06-09T20:19:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 >> 172.21.15.78:0/3816628397 conn(0x7f883c0b57d0 msgr2=0x7f883c06d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 shutdown_connections 2023-06-09T20:19:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.217+0000 7f884151e700 1 -- 172.21.15.78:0/3816628397 wait complete. 2023-06-09T20:19:35.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-06-09T20:19:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.425+0000 7fda34cfa700 1 Processor -- start 2023-06-09T20:19:35.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.425+0000 7fda34cfa700 1 -- start start 2023-06-09T20:19:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.425+0000 7fda34cfa700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fda3006dfe0 0x7fda30165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.425+0000 7fda34cfa700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda300c1ce0 0x7fda3006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda300cc810 con 0x7fda30160c20 2023-06-09T20:19:35.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda30160ff0 con 0x7fda300c1ce0 2023-06-09T20:19:35.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda300cca60 con 0x7fda3006dfe0 2023-06-09T20:19:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2e59c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fda30160c20 0x7fda3006d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:46646/0 (socket says 172.21.15.78:46646) 2023-06-09T20:19:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2e59c700 1 -- 172.21.15.78:0/3711564589 learned_addr learned my addr 172.21.15.78:0/3711564589 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:35.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2dd9b700 1 --2- 172.21.15.78:0/3711564589 >> v2:172.21.15.187:3300/0 conn(0x7fda3006dfe0 0x7fda30165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2ed9d700 1 --2- 172.21.15.78:0/3711564589 >> v2:172.21.15.78:3300/0 conn(0x7fda300c1ce0 0x7fda3006fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2d59a700 1 -- 172.21.15.78:0/3711564589 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349361261 0 0) 0x7fda300cc810 con 0x7fda30160c20 2023-06-09T20:19:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2d59a700 1 -- 172.21.15.78:0/3711564589 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda180035d0 con 0x7fda30160c20 2023-06-09T20:19:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2dd9b700 1 -- 172.21.15.78:0/3711564589 >> v2:172.21.15.78:3300/0 conn(0x7fda300c1ce0 msgr2=0x7fda3006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:35.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2dd9b700 1 --2- 172.21.15.78:0/3711564589 >> v2:172.21.15.78:3300/0 conn(0x7fda300c1ce0 0x7fda3006fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2dd9b700 1 -- 172.21.15.78:0/3711564589 >> v1:172.21.15.187:6789/0 conn(0x7fda30160c20 legacy=0x7fda3006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2dd9b700 1 -- 172.21.15.78:0/3711564589 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300ccd40 con 0x7fda3006dfe0 2023-06-09T20:19:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2ed9d700 1 --2- 172.21.15.78:0/3711564589 >> v2:172.21.15.78:3300/0 conn(0x7fda300c1ce0 0x7fda3006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T20:19:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2dd9b700 1 --2- 172.21.15.78:0/3711564589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30165160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda3006d860 tx=0x7fda24009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf4c48c5f5577f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2d59a700 1 -- 172.21.15.78:0/3711564589 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24011830 con 0x7fda3006dfe0 2023-06-09T20:19:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2d59a700 1 -- 172.21.15.78:0/3711564589 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24011990 con 0x7fda3006dfe0 2023-06-09T20:19:35.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda2d59a700 1 -- 172.21.15.78:0/3711564589 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24011d20 con 0x7fda3006dfe0 2023-06-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- 172.21.15.78:0/3711564589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 msgr2=0x7fda30165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 --2- 172.21.15.78:0/3711564589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30165160 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda3006d860 tx=0x7fda24009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- 172.21.15.78:0/3711564589 shutdown_connections 2023-06-09T20:19:35.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 --2- 172.21.15.78:0/3711564589 >> v2:172.21.15.78:3300/0 conn(0x7fda300c1ce0 0x7fda3006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 --2- 172.21.15.78:0/3711564589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30165160 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- 172.21.15.78:0/3711564589 >> 172.21.15.78:0/3711564589 conn(0x7fda300b1480 msgr2=0x7fda300cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- 172.21.15.78:0/3711564589 shutdown_connections 2023-06-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.429+0000 7fda34cfa700 1 -- 172.21.15.78:0/3711564589 wait complete. 2023-06-09T20:19:35.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 Processor -- start 2023-06-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 -- start start 2023-06-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300c1ce0 0x7fda30163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30160c20 0x7fda300af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda30149990 con 0x7fda30160c20 2023-06-09T20:19:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda30161bf0 con 0x7fda3006dfe0 2023-06-09T20:19:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.433+0000 7fda34cfa700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda30161630 con 0x7fda300c1ce0 2023-06-09T20:19:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:33334/0 (socket says 172.21.15.78:33334) 2023-06-09T20:19:35.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 -- 172.21.15.78:0/495404951 learned_addr learned my addr 172.21.15.78:0/495404951 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2ed9d700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30160c20 0x7fda300af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2dd9b700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300c1ce0 0x7fda30163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 -- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300c1ce0 msgr2=0x7fda30163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300c1ce0 0x7fda30163f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 -- 172.21.15.78:0/495404951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30160c20 msgr2=0x7fda300af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30160c20 0x7fda300af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 -- 172.21.15.78:0/495404951 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240094b0 con 0x7fda3006dfe0 2023-06-09T20:19:35.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2dd9b700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300c1ce0 0x7fda30163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T20:19:35.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2ed9d700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30160c20 0x7fda300af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T20:19:35.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda2e59c700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30148cc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c4d0 tx=0x7fda2000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda1effd700 1 -- 172.21.15.78:0/495404951 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20005d90 con 0x7fda3006dfe0 2023-06-09T20:19:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda1effd700 1 -- 172.21.15.78:0/495404951 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda200070d0 con 0x7fda3006dfe0 2023-06-09T20:19:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda1effd700 1 -- 172.21.15.78:0/495404951 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20007480 con 0x7fda3006dfe0 2023-06-09T20:19:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda300cd300 con 0x7fda3006dfe0 2023-06-09T20:19:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda300cd020 con 0x7fda3006dfe0 2023-06-09T20:19:35.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.437+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3006eaa0 con 0x7fda3006dfe0 2023-06-09T20:19:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.441+0000 7fda1effd700 1 -- 172.21.15.78:0/495404951 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda200075e0 con 0x7fda3006dfe0 2023-06-09T20:19:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.441+0000 7fda1effd700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda100662f0 0x7fda100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.441+0000 7fda1effd700 1 -- 172.21.15.78:0/495404951 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fda20083020 con 0x7fda3006dfe0 2023-06-09T20:19:35.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.441+0000 7fda2dd9b700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda100662f0 0x7fda100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.445+0000 7fda2dd9b700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda100662f0 0x7fda100687a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.445+0000 7fda1effd700 1 -- 172.21.15.78:0/495404951 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fda20050720 con 0x7fda3006dfe0 2023-06-09T20:19:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.617+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fda300741c0 con 0x7fda100662f0 2023-06-09T20:19:35.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda1effd700 1 -- 172.21.15.78:0/495404951 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fda300741c0 con 0x7fda100662f0 2023-06-09T20:19:35.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda100662f0 msgr2=0x7fda100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda100662f0 0x7fda100687a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24008030 comp rx=0 tx=0).stop 2023-06-09T20:19:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 msgr2=0x7fda30148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30148cc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c4d0 tx=0x7fda2000c890 comp rx=0 tx=0).stop 2023-06-09T20:19:35.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 shutdown_connections 2023-06-09T20:19:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fda100662f0 0x7fda100687a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30160c20 0x7fda300af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300c1ce0 0x7fda30163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 --2- 172.21.15.78:0/495404951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3006dfe0 0x7fda30148cc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 >> 172.21.15.78:0/495404951 conn(0x7fda300b1480 msgr2=0x7fda30070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:35.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 shutdown_connections 2023-06-09T20:19:35.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.621+0000 7fda34cfa700 1 -- 172.21.15.78:0/495404951 wait complete. 2023-06-09T20:19:35.632 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2023-06-09T20:19:35.651 INFO:tasks.ceph:Scrubbing osd.4 2023-06-09T20:19:35.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.821+0000 7f8bf3c91700 1 Processor -- start 2023-06-09T20:19:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.821+0000 7f8bf3c91700 1 -- start start 2023-06-09T20:19:35.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf3c91700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8bec0ca930 0x7f8bec0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf3c91700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec06adb0 con 0x7f8bec161000 2023-06-09T20:19:35.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf3c91700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec0c1ed0 con 0x7f8bec0ccee0 2023-06-09T20:19:35.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf3c91700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec06b800 con 0x7f8bec0ca930 2023-06-09T20:19:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf1a2d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8bec161000 0x7f8bec0cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57506/0 (socket says 172.21.15.78:57506) 2023-06-09T20:19:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf1a2d700 1 -- 172.21.15.78:0/1033127947 learned_addr learned my addr 172.21.15.78:0/1033127947 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:35.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf222e700 1 --2- 172.21.15.78:0/1033127947 >> v2:172.21.15.187:3300/0 conn(0x7f8bec0ca930 0x7f8bec0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf0a2b700 1 -- 172.21.15.78:0/1033127947 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857381406 0 0) 0x7f8bec0c1ed0 con 0x7f8bec0ccee0 2023-06-09T20:19:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf0a2b700 1 -- 172.21.15.78:0/1033127947 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd80035d0 con 0x7f8bec0ccee0 2023-06-09T20:19:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf0a2b700 1 -- 172.21.15.78:0/1033127947 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583670332 0 0) 0x7f8bec06adb0 con 0x7f8bec161000 2023-06-09T20:19:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf0a2b700 1 -- 172.21.15.78:0/1033127947 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bec0c1ed0 con 0x7f8bec161000 2023-06-09T20:19:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf222e700 1 -- 172.21.15.78:0/1033127947 >> v1:172.21.15.187:6789/0 conn(0x7f8bec0ccee0 legacy=0x7f8bec0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf222e700 1 -- 172.21.15.78:0/1033127947 >> v1:172.21.15.78:6789/0 conn(0x7f8bec161000 legacy=0x7f8bec0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf222e700 1 -- 172.21.15.78:0/1033127947 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0c21b0 con 0x7f8bec0ca930 2023-06-09T20:19:35.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf222e700 1 --2- 172.21.15.78:0/1033127947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 0x7f8bec0c9960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009d90 tx=0x7f8be400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23cff14d4296cf4a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf0a2b700 1 -- 172.21.15.78:0/1033127947 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400e070 con 0x7f8bec0ca930 2023-06-09T20:19:35.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf0a2b700 1 -- 172.21.15.78:0/1033127947 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400bb20 con 0x7f8bec0ca930 2023-06-09T20:19:35.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.825+0000 7f8bf0a2b700 1 -- 172.21.15.78:0/1033127947 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400be90 con 0x7f8bec0ca930 2023-06-09T20:19:35.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.829+0000 7f8bf3c91700 1 -- 172.21.15.78:0/1033127947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 msgr2=0x7f8bec0c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.829+0000 7f8bf3c91700 1 --2- 172.21.15.78:0/1033127947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 0x7f8bec0c9960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009d90 tx=0x7f8be400b330 comp rx=0 tx=0).stop 2023-06-09T20:19:35.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.829+0000 7f8bf3c91700 1 -- 172.21.15.78:0/1033127947 shutdown_connections 2023-06-09T20:19:35.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.829+0000 7f8bf3c91700 1 --2- 172.21.15.78:0/1033127947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 0x7f8bec0c9960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.829+0000 7f8bf3c91700 1 -- 172.21.15.78:0/1033127947 >> 172.21.15.78:0/1033127947 conn(0x7f8bec0cf860 msgr2=0x7f8bec0cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:35.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.829+0000 7f8bf3c91700 1 -- 172.21.15.78:0/1033127947 shutdown_connections 2023-06-09T20:19:35.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.829+0000 7f8bf3c91700 1 -- 172.21.15.78:0/1033127947 wait complete. 2023-06-09T20:19:35.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 Processor -- start 2023-06-09T20:19:35.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 -- start start 2023-06-09T20:19:35.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 0x7f8bec151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bec0ccee0 0x7f8bec15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bec15c4d0 0x7f8bec0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec15c970 con 0x7f8bec0ccee0 2023-06-09T20:19:35.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0c3510 con 0x7f8bec0ca930 2023-06-09T20:19:35.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0c37f0 con 0x7f8bec15c4d0 2023-06-09T20:19:35.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bec15c4d0 0x7f8bec0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf122c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bec0ccee0 0x7f8bec15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bec15c4d0 0x7f8bec0c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:60276/0 (socket says 172.21.15.78:60276) 2023-06-09T20:19:35.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 -- 172.21.15.78:0/3089711477 learned_addr learned my addr 172.21.15.78:0/3089711477 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:35.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf1a2d700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 0x7f8bec151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 -- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 msgr2=0x7f8bec151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bec0ca930 0x7f8bec151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 -- 172.21.15.78:0/3089711477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bec0ccee0 msgr2=0x7f8bec15bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:35.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bec0ccee0 0x7f8bec15bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009a70 con 0x7f8bec15c4d0 2023-06-09T20:19:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf222e700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bec15c4d0 0x7f8bec0c27a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8be400b370 tx=0x7f8be4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40098f0 con 0x7f8bec15c4d0 2023-06-09T20:19:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be401f070 con 0x7f8bec15c4d0 2023-06-09T20:19:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4003c60 con 0x7f8bec15c4d0 2023-06-09T20:19:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.833+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec06b2e0 con 0x7f8bec15c4d0 2023-06-09T20:19:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.837+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec06b000 con 0x7f8bec15c4d0 2023-06-09T20:19:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.837+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bec06a0b0 con 0x7f8bec15c4d0 2023-06-09T20:19:35.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.837+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8be4004030 con 0x7f8bec15c4d0 2023-06-09T20:19:35.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8be27fc700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bd00662f0 0x7f8bd00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8be4085160 con 0x7f8bec15c4d0 2023-06-09T20:19:35.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8be27fc700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f8bd006c760 0x7f8bd006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:35.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bd006f220 con 0x7f8bd006c760 2023-06-09T20:19:35.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8be4087740 con 0x7f8bec15c4d0 2023-06-09T20:19:35.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8bf1a2d700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bd00662f0 0x7f8bd00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8bf122c700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f8bd006c760 0x7f8bd006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8bf1a2d700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bd00662f0 0x7f8bd00687a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8be8007fd0 tx=0x7f8be8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:35.841+0000 7f8bf122c700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f8bd006c760 0x7f8bd006eb70 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:40.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:40.841+0000 7f8be2ffd700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=43}) v3 -- 0x7f8bcc003580 con 0x7f8bec15c4d0 2023-06-09T20:19:40.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:40.841+0000 7f8be2ffd700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] -- ping magic: 0 v1 -- 0x7f8bcc003910 con 0x7f8bd006c760 2023-06-09T20:19:42.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.413+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== osd.4 v2:172.21.15.187:6809/225897659 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8bd006f220 con 0x7f8bd006c760 2023-06-09T20:19:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.433+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 --> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8bec06d140 con 0x7f8bd006c760 2023-06-09T20:19:42.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8be27fc700 1 -- 172.21.15.78:0/3089711477 <== osd.4 v2:172.21.15.187:6809/225897659 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8bec06d140 con 0x7f8bd006c760 2023-06-09T20:19:42.521 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:42.521 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:42.521 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f8bd006c760 msgr2=0x7f8bd006eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6809/225897659,v1:172.21.15.187:6812/225897659] conn(0x7f8bd006c760 0x7f8bd006eb70 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bd00662f0 msgr2=0x7f8bd00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bd00662f0 0x7f8bd00687a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8be8007fd0 tx=0x7f8be8007de0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bec15c4d0 msgr2=0x7f8bec0c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 --2- 172.21.15.78:0/3089711477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bec15c4d0 0x7f8bec0c27a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8be400b370 tx=0x7f8be4004af0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf222e700 1 -- 172.21.15.78:0/3089711477 reap_dead start 2023-06-09T20:19:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 shutdown_connections 2023-06-09T20:19:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 >> 172.21.15.78:0/3089711477 conn(0x7f8bec0cf860 msgr2=0x7f8bec0b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 shutdown_connections 2023-06-09T20:19:42.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.517+0000 7f8bf3c91700 1 -- 172.21.15.78:0/3089711477 wait complete. 2023-06-09T20:19:42.548 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-06-09T20:19:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.725+0000 7ffbd60a7700 1 Processor -- start 2023-06-09T20:19:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.725+0000 7ffbd60a7700 1 -- start start 2023-06-09T20:19:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbd60a7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffbd015cf40 0x7ffbd015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbd60a7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd01664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbd60a7700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd006fc20 con 0x7ffbd015d850 2023-06-09T20:19:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbd60a7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd006f920 con 0x7ffbd015cf40 2023-06-09T20:19:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbd60a7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00ce570 con 0x7ffbd00ce130 2023-06-09T20:19:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbcf7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffbd015cf40 0x7ffbd015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbceffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ffbd015d850 0x7ffbd00cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:46662/0 (socket says 172.21.15.78:46662) 2023-06-09T20:19:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbceffd700 1 -- 172.21.15.78:0/4078158085 learned_addr learned my addr 172.21.15.78:0/4078158085 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbcffff700 1 --2- 172.21.15.78:0/4078158085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd01664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbce7fc700 1 -- 172.21.15.78:0/4078158085 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154448700 0 0) 0x7ffbd006fc20 con 0x7ffbd015d850 2023-06-09T20:19:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbcf7fe700 1 -- 172.21.15.78:0/4078158085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 msgr2=0x7ffbd01664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbcf7fe700 1 --2- 172.21.15.78:0/4078158085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd01664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbcf7fe700 1 -- 172.21.15.78:0/4078158085 >> v1:172.21.15.187:6789/0 conn(0x7ffbd015d850 legacy=0x7ffbd00cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbcf7fe700 1 -- 172.21.15.78:0/4078158085 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00c7f70 con 0x7ffbd015cf40 2023-06-09T20:19:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbcf7fe700 1 --2- 172.21.15.78:0/4078158085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 0x7ffbd015d310 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009850 tx=0x7ffbc0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29185bc558010365 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:42.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbce7fc700 1 -- 172.21.15.78:0/4078158085 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0011830 con 0x7ffbd015cf40 2023-06-09T20:19:42.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbce7fc700 1 -- 172.21.15.78:0/4078158085 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0011990 con 0x7ffbd015cf40 2023-06-09T20:19:42.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbce7fc700 1 -- 172.21.15.78:0/4078158085 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0011d40 con 0x7ffbd015cf40 2023-06-09T20:19:42.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbd60a7700 1 -- 172.21.15.78:0/4078158085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 msgr2=0x7ffbd015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.729+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/4078158085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 0x7ffbd015d310 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009850 tx=0x7ffbc0009b60 comp rx=0 tx=0).stop 2023-06-09T20:19:42.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- 172.21.15.78:0/4078158085 shutdown_connections 2023-06-09T20:19:42.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/4078158085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd01664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/4078158085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 0x7ffbd015d310 unknown :-1 s=CLOSED pgs=3285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- 172.21.15.78:0/4078158085 >> 172.21.15.78:0/4078158085 conn(0x7ffbd00cfb70 msgr2=0x7ffbd00cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:42.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- 172.21.15.78:0/4078158085 shutdown_connections 2023-06-09T20:19:42.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- 172.21.15.78:0/4078158085 wait complete. 2023-06-09T20:19:42.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 Processor -- start 2023-06-09T20:19:42.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- start start 2023-06-09T20:19:42.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd0144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 0x7ffbd00b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd015d850 0x7ffbd00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00cc420 con 0x7ffbd015cf40 2023-06-09T20:19:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00cb830 con 0x7ffbd015d850 2023-06-09T20:19:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.733+0000 7ffbd60a7700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00cba80 con 0x7ffbd00ce130 2023-06-09T20:19:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd015d850 0x7ffbd00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd015d850 0x7ffbd00cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:33350/0 (socket says 172.21.15.78:33350) 2023-06-09T20:19:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 -- 172.21.15.78:0/3723440570 learned_addr learned my addr 172.21.15.78:0/3723440570 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcf7fe700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd0144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbceffd700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 0x7ffbd00b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:42.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 -- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 msgr2=0x7ffbd0144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd0144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 -- 172.21.15.78:0/3723440570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 msgr2=0x7ffbd00b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 0x7ffbd00b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 -- 172.21.15.78:0/3723440570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00094b0 con 0x7ffbd015d850 2023-06-09T20:19:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbcffff700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd015d850 0x7ffbd00cc840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800efc0 tx=0x7ffbc800c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:42.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbb7fff700 1 -- 172.21.15.78:0/3723440570 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800cb80 con 0x7ffbd015d850 2023-06-09T20:19:42.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbb7fff700 1 -- 172.21.15.78:0/3723440570 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800f040 con 0x7ffbd015d850 2023-06-09T20:19:42.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd00ceaf0 con 0x7ffbd015d850 2023-06-09T20:19:42.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbb7fff700 1 -- 172.21.15.78:0/3723440570 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8014480 con 0x7ffbd015d850 2023-06-09T20:19:42.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd00ce810 con 0x7ffbd015d850 2023-06-09T20:19:42.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.737+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd015dcc0 con 0x7ffbd015d850 2023-06-09T20:19:42.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.741+0000 7ffbb7fff700 1 -- 172.21.15.78:0/3723440570 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffbc803b020 con 0x7ffbd015d850 2023-06-09T20:19:42.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.741+0000 7ffbb7fff700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffbbc066320 0x7ffbbc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:42.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.741+0000 7ffbb7fff700 1 -- 172.21.15.78:0/3723440570 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ffbc8084750 con 0x7ffbd015d850 2023-06-09T20:19:42.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.741+0000 7ffbcf7fe700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffbbc066320 0x7ffbbc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:42.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.749+0000 7ffbb7fff700 1 -- 172.21.15.78:0/3723440570 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffbc8051ee0 con 0x7ffbd015d850 2023-06-09T20:19:42.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.781+0000 7ffbcf7fe700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffbbc066320 0x7ffbbc0687d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00090b0 tx=0x7ffbc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:42.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.925+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbd00cc560 con 0x7ffbbc066320 2023-06-09T20:19:42.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.925+0000 7ffbb7fff700 1 -- 172.21.15.78:0/3723440570 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffbd00cc560 con 0x7ffbbc066320 2023-06-09T20:19:42.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffbbc066320 msgr2=0x7ffbbc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffbbc066320 0x7ffbbc0687d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00090b0 tx=0x7ffbc0008030 comp rx=0 tx=0).stop 2023-06-09T20:19:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd015d850 msgr2=0x7ffbd00cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd015d850 0x7ffbd00cc840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800efc0 tx=0x7ffbc800c0c0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 shutdown_connections 2023-06-09T20:19:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ffbbc066320 0x7ffbbc0687d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbd015d850 0x7ffbd00cc840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbd015cf40 0x7ffbd00b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 --2- 172.21.15.78:0/3723440570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffbd00ce130 0x7ffbd0144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 >> 172.21.15.78:0/3723440570 conn(0x7ffbd00cfb70 msgr2=0x7ffbd015ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 shutdown_connections 2023-06-09T20:19:42.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:42.929+0000 7ffbd60a7700 1 -- 172.21.15.78:0/3723440570 wait complete. 2023-06-09T20:19:42.940 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2023-06-09T20:19:42.958 INFO:tasks.ceph:Scrubbing osd.5 2023-06-09T20:19:42.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:43.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.129+0000 7f649899a700 1 Processor -- start 2023-06-09T20:19:43.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.129+0000 7f649899a700 1 -- start start 2023-06-09T20:19:43.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6494146b70 0x7f64940b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:43.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494146f40 0x7f6494164610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:43.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6494164fb0 con 0x7f6494164b50 2023-06-09T20:19:43.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649406a350 con 0x7f6494146b70 2023-06-09T20:19:43.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940b1a80 con 0x7f6494146f40 2023-06-09T20:19:43.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6493fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6494164b50 0x7f649406d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57510/0 (socket says 172.21.15.78:57510) 2023-06-09T20:19:43.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6493fff700 1 -- 172.21.15.78:0/315416918 learned_addr learned my addr 172.21.15.78:0/315416918 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:43.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f64937fe700 1 --2- 172.21.15.78:0/315416918 >> v2:172.21.15.78:3300/0 conn(0x7f6494146b70 0x7f64940b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:43.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6492ffd700 1 --2- 172.21.15.78:0/315416918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494146f40 0x7f6494164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:43.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6492ffd700 1 -- 172.21.15.78:0/315416918 >> v2:172.21.15.78:3300/0 conn(0x7f6494146b70 msgr2=0x7f64940b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:43.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6492ffd700 1 --2- 172.21.15.78:0/315416918 >> v2:172.21.15.78:3300/0 conn(0x7f6494146b70 0x7f64940b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:43.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f64927fc700 1 -- 172.21.15.78:0/315416918 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266186301 0 0) 0x7f6494164fb0 con 0x7f6494164b50 2023-06-09T20:19:43.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6492ffd700 1 -- 172.21.15.78:0/315416918 >> v1:172.21.15.78:6789/0 conn(0x7f6494164b50 legacy=0x7f649406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:43.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6492ffd700 1 -- 172.21.15.78:0/315416918 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940b2250 con 0x7f6494146f40 2023-06-09T20:19:43.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f6492ffd700 1 --2- 172.21.15.78:0/315416918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494146f40 0x7f6494164610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64940b1bc0 tx=0x7f6488009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1437bc48dd761e7e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f64927fc700 1 -- 172.21.15.78:0/315416918 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488004020 con 0x7f6494146f40 2023-06-09T20:19:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f64927fc700 1 -- 172.21.15.78:0/315416918 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6488004180 con 0x7f6494146f40 2023-06-09T20:19:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f64927fc700 1 -- 172.21.15.78:0/315416918 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488004530 con 0x7f6494146f40 2023-06-09T20:19:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 -- 172.21.15.78:0/315416918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494146f40 msgr2=0x7f6494164610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 --2- 172.21.15.78:0/315416918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494146f40 0x7f6494164610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64940b1bc0 tx=0x7f6488009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 -- 172.21.15.78:0/315416918 shutdown_connections 2023-06-09T20:19:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 --2- 172.21.15.78:0/315416918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494146f40 0x7f6494164610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 --2- 172.21.15.78:0/315416918 >> v2:172.21.15.78:3300/0 conn(0x7f6494146b70 0x7f64940b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.133+0000 7f649899a700 1 -- 172.21.15.78:0/315416918 >> 172.21.15.78:0/315416918 conn(0x7f64940b0780 msgr2=0x7f64940b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.137+0000 7f649899a700 1 -- 172.21.15.78:0/315416918 shutdown_connections 2023-06-09T20:19:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.137+0000 7f649899a700 1 -- 172.21.15.78:0/315416918 wait complete. 2023-06-09T20:19:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.137+0000 7f649899a700 1 Processor -- start 2023-06-09T20:19:43.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.137+0000 7f649899a700 1 -- start start 2023-06-09T20:19:43.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494146b70 0x7f6494145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:43.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6494146f40 0x7f64941f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:43.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494164b50 0x7f64940aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:43.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6494145c80 con 0x7f6494146f40 2023-06-09T20:19:43.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940a91a0 con 0x7f6494146b70 2023-06-09T20:19:43.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6494161660 con 0x7f6494164b50 2023-06-09T20:19:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6494146f40 0x7f64941f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6494146f40 0x7f64941f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33592/0 (socket says 172.21.15.78:33592) 2023-06-09T20:19:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 -- 172.21.15.78:0/3617089200 learned_addr learned my addr 172.21.15.78:0/3617089200 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:43.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6493fff700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494164b50 0x7f64940aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f64937fe700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494146b70 0x7f6494145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 -- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494164b50 msgr2=0x7f64940aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6494164b50 0x7f64940aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 -- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494146b70 msgr2=0x7f6494145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494146b70 0x7f6494145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 -- 172.21.15.78:0/3617089200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880094b0 con 0x7f6494146f40 2023-06-09T20:19:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f64937fe700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494146b70 0x7f6494145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T20:19:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f6492ffd700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6494146f40 0x7f64941f6630 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f64880090b0 tx=0x7f6488004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488011ca0 con 0x7f6494146f40 2023-06-09T20:19:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6488011e00 con 0x7f6494146f40 2023-06-09T20:19:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64940b1f70 con 0x7f6494146f40 2023-06-09T20:19:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488003900 con 0x7f6494146f40 2023-06-09T20:19:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.141+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64940b1c90 con 0x7f6494146f40 2023-06-09T20:19:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.145+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6494069f70 con 0x7f6494146f40 2023-06-09T20:19:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.145+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6488003a60 con 0x7f6494146f40 2023-06-09T20:19:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f647bfff700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f64800662f0 0x7f64800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6488084bc0 con 0x7f6494146f40 2023-06-09T20:19:43.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f647bfff700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f648006c760 0x7f648006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:43.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 --> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f648006f220 con 0x7f648006c760 2023-06-09T20:19:43.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64880892a0 con 0x7f6494146f40 2023-06-09T20:19:43.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f64937fe700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f64800662f0 0x7f64800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:43.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f6493fff700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f648006c760 0x7f648006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:43.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f64937fe700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f64800662f0 0x7f64800687a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f6484009c40 tx=0x7f6484008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:43.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:43.149+0000 7f6493fff700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f648006c760 0x7f648006eb70 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:46.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:19:46.348 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:19:47.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.757+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== osd.5 v2:172.21.15.187:6824/3523281429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f648006f220 con 0x7f648006c760 2023-06-09T20:19:47.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.777+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 --> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64940741c0 con 0x7f648006c760 2023-06-09T20:19:47.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f647bfff700 1 -- 172.21.15.78:0/3617089200 <== osd.5 v2:172.21.15.187:6824/3523281429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f64940741c0 con 0x7f648006c760 2023-06-09T20:19:47.811 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:47.812 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:47.812 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:47.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f648006c760 msgr2=0x7f648006eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:47.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6824/3523281429,v1:172.21.15.187:6825/3523281429] conn(0x7f648006c760 0x7f648006eb70 crc :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:47.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f64800662f0 msgr2=0x7f64800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:47.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f64800662f0 0x7f64800687a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f6484009c40 tx=0x7f6484008040 comp rx=0 tx=0).stop 2023-06-09T20:19:47.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6494146f40 msgr2=0x7f64941f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:47.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 --2- 172.21.15.78:0/3617089200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6494146f40 0x7f64941f6630 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7f64880090b0 tx=0x7f6488004770 comp rx=0 tx=0).stop 2023-06-09T20:19:47.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f6493fff700 1 -- 172.21.15.78:0/3617089200 reap_dead start 2023-06-09T20:19:47.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 shutdown_connections 2023-06-09T20:19:47.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 >> 172.21.15.78:0/3617089200 conn(0x7f64940b0780 msgr2=0x7f64941481f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:47.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 shutdown_connections 2023-06-09T20:19:47.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:47.805+0000 7f649899a700 1 -- 172.21.15.78:0/3617089200 wait complete. 2023-06-09T20:19:47.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-06-09T20:19:48.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7c293e700 1 Processor -- start 2023-06-09T20:19:48.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7c293e700 1 -- start start 2023-06-09T20:19:48.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7c293e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7bc160c20 0x7fe7bc165160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7c293e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc0cc810 con 0x7fe7bc0c1ce0 2023-06-09T20:19:48.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7c293e700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc160ff0 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7c293e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc0cca60 con 0x7fe7bc160c20 2023-06-09T20:19:48.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7bbfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7bc160c20 0x7fe7bc165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7b37fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe7bc0c1ce0 0x7fe7bc06d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39370/0 (socket says 172.21.15.78:39370) 2023-06-09T20:19:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7bbfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7bc160c20 0x7fe7bc165160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37086/0 (socket says 172.21.15.78:37086) 2023-06-09T20:19:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7bbfff700 1 -- 172.21.15.78:0/945413643 learned_addr learned my addr 172.21.15.78:0/945413643 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.013+0000 7fe7c0edb700 1 --1- 172.21.15.78:0/945413643 >> v1:172.21.15.187:6789/0 conn(0x7fe7bc06dfe0 0x7fe7bc06fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:59266/0 (socket says 172.21.15.78:59266) 2023-06-09T20:19:48.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bb7fe700 1 -- 172.21.15.78:0/945413643 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170004990 0 0) 0x7fe7bc160ff0 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bbfff700 1 -- 172.21.15.78:0/945413643 >> v1:172.21.15.187:6789/0 conn(0x7fe7bc06dfe0 legacy=0x7fe7bc06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bbfff700 1 -- 172.21.15.78:0/945413643 >> v1:172.21.15.78:6789/0 conn(0x7fe7bc0c1ce0 legacy=0x7fe7bc06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bbfff700 1 -- 172.21.15.78:0/945413643 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0ccd40 con 0x7fe7bc160c20 2023-06-09T20:19:48.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bbfff700 1 --2- 172.21.15.78:0/945413643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc165160 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009e80 tx=0x7fe7ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e61473fefc9be3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:48.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bb7fe700 1 -- 172.21.15.78:0/945413643 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00e070 con 0x7fe7bc160c20 2023-06-09T20:19:48.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bb7fe700 1 -- 172.21.15.78:0/945413643 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00b980 con 0x7fe7bc160c20 2023-06-09T20:19:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7bb7fe700 1 -- 172.21.15.78:0/945413643 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00bd30 con 0x7fe7bc160c20 2023-06-09T20:19:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7c293e700 1 -- 172.21.15.78:0/945413643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 msgr2=0x7fe7bc165160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7c293e700 1 --2- 172.21.15.78:0/945413643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc165160 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009e80 tx=0x7fe7ac00b330 comp rx=0 tx=0).stop 2023-06-09T20:19:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7c293e700 1 -- 172.21.15.78:0/945413643 shutdown_connections 2023-06-09T20:19:48.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7c293e700 1 --2- 172.21.15.78:0/945413643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc165160 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7c293e700 1 -- 172.21.15.78:0/945413643 >> 172.21.15.78:0/945413643 conn(0x7fe7bc0b1480 msgr2=0x7fe7bc0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7c293e700 1 -- 172.21.15.78:0/945413643 shutdown_connections 2023-06-09T20:19:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.017+0000 7fe7c293e700 1 -- 172.21.15.78:0/945413643 wait complete. 2023-06-09T20:19:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.021+0000 7fe7c293e700 1 Processor -- start 2023-06-09T20:19:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.021+0000 7fe7c293e700 1 -- start start 2023-06-09T20:19:48.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc06dfe0 0x7fe7bc0c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7bc0c1ce0 0x7fe7bc0c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0c30c0 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0c33a0 con 0x7fe7bc160c20 2023-06-09T20:19:48.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0c3680 con 0x7fe7bc0c1ce0 2023-06-09T20:19:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc06dfe0 0x7fe7bc0c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc06dfe0 0x7fe7bc0c2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48442/0 (socket says 172.21.15.78:48442) 2023-06-09T20:19:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 -- 172.21.15.78:0/80225405 learned_addr learned my addr 172.21.15.78:0/80225405 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7b37fe700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7bc0c1ce0 0x7fe7bc0c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c0edb700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 -- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7bc0c1ce0 msgr2=0x7fe7bc0c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7bc0c1ce0 0x7fe7bc0c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 -- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 msgr2=0x7fe7bc1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 -- 172.21.15.78:0/80225405 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009b30 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c0edb700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T20:19:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7bbfff700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc06dfe0 0x7fe7bc0c2770 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac000f80 tx=0x7fe7ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7b97fa700 1 -- 172.21.15.78:0/80225405 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac01c640 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7b97fa700 1 -- 172.21.15.78:0/80225405 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac01c7a0 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc0cd300 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7b97fa700 1 -- 172.21.15.78:0/80225405 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac01cb50 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.025+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc0cd020 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.029+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc06eaa0 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.029+0000 7fe7b97fa700 1 -- 172.21.15.78:0/80225405 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7ac01ccb0 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.033+0000 7fe7b97fa700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7a00662f0 0x7fe7a00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.033+0000 7fe7b97fa700 1 -- 172.21.15.78:0/80225405 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe7ac0854b0 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.033+0000 7fe7b37fe700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7a00662f0 0x7fe7a00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.033+0000 7fe7b37fe700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7a00662f0 0x7fe7a00687a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc158eb0 tx=0x7fe7a4007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.037+0000 7fe7b97fa700 1 -- 172.21.15.78:0/80225405 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe7ac052c40 con 0x7fe7bc06dfe0 2023-06-09T20:19:48.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.205+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7bc0741c0 con 0x7fe7a00662f0 2023-06-09T20:19:48.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7b97fa700 1 -- 172.21.15.78:0/80225405 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7bc0741c0 con 0x7fe7a00662f0 2023-06-09T20:19:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7a00662f0 msgr2=0x7fe7a00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7a00662f0 0x7fe7a00687a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc158eb0 tx=0x7fe7a4007ef0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc06dfe0 msgr2=0x7fe7bc0c2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc06dfe0 0x7fe7bc0c2770 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac000f80 tx=0x7fe7ac004af0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 shutdown_connections 2023-06-09T20:19:48.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7a00662f0 0x7fe7a00687a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7bc160c20 0x7fe7bc1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7bc0c1ce0 0x7fe7bc0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 --2- 172.21.15.78:0/80225405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7bc06dfe0 0x7fe7bc0c2770 unknown :-1 s=CLOSED pgs=3289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 >> 172.21.15.78:0/80225405 conn(0x7fe7bc0b1480 msgr2=0x7fe7bc0b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:48.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 shutdown_connections 2023-06-09T20:19:48.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.225+0000 7fe7c293e700 1 -- 172.21.15.78:0/80225405 wait complete. 2023-06-09T20:19:48.236 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2023-06-09T20:19:48.257 INFO:tasks.ceph:Scrubbing osd.6 2023-06-09T20:19:48.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:48.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.421+0000 7f29b0ae4700 1 Processor -- start 2023-06-09T20:19:48.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.421+0000 7f29b0ae4700 1 -- start start 2023-06-09T20:19:48.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29b0ae4700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f29ac1597c0 0x7f29ac159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29b0ae4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29ac06ae70 0x7f29ac0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29b0ae4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac06d690 con 0x7f29ac0b2680 2023-06-09T20:19:48.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29b0ae4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac0b31b0 con 0x7f29ac06ae70 2023-06-09T20:19:48.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29b0ae4700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac06d8e0 con 0x7f29ac1597c0 2023-06-09T20:19:48.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29a2ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f29ac0b2680 0x7f29ac06a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39382/0 (socket says 172.21.15.78:39382) 2023-06-09T20:19:48.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29a2ffd700 1 -- 172.21.15.78:0/2738712689 learned_addr learned my addr 172.21.15.78:0/2738712689 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:48.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29ab7fe700 1 --2- 172.21.15.78:0/2738712689 >> v2:172.21.15.187:3300/0 conn(0x7f29ac1597c0 0x7f29ac159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29abfff700 1 --2- 172.21.15.78:0/2738712689 >> v2:172.21.15.78:3300/0 conn(0x7f29ac06ae70 0x7f29ac0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29aaffd700 1 -- 172.21.15.78:0/2738712689 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253126255 0 0) 0x7f29ac06d690 con 0x7f29ac0b2680 2023-06-09T20:19:48.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.425+0000 7f29aaffd700 1 -- 172.21.15.78:0/2738712689 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29980057e0 con 0x7f29ac0b2680 2023-06-09T20:19:48.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29abfff700 1 -- 172.21.15.78:0/2738712689 >> v2:172.21.15.187:3300/0 conn(0x7f29ac1597c0 msgr2=0x7f29ac159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:48.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29abfff700 1 --2- 172.21.15.78:0/2738712689 >> v2:172.21.15.187:3300/0 conn(0x7f29ac1597c0 0x7f29ac159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29abfff700 1 -- 172.21.15.78:0/2738712689 >> v1:172.21.15.78:6789/0 conn(0x7f29ac0b2680 legacy=0x7f29ac06a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29abfff700 1 -- 172.21.15.78:0/2738712689 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac06dbc0 con 0x7f29ac06ae70 2023-06-09T20:19:48.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29ab7fe700 1 --2- 172.21.15.78:0/2738712689 >> v2:172.21.15.187:3300/0 conn(0x7f29ac1597c0 0x7f29ac159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:48.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29abfff700 1 --2- 172.21.15.78:0/2738712689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac0b2ac0 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0700f0 tx=0x7f29a4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1641110e3a89b22c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:48.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29aaffd700 1 -- 172.21.15.78:0/2738712689 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4011830 con 0x7f29ac06ae70 2023-06-09T20:19:48.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29aaffd700 1 -- 172.21.15.78:0/2738712689 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4011990 con 0x7f29ac06ae70 2023-06-09T20:19:48.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29aaffd700 1 -- 172.21.15.78:0/2738712689 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4011d20 con 0x7f29ac06ae70 2023-06-09T20:19:48.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 -- 172.21.15.78:0/2738712689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 msgr2=0x7f29ac0b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 --2- 172.21.15.78:0/2738712689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac0b2ac0 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0700f0 tx=0x7f29a4009b30 comp rx=0 tx=0).stop 2023-06-09T20:19:48.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 -- 172.21.15.78:0/2738712689 shutdown_connections 2023-06-09T20:19:48.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 --2- 172.21.15.78:0/2738712689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac0b2ac0 unknown :-1 s=CLOSED pgs=3291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 --2- 172.21.15.78:0/2738712689 >> v2:172.21.15.187:3300/0 conn(0x7f29ac1597c0 0x7f29ac159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 -- 172.21.15.78:0/2738712689 >> 172.21.15.78:0/2738712689 conn(0x7f29ac0b0780 msgr2=0x7f29ac0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:48.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 -- 172.21.15.78:0/2738712689 shutdown_connections 2023-06-09T20:19:48.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.429+0000 7f29b0ae4700 1 -- 172.21.15.78:0/2738712689 wait complete. 2023-06-09T20:19:48.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 Processor -- start 2023-06-09T20:19:48.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 -- start start 2023-06-09T20:19:48.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0b2680 0x7f29ac15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac1597c0 0x7f29ac15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac1edb10 con 0x7f29ac06ae70 2023-06-09T20:19:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac1eddf0 con 0x7f29ac0b2680 2023-06-09T20:19:48.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29b0ae4700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac1ee0d0 con 0x7f29ac1597c0 2023-06-09T20:19:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac147e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48466/0 (socket says 172.21.15.78:48466) 2023-06-09T20:19:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 -- 172.21.15.78:0/510755159 learned_addr learned my addr 172.21.15.78:0/510755159 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29a2ffd700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0b2680 0x7f29ac15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29abfff700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac1597c0 0x7f29ac15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 -- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac1597c0 msgr2=0x7f29ac15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac1597c0 0x7f29ac15c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 -- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0b2680 msgr2=0x7f29ac15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0b2680 0x7f29ac15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:48.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.433+0000 7f29ab7fe700 1 -- 172.21.15.78:0/510755159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0094b0 con 0x7f29ac06ae70 2023-06-09T20:19:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.437+0000 7f29ab7fe700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac147e90 secure :-1 s=READY pgs=3292 cs=0 l=1 rev1=1 crypto rx=0x7f299c00ebe0 tx=0x7f299c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:48.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.437+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00c8b0 con 0x7f29ac06ae70 2023-06-09T20:19:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.437+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c00ca10 con 0x7f29ac06ae70 2023-06-09T20:19:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.437+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a40094b0 con 0x7f29ac06ae70 2023-06-09T20:19:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.437+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00cda0 con 0x7f29ac06ae70 2023-06-09T20:19:48.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.437+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac06e3c0 con 0x7f29ac06ae70 2023-06-09T20:19:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.437+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29ac06dea0 con 0x7f29ac06ae70 2023-06-09T20:19:48.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f299c013470 con 0x7f29ac06ae70 2023-06-09T20:19:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29a8ff9700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f298c0662f0 0x7f298c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f299c084000 con 0x7f29ac06ae70 2023-06-09T20:19:48.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29a2ffd700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f298c0662f0 0x7f298c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29a8ff9700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f298c06c760 0x7f298c06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:48.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 --> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f298c06f220 con 0x7f298c06c760 2023-06-09T20:19:48.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f299c084370 con 0x7f29ac06ae70 2023-06-09T20:19:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.441+0000 7f29abfff700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f298c06c760 0x7f298c06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.445+0000 7f29a2ffd700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f298c0662f0 0x7f298c0687a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f29ac1f0f50 tx=0x7f2994009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:48.445+0000 7f29abfff700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f298c06c760 0x7f298c06eb70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.005+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== osd.6 v2:172.21.15.187:6800/2841984916 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f298c06f220 con 0x7f298c06c760 2023-06-09T20:19:49.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.025+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 --> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f29ac069ed0 con 0x7f298c06c760 2023-06-09T20:19:49.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.089+0000 7f29a8ff9700 1 -- 172.21.15.78:0/510755159 <== osd.6 v2:172.21.15.187:6800/2841984916 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f29ac069ed0 con 0x7f298c06c760 2023-06-09T20:19:49.099 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:49.099 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:49.100 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:49.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f298c06c760 msgr2=0x7f298c06eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6800/2841984916,v1:172.21.15.187:6801/2841984916] conn(0x7f298c06c760 0x7f298c06eb70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f298c0662f0 msgr2=0x7f298c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f298c0662f0 0x7f298c0687a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f29ac1f0f50 tx=0x7f2994009040 comp rx=0 tx=0).stop 2023-06-09T20:19:49.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 msgr2=0x7f29ac147e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 --2- 172.21.15.78:0/510755159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ac06ae70 0x7f29ac147e90 secure :-1 s=READY pgs=3292 cs=0 l=1 rev1=1 crypto rx=0x7f299c00ebe0 tx=0x7f299c009e30 comp rx=0 tx=0).stop 2023-06-09T20:19:49.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29abfff700 1 -- 172.21.15.78:0/510755159 reap_dead start 2023-06-09T20:19:49.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 shutdown_connections 2023-06-09T20:19:49.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 >> 172.21.15.78:0/510755159 conn(0x7f29ac0b0780 msgr2=0x7f29ac0cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 shutdown_connections 2023-06-09T20:19:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.093+0000 7f29b0ae4700 1 -- 172.21.15.78:0/510755159 wait complete. 2023-06-09T20:19:49.125 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-06-09T20:19:49.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.293+0000 7efead86f700 1 Processor -- start 2023-06-09T20:19:49.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.293+0000 7efead86f700 1 -- start start 2023-06-09T20:19:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead86f700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efea806f2a0 0x7efea80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead86f700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80adb00 con 0x7efea8164c00 2023-06-09T20:19:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead86f700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80ccb10 con 0x7efea8160940 2023-06-09T20:19:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead86f700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea81653a0 con 0x7efea806f2a0 2023-06-09T20:19:49.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efeac86d700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7efea8160940 0x7efea81644f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:59274/0 (socket says 172.21.15.78:59274) 2023-06-09T20:19:49.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efeac86d700 1 -- 172.21.15.78:0/4238034965 learned_addr learned my addr 172.21.15.78:0/4238034965 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:49.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efea7fff700 1 --1- 172.21.15.78:0/4238034965 >> v1:172.21.15.78:6789/0 conn(0x7efea8164c00 0x7efea806dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39398/0 (socket says 172.21.15.78:39398) 2023-06-09T20:19:49.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead06e700 1 --2- 172.21.15.78:0/4238034965 >> v2:172.21.15.187:3300/0 conn(0x7efea806f2a0 0x7efea80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efea77fe700 1 -- 172.21.15.78:0/4238034965 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195573564 0 0) 0x7efea80adb00 con 0x7efea8164c00 2023-06-09T20:19:49.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efea77fe700 1 -- 172.21.15.78:0/4238034965 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe980035d0 con 0x7efea8164c00 2023-06-09T20:19:49.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efea77fe700 1 -- 172.21.15.78:0/4238034965 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911671659 0 0) 0x7efea80ccb10 con 0x7efea8160940 2023-06-09T20:19:49.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efea77fe700 1 -- 172.21.15.78:0/4238034965 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea80adb00 con 0x7efea8160940 2023-06-09T20:19:49.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead06e700 1 -- 172.21.15.78:0/4238034965 >> v1:172.21.15.187:6789/0 conn(0x7efea8160940 legacy=0x7efea81644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead06e700 1 -- 172.21.15.78:0/4238034965 >> v1:172.21.15.78:6789/0 conn(0x7efea8164c00 legacy=0x7efea806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.297+0000 7efead06e700 1 -- 172.21.15.78:0/4238034965 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80add50 con 0x7efea806f2a0 2023-06-09T20:19:49.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead06e700 1 --2- 172.21.15.78:0/4238034965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 0x7efea80ce4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efea0009d90 tx=0x7efea000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb5907af56c7cb8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efea77fe700 1 -- 172.21.15.78:0/4238034965 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea000e070 con 0x7efea806f2a0 2023-06-09T20:19:49.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efea77fe700 1 -- 172.21.15.78:0/4238034965 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea000bb20 con 0x7efea806f2a0 2023-06-09T20:19:49.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efea77fe700 1 -- 172.21.15.78:0/4238034965 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0012430 con 0x7efea806f2a0 2023-06-09T20:19:49.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead86f700 1 -- 172.21.15.78:0/4238034965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 msgr2=0x7efea80ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead86f700 1 --2- 172.21.15.78:0/4238034965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 0x7efea80ce4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efea0009d90 tx=0x7efea000b330 comp rx=0 tx=0).stop 2023-06-09T20:19:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead86f700 1 -- 172.21.15.78:0/4238034965 shutdown_connections 2023-06-09T20:19:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead86f700 1 --2- 172.21.15.78:0/4238034965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 0x7efea80ce4a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead86f700 1 -- 172.21.15.78:0/4238034965 >> 172.21.15.78:0/4238034965 conn(0x7efea80cf670 msgr2=0x7efea80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead86f700 1 -- 172.21.15.78:0/4238034965 shutdown_connections 2023-06-09T20:19:49.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.301+0000 7efead86f700 1 -- 172.21.15.78:0/4238034965 wait complete. 2023-06-09T20:19:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 Processor -- start 2023-06-09T20:19:49.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 -- start start 2023-06-09T20:19:49.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 0x7efea80b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efea8160940 0x7efea8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea8164c00 0x7efea80af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80b29f0 con 0x7efea8164c00 2023-06-09T20:19:49.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea815fcd0 con 0x7efea806f2a0 2023-06-09T20:19:49.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead86f700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea815aa20 con 0x7efea8160940 2023-06-09T20:19:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead06e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea8164c00 0x7efea80af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efeac86d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 0x7efea80b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead06e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea8164c00 0x7efea80af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48476/0 (socket says 172.21.15.78:48476) 2023-06-09T20:19:49.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead06e700 1 -- 172.21.15.78:0/387019682 learned_addr learned my addr 172.21.15.78:0/387019682 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efea7fff700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efea8160940 0x7efea8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.305+0000 7efead06e700 1 -- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efea8160940 msgr2=0x7efea8154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead06e700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efea8160940 0x7efea8154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead06e700 1 -- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 msgr2=0x7efea80b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead06e700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 0x7efea80b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead06e700 1 -- 172.21.15.78:0/387019682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0009a70 con 0x7efea8164c00 2023-06-09T20:19:49.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efea7fff700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efea8160940 0x7efea8154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T20:19:49.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead06e700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea8164c00 0x7efea80af440 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7efea0013000 tx=0x7efea0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efea57fa700 1 -- 172.21.15.78:0/387019682 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea001b810 con 0x7efea8164c00 2023-06-09T20:19:49.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efea57fa700 1 -- 172.21.15.78:0/387019682 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0020070 con 0x7efea8164c00 2023-06-09T20:19:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efea57fa700 1 -- 172.21.15.78:0/387019682 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea001bbb0 con 0x7efea8164c00 2023-06-09T20:19:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea8161d20 con 0x7efea8164c00 2023-06-09T20:19:49.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea81650c0 con 0x7efea8164c00 2023-06-09T20:19:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.309+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea80741c0 con 0x7efea8164c00 2023-06-09T20:19:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.313+0000 7efea57fa700 1 -- 172.21.15.78:0/387019682 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efea001bd10 con 0x7efea8164c00 2023-06-09T20:19:49.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.313+0000 7efea57fa700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efe8c0662f0 0x7efe8c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.313+0000 7efea57fa700 1 -- 172.21.15.78:0/387019682 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efea0022070 con 0x7efea8164c00 2023-06-09T20:19:49.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.313+0000 7efeac86d700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efe8c0662f0 0x7efe8c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.313+0000 7efeac86d700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efe8c0662f0 0x7efe8c0687a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7efe9c007fd0 tx=0x7efe9c007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.317+0000 7efea57fa700 1 -- 172.21.15.78:0/387019682 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efea0053410 con 0x7efea8164c00 2023-06-09T20:19:49.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.489+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7efea815bcf0 con 0x7efe8c0662f0 2023-06-09T20:19:49.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efea57fa700 1 -- 172.21.15.78:0/387019682 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efea815bcf0 con 0x7efe8c0662f0 2023-06-09T20:19:49.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efe8c0662f0 msgr2=0x7efe8c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efe8c0662f0 0x7efe8c0687a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7efe9c007fd0 tx=0x7efe9c007de0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea8164c00 msgr2=0x7efea80af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea8164c00 0x7efea80af440 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7efea0013000 tx=0x7efea0004af0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 shutdown_connections 2023-06-09T20:19:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7efe8c0662f0 0x7efe8c0687a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea8164c00 0x7efea80af440 unknown :-1 s=CLOSED pgs=3294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efea8160940 0x7efea8154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 --2- 172.21.15.78:0/387019682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea806f2a0 0x7efea80b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.493+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 >> 172.21.15.78:0/387019682 conn(0x7efea80cf670 msgr2=0x7efea8065b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:49.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.497+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 shutdown_connections 2023-06-09T20:19:49.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.497+0000 7efead86f700 1 -- 172.21.15.78:0/387019682 wait complete. 2023-06-09T20:19:49.505 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2023-06-09T20:19:49.524 INFO:tasks.ceph:Scrubbing osd.7 2023-06-09T20:19:49.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-06-09T20:19:49.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.693+0000 7fd4bd861700 1 Processor -- start 2023-06-09T20:19:49.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.693+0000 7fd4bd861700 1 -- start start 2023-06-09T20:19:49.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.693+0000 7fd4bd861700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4b80ce0c0 0x7fd4b806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.693+0000 7fd4bd861700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4b80ce540 0x7fd4b806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.693+0000 7fd4bd861700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b806e110 con 0x7fd4b815aa80 2023-06-09T20:19:49.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.693+0000 7fd4bd861700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b806b7b0 con 0x7fd4b80ce540 2023-06-09T20:19:49.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.693+0000 7fd4bd861700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b806efc0 con 0x7fd4b80ce0c0 2023-06-09T20:19:49.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd060700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd4b80ce540 0x7fd4b806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4b80ce0c0 0x7fd4b806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4b80ce0c0 0x7fd4b806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37142/0 (socket says 172.21.15.78:37142) 2023-06-09T20:19:49.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bc85f700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd4b815aa80 0x7fd4b806b0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:59288/0 (socket says 172.21.15.78:59288) 2023-06-09T20:19:49.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 -- 172.21.15.78:0/1067292716 learned_addr learned my addr 172.21.15.78:0/1067292716 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:49.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 -- 172.21.15.78:0/1067292716 >> v2:172.21.15.78:3300/0 conn(0x7fd4b80ce540 msgr2=0x7fd4b806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:49.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 --2- 172.21.15.78:0/1067292716 >> v2:172.21.15.78:3300/0 conn(0x7fd4b80ce540 0x7fd4b806dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 -- 172.21.15.78:0/1067292716 >> v1:172.21.15.187:6789/0 conn(0x7fd4b815aa80 legacy=0x7fd4b806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 -- 172.21.15.78:0/1067292716 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b806a000 con 0x7fd4b80ce0c0 2023-06-09T20:19:49.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b7fff700 1 --2- 172.21.15.78:0/1067292716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b80ce0c0 0x7fd4b806d690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80b1b10 tx=0x7fd4a4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f64d08561d8c39a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b77fe700 1 -- 172.21.15.78:0/1067292716 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4011830 con 0x7fd4b80ce0c0 2023-06-09T20:19:49.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b77fe700 1 -- 172.21.15.78:0/1067292716 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a4011990 con 0x7fd4b80ce0c0 2023-06-09T20:19:49.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4b77fe700 1 -- 172.21.15.78:0/1067292716 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4011d20 con 0x7fd4b80ce0c0 2023-06-09T20:19:49.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 -- 172.21.15.78:0/1067292716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b80ce0c0 msgr2=0x7fd4b806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 --2- 172.21.15.78:0/1067292716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b80ce0c0 0x7fd4b806d690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80b1b10 tx=0x7fd4a4009bf0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 -- 172.21.15.78:0/1067292716 shutdown_connections 2023-06-09T20:19:49.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 --2- 172.21.15.78:0/1067292716 >> v2:172.21.15.78:3300/0 conn(0x7fd4b80ce540 0x7fd4b806dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 --2- 172.21.15.78:0/1067292716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b80ce0c0 0x7fd4b806d690 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 -- 172.21.15.78:0/1067292716 >> 172.21.15.78:0/1067292716 conn(0x7fd4b80b0780 msgr2=0x7fd4b80b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:49.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 -- 172.21.15.78:0/1067292716 shutdown_connections 2023-06-09T20:19:49.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.697+0000 7fd4bd861700 1 -- 172.21.15.78:0/1067292716 wait complete. 2023-06-09T20:19:49.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 Processor -- start 2023-06-09T20:19:49.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 -- start start 2023-06-09T20:19:49.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b80ce0c0 0x7fd4b814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b80ce540 0x7fd4b81f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b815aa80 0x7fd4b80ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815c8d0 con 0x7fd4b80ce540 2023-06-09T20:19:49.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b814bb30 con 0x7fd4b815aa80 2023-06-09T20:19:49.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd861700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815bc50 con 0x7fd4b80ce0c0 2023-06-09T20:19:49.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bc85f700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b80ce0c0 0x7fd4b814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd060700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b815aa80 0x7fd4b80ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd060700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b815aa80 0x7fd4b80ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:37156/0 (socket says 172.21.15.78:37156) 2023-06-09T20:19:49.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4bd060700 1 -- 172.21.15.78:0/2133608485 learned_addr learned my addr 172.21.15.78:0/2133608485 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:49.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.701+0000 7fd4b7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b80ce540 0x7fd4b81f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd060700 1 -- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b80ce0c0 msgr2=0x7fd4b814b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd060700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b80ce0c0 0x7fd4b814b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd060700 1 -- 172.21.15.78:0/2133608485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b80ce540 msgr2=0x7fd4b81f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd060700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b80ce540 0x7fd4b81f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd060700 1 -- 172.21.15.78:0/2133608485 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009570 con 0x7fd4b815aa80 2023-06-09T20:19:49.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd060700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b815aa80 0x7fd4b80ac910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009dd0 tx=0x7fd4b000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0009c40 con 0x7fd4b815aa80 2023-06-09T20:19:49.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b000f040 con 0x7fd4b815aa80 2023-06-09T20:19:49.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b806a5c0 con 0x7fd4b815aa80 2023-06-09T20:19:49.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000ceb0 con 0x7fd4b815aa80 2023-06-09T20:19:49.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b806a2e0 con 0x7fd4b815aa80 2023-06-09T20:19:49.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.705+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4b806a8a0 con 0x7fd4b815aa80 2023-06-09T20:19:49.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4b0014480 con 0x7fd4b815aa80 2023-06-09T20:19:49.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b57fa700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd49c0662f0 0x7fd49c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd4b0084220 con 0x7fd4b815aa80 2023-06-09T20:19:49.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4bc85f700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd49c0662f0 0x7fd49c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b57fa700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd49c06c760 0x7fd49c06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:49.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 --> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd49c06f220 con 0x7fd49c06c760 2023-06-09T20:19:49.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4b0086800 con 0x7fd4b815aa80 2023-06-09T20:19:49.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b7fff700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd49c06c760 0x7fd49c06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4bc85f700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd49c0662f0 0x7fd49c0687a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000f60 tx=0x7fd4ac007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.709+0000 7fd4b7fff700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd49c06c760 0x7fd49c06eb70 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:49.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.761+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== osd.7 v2:172.21.15.187:6808/3928672602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd49c06f220 con 0x7fd49c06c760 2023-06-09T20:19:49.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.781+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 --> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4b80670e0 con 0x7fd49c06c760 2023-06-09T20:19:49.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4b57fa700 1 -- 172.21.15.78:0/2133608485 <== osd.7 v2:172.21.15.187:6808/3928672602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd4b80670e0 con 0x7fd49c06c760 2023-06-09T20:19:49.808 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-09T20:19:49.809 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-09T20:19:49.809 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-09T20:19:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd49c06c760 msgr2=0x7fd49c06eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6808/3928672602,v1:172.21.15.187:6810/3928672602] conn(0x7fd49c06c760 0x7fd49c06eb70 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd49c0662f0 msgr2=0x7fd49c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fd49c0662f0 0x7fd49c0687a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000f60 tx=0x7fd4ac007eb0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b815aa80 msgr2=0x7fd4b80ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 --2- 172.21.15.78:0/2133608485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b815aa80 0x7fd4b80ac910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009dd0 tx=0x7fd4b000c3a0 comp rx=0 tx=0).stop 2023-06-09T20:19:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd060700 1 -- 172.21.15.78:0/2133608485 reap_dead start 2023-06-09T20:19:49.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 shutdown_connections 2023-06-09T20:19:49.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 >> 172.21.15.78:0/2133608485 conn(0x7fd4b80b0780 msgr2=0x7fd4b806f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:49.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 shutdown_connections 2023-06-09T20:19:49.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:49.801+0000 7fd4bd861700 1 -- 172.21.15.78:0/2133608485 wait complete. 2023-06-09T20:19:49.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-06-09T20:19:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.013+0000 7fe7ad96a700 1 Processor -- start 2023-06-09T20:19:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.017+0000 7fe7ad96a700 1 -- start start 2023-06-09T20:19:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.017+0000 7fe7ad96a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.017+0000 7fe7ad96a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7a806ae70 0x7fe7a8162600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.017+0000 7fe7ad96a700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80c5710 con 0x7fe7a8070290 2023-06-09T20:19:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.017+0000 7fe7ad96a700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a8158f30 con 0x7fe7a806ae70 2023-06-09T20:19:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.017+0000 7fe7ad96a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80cd830 con 0x7fe7a8158b60 2023-06-09T20:19:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a67fc700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe7a8070290 0x7fe7a806a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:59298/0 (socket says 172.21.15.78:59298) 2023-06-09T20:19:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a67fc700 1 -- 172.21.15.78:0/3412906224 learned_addr learned my addr 172.21.15.78:0/3412906224 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-09T20:19:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a6ffd700 1 --2- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a77fe700 1 --2- 172.21.15.78:0/3412906224 >> v2:172.21.15.187:3300/0 conn(0x7fe7a806ae70 0x7fe7a8162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a77fe700 1 -- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 msgr2=0x7fe7a80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:19:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a77fe700 1 --2- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a80ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a77fe700 1 -- 172.21.15.78:0/3412906224 >> v1:172.21.15.187:6789/0 conn(0x7fe7a8070290 legacy=0x7fe7a806a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a77fe700 1 -- 172.21.15.78:0/3412906224 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80cd270 con 0x7fe7a806ae70 2023-06-09T20:19:50.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a5ffb700 1 -- 172.21.15.78:0/3412906224 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638180919 0 0) 0x7fe7a80c5710 con 0x7fe7a8070290 2023-06-09T20:19:50.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a77fe700 1 --2- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 0x7fe7a8162600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009d90 tx=0x7fe7a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1da4aab7d7840f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a5ffb700 1 -- 172.21.15.78:0/3412906224 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000e070 con 0x7fe7a806ae70 2023-06-09T20:19:50.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a5ffb700 1 -- 172.21.15.78:0/3412906224 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000bb20 con 0x7fe7a806ae70 2023-06-09T20:19:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7a5ffb700 1 -- 172.21.15.78:0/3412906224 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0012430 con 0x7fe7a806ae70 2023-06-09T20:19:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 -- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 msgr2=0x7fe7a8162600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 0x7fe7a8162600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009d90 tx=0x7fe7a000b330 comp rx=0 tx=0).stop 2023-06-09T20:19:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 -- 172.21.15.78:0/3412906224 shutdown_connections 2023-06-09T20:19:50.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 0x7fe7a8162600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/3412906224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a80ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 -- 172.21.15.78:0/3412906224 >> 172.21.15.78:0/3412906224 conn(0x7fe7a80cf670 msgr2=0x7fe7a80cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 -- 172.21.15.78:0/3412906224 shutdown_connections 2023-06-09T20:19:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.021+0000 7fe7ad96a700 1 -- 172.21.15.78:0/3412906224 wait complete. 2023-06-09T20:19:50.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 Processor -- start 2023-06-09T20:19:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 -- start start 2023-06-09T20:19:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 0x7fe7a814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7a8070290 0x7fe7a814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80ab960 con 0x7fe7a8070290 2023-06-09T20:19:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a814bf60 con 0x7fe7a806ae70 2023-06-09T20:19:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7ad96a700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a81571f0 con 0x7fe7a8158b60 2023-06-09T20:19:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7a8070290 0x7fe7a814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a814d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:33988/0 (socket says 172.21.15.78:33988) 2023-06-09T20:19:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 -- 172.21.15.78:0/1589434847 learned_addr learned my addr 172.21.15.78:0/1589434847 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a6ffd700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 0x7fe7a814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 -- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 msgr2=0x7fe7a814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 0x7fe7a814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 -- 172.21.15.78:0/1589434847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7a8070290 msgr2=0x7fe7a814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7a8070290 0x7fe7a814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 -- 172.21.15.78:0/1589434847 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0009a70 con 0x7fe7a8158b60 2023-06-09T20:19:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe7a77fe700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a814d4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0014040 tx=0x7fe7a0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.025+0000 7fe78ffff700 1 -- 172.21.15.78:0/1589434847 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0012430 con 0x7fe7a8158b60 2023-06-09T20:19:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.029+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a80c3f00 con 0x7fe7a8158b60 2023-06-09T20:19:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.029+0000 7fe78ffff700 1 -- 172.21.15.78:0/1589434847 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0020070 con 0x7fe7a8158b60 2023-06-09T20:19:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.029+0000 7fe78ffff700 1 -- 172.21.15.78:0/1589434847 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0004280 con 0x7fe7a8158b60 2023-06-09T20:19:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.029+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a80cd550 con 0x7fe7a8158b60 2023-06-09T20:19:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.029+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a80c41e0 con 0x7fe7a8158b60 2023-06-09T20:19:50.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.041+0000 7fe78ffff700 1 -- 172.21.15.78:0/1589434847 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7a00043e0 con 0x7fe7a8158b60 2023-06-09T20:19:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.041+0000 7fe78ffff700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7940662f0 0x7fe7940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.045+0000 7fe7a6ffd700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7940662f0 0x7fe7940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.045+0000 7fe7a6ffd700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7940662f0 0x7fe7940687a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fe79800acf0 tx=0x7fe79800a350 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:50.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.045+0000 7fe78ffff700 1 -- 172.21.15.78:0/1589434847 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe7a0022070 con 0x7fe7a8158b60 2023-06-09T20:19:50.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.049+0000 7fe78ffff700 1 -- 172.21.15.78:0/1589434847 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe7a0053440 con 0x7fe7a8158b60 2023-06-09T20:19:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.217+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7a80abb30 con 0x7fe7940662f0 2023-06-09T20:19:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.221+0000 7fe78ffff700 1 -- 172.21.15.78:0/1589434847 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7a80abb30 con 0x7fe7940662f0 2023-06-09T20:19:50.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.221+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7940662f0 msgr2=0x7fe7940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.221+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7940662f0 0x7fe7940687a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fe79800acf0 tx=0x7fe79800a350 comp rx=0 tx=0).stop 2023-06-09T20:19:50.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.221+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 msgr2=0x7fe7a814d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.221+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a814d4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0014040 tx=0x7fe7a0004af0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 shutdown_connections 2023-06-09T20:19:50.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7fe7940662f0 0x7fe7940687a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7a8158b60 0x7fe7a814d4d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7a8070290 0x7fe7a814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 --2- 172.21.15.78:0/1589434847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7a806ae70 0x7fe7a814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 >> 172.21.15.78:0/1589434847 conn(0x7fe7a80cf670 msgr2=0x7fe7a81558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:50.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 shutdown_connections 2023-06-09T20:19:50.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.225+0000 7fe7ad96a700 1 -- 172.21.15.78:0/1589434847 wait complete. 2023-06-09T20:19:50.234 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2023-06-09T20:19:50.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T20:19:50.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.421+0000 7f1630adc700 1 Processor -- start 2023-06-09T20:19:50.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.421+0000 7f1630adc700 1 -- start start 2023-06-09T20:19:50.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f162c0c7cb0 0x7f162c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0c87a0 con 0x7f162c06fc80 2023-06-09T20:19:50.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0c81e0 con 0x7f162c15c880 2023-06-09T20:19:50.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c06e660 con 0x7f162c0c7cb0 2023-06-09T20:19:50.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f162c0c7cb0 0x7f162c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f162c0c7cb0 0x7f162c06a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48526/0 (socket says 172.21.15.78:48526) 2023-06-09T20:19:50.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162bfff700 1 -- 172.21.15.78:0/1056168380 learned_addr learned my addr 172.21.15.78:0/1056168380 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:50.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162affd700 1 --1- 172.21.15.78:0/1056168380 >> v1:172.21.15.187:6789/0 conn(0x7f162c15c880 0x7f162c06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:59304/0 (socket says 172.21.15.78:59304) 2023-06-09T20:19:50.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162b7fe700 1 --1- 172.21.15.78:0/1056168380 >> v1:172.21.15.78:6789/0 conn(0x7f162c06fc80 0x7f162c070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39408/0 (socket says 172.21.15.78:39408) 2023-06-09T20:19:50.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162bfff700 1 -- 172.21.15.78:0/1056168380 >> v1:172.21.15.187:6789/0 conn(0x7f162c15c880 legacy=0x7f162c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162bfff700 1 -- 172.21.15.78:0/1056168380 >> v1:172.21.15.78:6789/0 conn(0x7f162c06fc80 legacy=0x7f162c070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162bfff700 1 -- 172.21.15.78:0/1056168380 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0c84c0 con 0x7f162c0c7cb0 2023-06-09T20:19:50.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162bfff700 1 --2- 172.21.15.78:0/1056168380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c06a870 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7f1624009e80 tx=0x7f162400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c96438c68023427 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:50.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162a7fc700 1 -- 172.21.15.78:0/1056168380 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400e070 con 0x7f162c0c7cb0 2023-06-09T20:19:50.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162a7fc700 1 -- 172.21.15.78:0/1056168380 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624003a40 con 0x7f162c0c7cb0 2023-06-09T20:19:50.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f162a7fc700 1 -- 172.21.15.78:0/1056168380 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624003df0 con 0x7f162c0c7cb0 2023-06-09T20:19:50.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- 172.21.15.78:0/1056168380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 msgr2=0x7f162c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 --2- 172.21.15.78:0/1056168380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c06a870 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7f1624009e80 tx=0x7f162400b330 comp rx=0 tx=0).stop 2023-06-09T20:19:50.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- 172.21.15.78:0/1056168380 shutdown_connections 2023-06-09T20:19:50.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 --2- 172.21.15.78:0/1056168380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c06a870 unknown :-1 s=CLOSED pgs=3296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- 172.21.15.78:0/1056168380 >> 172.21.15.78:0/1056168380 conn(0x7f162c0cf870 msgr2=0x7f162c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:50.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- 172.21.15.78:0/1056168380 shutdown_connections 2023-06-09T20:19:50.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.425+0000 7f1630adc700 1 -- 172.21.15.78:0/1056168380 wait complete. 2023-06-09T20:19:50.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.429+0000 7f1630adc700 1 Processor -- start 2023-06-09T20:19:50.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1630adc700 1 -- start start 2023-06-09T20:19:50.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1630adc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c06fc80 0x7f162c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1630adc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1630adc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c15c880 0x7f162c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1630adc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c155760 con 0x7f162c0c7cb0 2023-06-09T20:19:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1630adc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c155a40 con 0x7f162c06fc80 2023-06-09T20:19:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1630adc700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c155d20 con 0x7f162c15c880 2023-06-09T20:19:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c06fc80 0x7f162c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c15c880 0x7f162c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48530/0 (socket says 172.21.15.78:48530) 2023-06-09T20:19:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162affd700 1 -- 172.21.15.78:0/610056461 learned_addr learned my addr 172.21.15.78:0/610056461 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:19:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162bfff700 1 -- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c06fc80 msgr2=0x7f162c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162bfff700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c06fc80 0x7f162c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162bfff700 1 -- 172.21.15.78:0/610056461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 msgr2=0x7f162c156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162bfff700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162bfff700 1 -- 172.21.15.78:0/610056461 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009b30 con 0x7f162c15c880 2023-06-09T20:19:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162b7fe700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c06fc80 0x7f162c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162affd700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:19:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f162bfff700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c15c880 0x7f162c157440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1624014000 tx=0x7f1624004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1613fff700 1 -- 172.21.15.78:0/610056461 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624004440 con 0x7f162c15c880 2023-06-09T20:19:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.433+0000 7f1613fff700 1 -- 172.21.15.78:0/610056461 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16240045c0 con 0x7f162c15c880 2023-06-09T20:19:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.437+0000 7f1613fff700 1 -- 172.21.15.78:0/610056461 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624004970 con 0x7f162c15c880 2023-06-09T20:19:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.437+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c06a350 con 0x7f162c15c880 2023-06-09T20:19:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.437+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c06a070 con 0x7f162c15c880 2023-06-09T20:19:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.437+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c06adb0 con 0x7f162c15c880 2023-06-09T20:19:50.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.441+0000 7f1613fff700 1 -- 172.21.15.78:0/610056461 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f162402e430 con 0x7f162c15c880 2023-06-09T20:19:50.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.441+0000 7f1613fff700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f16180662f0 0x7f16180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:19:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.441+0000 7f1613fff700 1 -- 172.21.15.78:0/610056461 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f16240851d0 con 0x7f162c15c880 2023-06-09T20:19:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.441+0000 7f162b7fe700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f16180662f0 0x7f16180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:19:50.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.441+0000 7f162b7fe700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f16180662f0 0x7f16180687a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f161c000f60 tx=0x7f161c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:19:50.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.445+0000 7f1613fff700 1 -- 172.21.15.78:0/610056461 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1624052a80 con 0x7f162c15c880 2023-06-09T20:19:50.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.617+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f162c0741c0 con 0x7f16180662f0 2023-06-09T20:19:50.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.625+0000 7f1613fff700 1 -- 172.21.15.78:0/610056461 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71249 (secure 0 0 0) 0x7f162c0741c0 con 0x7f16180662f0 2023-06-09T20:19:50.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:19:50.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f16180662f0 msgr2=0x7f16180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f16180662f0 0x7f16180687a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f161c000f60 tx=0x7f161c009040 comp rx=0 tx=0).stop 2023-06-09T20:19:50.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c15c880 msgr2=0x7f162c157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:19:50.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c15c880 0x7f162c157440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1624014000 tx=0x7f1624004af0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 shutdown_connections 2023-06-09T20:19:50.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f16180662f0 0x7f16180687a0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c15c880 0x7f162c157440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f162c0c7cb0 0x7f162c156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 --2- 172.21.15.78:0/610056461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c06fc80 0x7f162c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:19:50.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 >> 172.21.15.78:0/610056461 conn(0x7f162c0cf870 msgr2=0x7f162c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:19:50.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 shutdown_connections 2023-06-09T20:19:50.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:19:50.629+0000 7f1630adc700 1 -- 172.21.15.78:0/610056461 wait complete. 2023-06-09T20:19:50.641 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T20:19:50.661 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":16464,"stamp":"2023-06-09T20:19:49.558473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":9104672,"kb_used_data":1991072,"kb_used_omap":164701,"kb_used_meta":6948834,"kb_avail":745870048,"statfs":{"total":773094113280,"available":763770929152,"internally_reserved":0,"allocated":2038857728,"data_stored":2035938658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":168654543,"internal_metadata":7115606321},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5479,"apply_latency_ms":5479,"commit_latency_ns":5479000000,"apply_latency_ns":5479000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002592"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":481,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.432835+0000","last_change":"2023-06-09T11:11:57.161604+0000","last_active":"2023-06-09T20:19:25.432835+0000","last_peered":"2023-06-09T20:19:25.432835+0000","last_clean":"2023-06-09T20:19:25.432835+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T20:19:25.432835+0000","last_undegraded":"2023-06-09T20:19:25.432835+0000","last_fullsized":"2023-06-09T20:19:25.432835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:11:56.004228+0000","last_clean_scrub_stamp":"2023-06-09T11:11:56.004228+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:35.276528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":319,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.882958+0000","last_change":"2023-06-09T11:12:03.192555+0000","last_active":"2023-06-09T20:19:23.882958+0000","last_peered":"2023-06-09T20:19:23.882958+0000","last_clean":"2023-06-09T20:19:23.882958+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T20:19:23.882958+0000","last_undegraded":"2023-06-09T20:19:23.882958+0000","last_fullsized":"2023-06-09T20:19:23.882958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:45:26.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":325,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.432177+0000","last_change":"2023-06-09T11:12:03.198405+0000","last_active":"2023-06-09T20:19:25.432177+0000","last_peered":"2023-06-09T20:19:25.432177+0000","last_clean":"2023-06-09T20:19:25.432177+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T20:19:25.432177+0000","last_undegraded":"2023-06-09T20:19:25.432177+0000","last_fullsized":"2023-06-09T20:19:25.432177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:03:32.866197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":324,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:42.464456+0000","last_change":"2023-06-09T20:19:42.464572+0000","last_active":"2023-06-09T20:19:42.464456+0000","last_peered":"2023-06-09T20:19:42.464456+0000","last_clean":"2023-06-09T20:19:42.464456+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T20:19:42.464456+0000","last_undegraded":"2023-06-09T20:19:42.464456+0000","last_fullsized":"2023-06-09T20:19:42.464456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:42.464231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:42.464231+0000","last_clean_scrub_stamp":"2023-06-09T20:19:42.464231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T02:37:38.619136+0000","scrub_duration":2.2381781950000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":319,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:23.882165+0000","last_change":"2023-06-09T11:12:03.197555+0000","last_active":"2023-06-09T20:19:23.882165+0000","last_peered":"2023-06-09T20:19:23.882165+0000","last_clean":"2023-06-09T20:19:23.882165+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T20:19:23.882165+0000","last_undegraded":"2023-06-09T20:19:23.882165+0000","last_fullsized":"2023-06-09T20:19:23.882165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:02:34.231405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":323,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:39.118688+0000","last_change":"2023-06-09T20:19:39.118863+0000","last_active":"2023-06-09T20:19:39.118688+0000","last_peered":"2023-06-09T20:19:39.118688+0000","last_clean":"2023-06-09T20:19:39.118688+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T20:19:39.118688+0000","last_undegraded":"2023-06-09T20:19:39.118688+0000","last_fullsized":"2023-06-09T20:19:39.118688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:39.118312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:39.118312+0000","last_clean_scrub_stamp":"2023-06-09T20:19:39.118312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T03:48:46.725428+0000","scrub_duration":2.3058696960000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.441446+0000","last_change":"2023-06-09T11:12:03.352505+0000","last_active":"2023-06-09T20:19:25.441446+0000","last_peered":"2023-06-09T20:19:25.441446+0000","last_clean":"2023-06-09T20:19:25.441446+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T20:19:25.441446+0000","last_undegraded":"2023-06-09T20:19:25.441446+0000","last_fullsized":"2023-06-09T20:19:25.441446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:36.632140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":316,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:42.338555+0000","last_change":"2023-06-09T20:19:42.338730+0000","last_active":"2023-06-09T20:19:42.338555+0000","last_peered":"2023-06-09T20:19:42.338555+0000","last_clean":"2023-06-09T20:19:42.338555+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T20:19:42.338555+0000","last_undegraded":"2023-06-09T20:19:42.338555+0000","last_fullsized":"2023-06-09T20:19:42.338555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:42.338236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:42.338236+0000","last_clean_scrub_stamp":"2023-06-09T20:19:42.338236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:02:16.804104+0000","scrub_duration":2.5441879919999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":301,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:25.418390+0000","last_change":"2023-06-09T11:12:03.198948+0000","last_active":"2023-06-09T20:19:25.418390+0000","last_peered":"2023-06-09T20:19:25.418390+0000","last_clean":"2023-06-09T20:19:25.418390+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T20:19:25.418390+0000","last_undegraded":"2023-06-09T20:19:25.418390+0000","last_fullsized":"2023-06-09T20:19:25.418390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T11:12:02.166272+0000","last_clean_scrub_stamp":"2023-06-09T11:12:02.166272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T20:40:02.219798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581410,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":781404,"kb_used_data":22420,"kb_used_omap":15347,"kb_used_meta":743628,"kb_avail":93590436,"statfs":{"total":96636764160,"available":95836606464,"internally_reserved":0,"allocated":22958080,"data_stored":22648583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715521,"internal_metadata":761475903},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":973,"apply_latency_ms":973,"commit_latency_ns":973000000,"apply_latency_ns":973000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":3.2189999999999999,"5min":1.238,"15min":0.94999999999999996},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":37.523000000000003,"5min":37.523000000000003,"15min":37.523000000000003},"last":0.87},{"interface":"front","average":{"1min":2.8650000000000002,"5min":1.1379999999999999,"15min":0.91900000000000004},"min":{"1min":0.41199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":31.436,"5min":31.436,"15min":31.436},"last":0.93300000000000005}]},{"osd":1,"last update":"Fri Jun 9 20:19:02 2023","interfaces":[{"interface":"back","average":{"1min":6.6509999999999998,"5min":1.964,"15min":1.2629999999999999},"min":{"1min":0.38,"5min":0.371,"15min":0.33500000000000002},"max":{"1min":106.97,"5min":106.97,"15min":106.97},"last":1.0620000000000001},{"interface":"front","average":{"1min":6.5869999999999997,"5min":1.966,"15min":1.284},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":107.06100000000001,"5min":107.06100000000001,"15min":107.06100000000001},"last":1.018}]},{"osd":2,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.86899999999999999,"15min":0.91700000000000004},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.38700000000000001},"max":{"1min":1.0369999999999999,"5min":4.0949999999999998,"15min":11.923},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.876,"15min":0.91500000000000004},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.972,"5min":3.4470000000000001,"15min":6.5880000000000001},"last":1.331}]},{"osd":3,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":1.1439999999999999},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.982,"5min":4.1459999999999999,"15min":59.793999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.105,"5min":0.95099999999999996,"15min":1.175},"min":{"1min":0.50700000000000001,"5min":0.45700000000000002,"15min":0.45200000000000001},"max":{"1min":3.02,"5min":3.484,"15min":60.773000000000003},"last":1.157}]},{"osd":4,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.556,"15min":1.165},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9390000000000001,"5min":54.104999999999997,"15min":54.104999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.655,"15min":1.2050000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.39500000000000002},"max":{"1min":3.3420000000000001,"5min":53.810000000000002,"15min":53.810000000000002},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":2.601,"15min":1.5720000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.42399999999999999},"max":{"1min":12.439,"5min":131.97200000000001,"15min":131.97200000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.8759999999999999,"5min":2.7269999999999999,"15min":1.728},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.434},"max":{"1min":15.169,"5min":134.97499999999999,"15min":134.97499999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.0669999999999999,"15min":1.294},"min":{"1min":0.58999999999999997,"5min":0.55700000000000005,"15min":0.499},"max":{"1min":6.274,"5min":6.274,"15min":61.345999999999997},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.163,"15min":1.3100000000000001},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":6.2279999999999998,"5min":6.2279999999999998,"15min":60.165999999999997},"last":1.054}]}]},{"osd":6,"up_from":13,"seq":55834581408,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1644604,"kb_used_data":485492,"kb_used_omap":10585,"kb_used_meta":1148518,"kb_avail":92727236,"statfs":{"total":96636764160,"available":94952689664,"internally_reserved":0,"allocated":497143808,"data_stored":496716391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10840012,"internal_metadata":1176082484},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1139,"apply_latency_ms":1139,"commit_latency_ns":1139000000,"apply_latency_ns":1139000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.7390000000000001,"5min":3.1760000000000002,"15min":7.4050000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.89000000000000001},"min":{"1min":0.42099999999999999,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":2.278,"5min":26.532,"15min":26.532},"last":0.95399999999999996}]},{"osd":1,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.778,"5min":1.036,"15min":0.93999999999999995},"min":{"1min":0.495,"5min":0.375,"15min":0.375},"max":{"1min":17.495000000000001,"5min":17.495000000000001,"15min":17.495000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":1.1279999999999999,"15min":0.95899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33700000000000002},"max":{"1min":23.216000000000001,"5min":23.216000000000001,"15min":23.216000000000001},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.92100000000000004,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":3.5110000000000001,"5min":7.5259999999999998,"15min":14.003},"last":0.755},{"interface":"front","average":{"1min":1.1819999999999999,"5min":0.88800000000000001,"15min":0.89000000000000001},"min":{"1min":0.51800000000000002,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":5.4429999999999996,"5min":5.4429999999999996,"15min":6.4199999999999999},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3979999999999999,"15min":1.0840000000000001},"min":{"1min":0.54100000000000004,"5min":0.439,"15min":0.42199999999999999},"max":{"1min":9.4649999999999999,"5min":39.442999999999998,"15min":39.442999999999998},"last":1.01},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.119},"min":{"1min":0.628,"5min":0.441,"15min":0.441},"max":{"1min":1.615,"5min":39.011000000000003,"15min":39.011000000000003},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90600000000000003,"15min":1.526},"min":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.33000000000000002},"max":{"1min":2.0379999999999998,"5min":4.0659999999999998,"15min":162.25399999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89000000000000001,"15min":1.5940000000000001},"min":{"1min":0.53700000000000003,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":2.867,"5min":3.294,"15min":162.19900000000001},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4690000000000001,"15min":1.5840000000000001},"min":{"1min":0.48299999999999998,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":9.4670000000000005,"5min":47.223999999999997,"15min":126.22},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.8680000000000001,"5min":1.9950000000000001,"15min":1.786},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38800000000000001},"max":{"1min":19.411000000000001,"5min":47.131,"15min":133.33000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.98299999999999998,"15min":1.7509999999999999},"min":{"1min":0.66600000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.5710000000000002,"5min":3.907,"15min":96.753},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0089999999999999,"15min":1.758},"min":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.8320000000000001,"5min":3.4670000000000001,"15min":101.806},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834581404,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2544000,"kb_used_data":1480184,"kb_used_omap":31576,"kb_used_meta":1032231,"kb_avail":91827840,"statfs":{"total":96636764160,"available":94031708160,"internally_reserved":0,"allocated":1515708416,"data_stored":1514949950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32334646,"internal_metadata":1057004746},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1594,"apply_latency_ms":1594,"commit_latency_ns":1594000000,"apply_latency_ns":1594000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.75900000000000001,"15min":1.732},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.31},"max":{"1min":8.2210000000000001,"5min":8.2210000000000001,"15min":150.52699999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":1.8149999999999999},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.33000000000000002},"max":{"1min":2.669,"5min":4.1779999999999999,"15min":151.72900000000001},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.5309999999999999,"15min":1.0609999999999999},"min":{"1min":0.42199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":9.9000000000000004,"5min":53.021999999999998,"15min":53.021999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.389,"5min":1.8069999999999999,"15min":1.177},"min":{"1min":0.52200000000000002,"5min":0.47299999999999998,"15min":0.376},"max":{"1min":9.9800000000000004,"5min":53.197000000000003,"15min":53.197000000000003},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":0.872,"15min":1.2},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.38400000000000001},"max":{"1min":8.173,"5min":8.173,"15min":97.159999999999997},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":1.181},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0589999999999999,"5min":1.4790000000000001,"15min":97.531000000000006},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.107,"15min":0.98599999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.41499999999999998},"max":{"1min":8.2029999999999994,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.377,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.54500000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":8.2889999999999997,"5min":8.2889999999999997,"15min":8.2889999999999997},"last":0.75600000000000001}]},{"osd":4,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":2.4820000000000002,"15min":1.4690000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.36399999999999999},"max":{"1min":8.2569999999999997,"5min":136.20500000000001,"15min":136.20500000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.024,"5min":2.3559999999999999,"15min":1.4450000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.36599999999999999},"max":{"1min":5.8079999999999998,"5min":135.35400000000001,"15min":135.35400000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":2.028,"5min":1.272,"15min":1.073},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.41899999999999998},"max":{"1min":20.053999999999998,"5min":20.053999999999998,"15min":20.053999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.97099999999999997,"15min":1.0309999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.39800000000000002},"max":{"1min":3.9049999999999998,"5min":6.0339999999999998,"15min":6.0339999999999998},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jun 9 20:19:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.101,"15min":1.0760000000000001},"min":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.44400000000000001},"max":{"1min":1.9810000000000001,"5min":4.2229999999999999,"15min":6.0720000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.536,"5min":1.0940000000000001,"15min":1.1140000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.40899999999999997},"max":{"1min":11.916,"5min":11.916,"15min":11.916},"last":0.70799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834581407,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":809704,"kb_used_data":480,"kb_used_omap":33020,"kb_used_meta":776195,"kb_avail":93562136,"statfs":{"total":96636764160,"available":95807627264,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33813444,"internal_metadata":794823740},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1770,"apply_latency_ms":1770,"commit_latency_ns":1770000000,"apply_latency_ns":1770000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.79800000000000004,"15min":0.747},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":2.2930000000000001,"5min":1.044,"15min":0.91500000000000004},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.37},"max":{"1min":15.125,"5min":15.125,"15min":15.125},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.1100000000000001,"15min":1.4159999999999999},"min":{"1min":0.53500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.8689999999999998,"5min":10.677,"15min":121.21599999999999},"last":1.032},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1000000000000001,"15min":1.3280000000000001},"min":{"1min":0.50600000000000001,"5min":0.45700000000000002,"15min":0.35199999999999998},"max":{"1min":6.8869999999999996,"5min":10.699,"15min":121.19799999999999},"last":1.099}]},{"osd":2,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":4.7320000000000002,"5min":2.1669999999999998,"15min":1.669},"min":{"1min":0.49399999999999999,"5min":0.41499999999999998,"15min":0.40300000000000002},"max":{"1min":63.813000000000002,"5min":63.813000000000002,"15min":120.88800000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":4.4960000000000004,"5min":1.984,"15min":1.716},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.40300000000000002},"max":{"1min":63.460000000000001,"5min":63.460000000000001,"15min":122.483},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.014,"15min":1.3169999999999999},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.42699999999999999},"max":{"1min":10.083,"5min":10.083,"15min":119.94199999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.381,"5min":1.167,"15min":1.4139999999999999},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.45200000000000001},"max":{"1min":9.9770000000000003,"5min":9.9770000000000003,"15min":129.40199999999999},"last":1.0029999999999999}]},{"osd":5,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.1439999999999999,"15min":1.367},"min":{"1min":0.53500000000000003,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":13.957000000000001,"5min":13.957000000000001,"15min":105.523},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.54,"5min":1.1259999999999999,"15min":1.387},"min":{"1min":0.46500000000000002,"5min":0.44,"15min":0.40699999999999997},"max":{"1min":14.122999999999999,"5min":14.122999999999999,"15min":104.76300000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.1020000000000001,"15min":0.99199999999999999},"min":{"1min":0.53000000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.1890000000000001,"5min":9.0280000000000005,"15min":9.0280000000000005},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.133,"5min":1.1060000000000001,"15min":1.0860000000000001},"min":{"1min":0.64000000000000001,"5min":0.499,"15min":0.48499999999999999},"max":{"1min":2.5230000000000001,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":2.9860000000000002,"15min":1.6699999999999999},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.432},"max":{"1min":3.794,"5min":196.364,"15min":196.364},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.181,"5min":3.0579999999999998,"15min":1.681},"min":{"1min":0.62,"5min":0.47599999999999998,"15min":0.44400000000000001},"max":{"1min":4.0469999999999997,"5min":192.33199999999999,"15min":192.33199999999999},"last":0.749}]}]},{"osd":3,"up_from":13,"seq":55834581398,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":793384,"kb_used_data":480,"kb_used_omap":17824,"kb_used_meta":775071,"kb_avail":93578456,"statfs":{"total":96636764160,"available":95824338944,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18251807,"internal_metadata":793673697},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.74099999999999999,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.29899999999999999,"15min":0.28100000000000003},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":1.3680000000000001}]},{"osd":1,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":0.92900000000000005,"15min":0.83999999999999997},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.27900000000000003},"max":{"1min":6.0659999999999998,"5min":8.25,"15min":8.25},"last":1.077},{"interface":"front","average":{"1min":1.083,"5min":0.91400000000000003,"15min":0.86599999999999999},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.32000000000000001},"max":{"1min":4.9930000000000003,"5min":8.2040000000000006,"15min":8.2040000000000006},"last":1.2949999999999999}]},{"osd":2,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.8200000000000001,"15min":1.1659999999999999},"min":{"1min":0.44700000000000001,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":6.1029999999999998,"5min":84.156000000000006,"15min":84.156000000000006},"last":1.171},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.859,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.34799999999999998},"max":{"1min":5.0270000000000001,"5min":90.442999999999998,"15min":90.442999999999998},"last":0.91500000000000004}]},{"osd":4,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.0109999999999999,"15min":0.92700000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":1.516},{"interface":"front","average":{"1min":1.506,"5min":1.0449999999999999,"15min":0.98299999999999998},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":10.448,"5min":10.448,"15min":10.448},"last":1.504}]},{"osd":5,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.92600000000000005,"15min":1.167},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.48799999999999999},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":55.159999999999997},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.6160000000000001,"5min":0.997,"15min":1.1679999999999999},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":13.651999999999999,"5min":13.651999999999999,"15min":54.234999999999999},"last":1.409}]},{"osd":6,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.107,"15min":1.075},"min":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":5.8680000000000003,"5min":6.2869999999999999,"15min":6.2869999999999999},"last":1.137},{"interface":"front","average":{"1min":1.327,"5min":1.0049999999999999,"15min":1.0860000000000001},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":6.3780000000000001,"5min":6.3780000000000001,"15min":12.545999999999999},"last":1.246}]},{"osd":7,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.0640000000000001,"15min":1.627},"min":{"1min":0.70399999999999996,"5min":0.56000000000000005,"15min":0.53500000000000003},"max":{"1min":6.2569999999999997,"5min":6.2569999999999997,"15min":187.14099999999999},"last":1.476},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.0820000000000001,"15min":1.6419999999999999},"min":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":187.03},"last":1.456}]}]},{"osd":2,"up_from":13,"seq":55834581404,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340520,"kb_used_data":480,"kb_used_omap":11211,"kb_used_meta":328820,"kb_avail":94031320,"statfs":{"total":96636764160,"available":96288071680,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11481051,"internal_metadata":336711717},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.73599999999999999,"15min":0.71699999999999997},"min":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.4199999999999999,"5min":7.5730000000000004,"15min":7.8390000000000004},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":3.218,"5min":3.218,"15min":4.8700000000000001},"last":1.0640000000000001}]},{"osd":1,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":0.88200000000000001,"15min":0.82499999999999996},"min":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.27800000000000002},"max":{"1min":9.5899999999999999,"5min":9.5899999999999999,"15min":9.5899999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.86499999999999999,"15min":0.88900000000000001},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.309},"max":{"1min":2.746,"5min":7.5330000000000004,"15min":9.4930000000000003},"last":1.296}]},{"osd":3,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":0.96799999999999997,"15min":0.94199999999999995},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.35699999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.028,"15min":0.95799999999999996},"min":{"1min":0.42699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":6.4809999999999999,"5min":7.4889999999999999,"15min":7.7690000000000001},"last":1.409}]},{"osd":4,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":2.7749999999999999,"5min":1.2230000000000001,"15min":1.0169999999999999},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.435},"max":{"1min":30.73,"5min":30.73,"15min":30.73},"last":1.224},{"interface":"front","average":{"1min":3.0150000000000001,"5min":1.333,"15min":1.091},"min":{"1min":0.54000000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":30.786000000000001,"5min":30.786000000000001,"15min":30.786000000000001},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.0349999999999999,"15min":0.98099999999999998},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.9930000000000003,"5min":5.9930000000000003,"15min":7.806},"last":1.5649999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.98699999999999999,"15min":1.0169999999999999},"min":{"1min":0.55600000000000005,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":3.1859999999999999,"5min":4.4669999999999996,"15min":7.3650000000000002},"last":1.3600000000000001}]},{"osd":6,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6950000000000001,"5min":1.101,"15min":1.669},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":9.3339999999999996,"5min":9.3339999999999996,"15min":88.555999999999997},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.0369999999999999,"15min":1.6759999999999999},"min":{"1min":0.55000000000000004,"5min":0.51600000000000001,"15min":0.47299999999999998},"max":{"1min":5.117,"5min":5.117,"15min":88.912000000000006},"last":1.502}]},{"osd":7,"last update":"Fri Jun 9 20:18:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.0660000000000001,"15min":1.0489999999999999},"min":{"1min":0.63100000000000001,"5min":0.57299999999999995,"15min":0.52400000000000002},"max":{"1min":6.1779999999999999,"5min":6.1779999999999999,"15min":6.1779999999999999},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.1519999999999999,"15min":1.133},"min":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.51400000000000001},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":1.391}]}]},{"osd":1,"up_from":13,"seq":55834581413,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1084200,"kb_used_data":480,"kb_used_omap":24790,"kb_used_meta":1058921,"kb_avail":93287640,"statfs":{"total":96636764160,"available":95526543360,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25385484,"internal_metadata":1084335604},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":0.99299999999999999,"15min":0.73799999999999999},"min":{"1min":0.33700000000000002,"5min":0.27400000000000002,"15min":0.245},"max":{"1min":18.120999999999999,"5min":18.120999999999999,"15min":18.120999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.427,"5min":1.0389999999999999,"15min":0.84799999999999998},"min":{"1min":0.45300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":18.346,"5min":18.346,"15min":18.346},"last":1.4350000000000001}]},{"osd":2,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":0.81100000000000005,"15min":0.746},"min":{"1min":0.316,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":15.304,"5min":15.304,"15min":15.304},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.3129999999999999,"5min":0.876,"15min":0.84999999999999998},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":11.759,"5min":11.759,"15min":11.759},"last":1.056}]},{"osd":3,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":7.7720000000000002,"5min":2.1949999999999998,"15min":1.2669999999999999},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":114.809,"5min":114.809,"15min":114.809},"last":1.25},{"interface":"front","average":{"1min":8.234,"5min":2.2490000000000001,"15min":1.3029999999999999},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":119.399,"5min":119.399,"15min":119.399},"last":1.212}]},{"osd":4,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":2.585,"5min":1.177,"15min":1.044},"min":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.435},"max":{"1min":23.172000000000001,"5min":23.172000000000001,"15min":23.172000000000001},"last":1.024},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.1120000000000001,"15min":1.0489999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":11.667999999999999,"5min":11.667999999999999,"15min":11.667999999999999},"last":1.1499999999999999}]},{"osd":5,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.5300000000000002},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.032,"15min":1.0029999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.535,"5min":10.535,"15min":10.535},"last":1.1739999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.0960000000000001,"15min":1.0629999999999999},"min":{"1min":0.66000000000000003,"5min":0.54500000000000004,"15min":0.50700000000000001},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.5720000000000001},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.0329999999999999,"15min":1.0580000000000001},"min":{"1min":0.56200000000000006,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":10.582000000000001,"5min":10.582000000000001,"15min":10.582000000000001},"last":1.3520000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.083,"15min":1.2},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.6070000000000002,"5min":6.0599999999999996,"15min":41.878999999999998},"last":1.399},{"interface":"front","average":{"1min":1.71,"5min":1.125,"15min":1.268},"min":{"1min":0.69199999999999995,"5min":0.55600000000000005,"15min":0.54500000000000004},"max":{"1min":5.5099999999999998,"5min":5.5099999999999998,"15min":41.908000000000001},"last":1.7809999999999999}]}]},{"osd":0,"up_from":13,"seq":55834581404,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1106856,"kb_used_data":1056,"kb_used_omap":20344,"kb_used_meta":1085447,"kb_avail":93264984,"statfs":{"total":96636764160,"available":95503343616,"internally_reserved":0,"allocated":1081344,"data_stored":796226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20832578,"internal_metadata":1111498430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.522,"15min":0.97299999999999998},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":6.6630000000000003,"5min":65.247,"15min":65.247},"last":1.198},{"interface":"front","average":{"1min":1.095,"5min":1.5269999999999999,"15min":0.99099999999999999},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":6.718,"5min":63.713999999999999,"15min":63.713999999999999},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.9299999999999999,"5min":1.034,"15min":0.89000000000000001},"min":{"1min":0.318,"5min":0.312,"15min":0.31},"max":{"1min":17.765999999999998,"5min":17.765999999999998,"15min":17.765999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":2.3799999999999999,"5min":1.103,"15min":0.83999999999999997},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.32100000000000001},"max":{"1min":32.375,"5min":32.375,"15min":32.375},"last":1.2330000000000001}]},{"osd":3,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.2609999999999999,"15min":1},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1319999999999997,"5min":35.847999999999999,"15min":35.847999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.3120000000000001,"15min":1.0189999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.38400000000000001},"max":{"1min":3.7330000000000001,"5min":35.762,"15min":35.762},"last":1.4850000000000001}]},{"osd":4,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86299999999999999,"15min":1.4630000000000001},"min":{"1min":0.52200000000000002,"5min":0.45200000000000001,"15min":0.39600000000000002},"max":{"1min":1.46,"5min":2.8559999999999999,"15min":174.31299999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.91600000000000004,"15min":1.522},"min":{"1min":0.503,"5min":0.47599999999999998,"15min":0.44800000000000001},"max":{"1min":4.0750000000000002,"5min":4.0750000000000002,"15min":174.25299999999999},"last":1.2589999999999999}]},{"osd":5,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":2.9700000000000002,"5min":1.49,"15min":1.1339999999999999},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":40.771000000000001,"5min":40.771000000000001,"15min":40.771000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":2.867,"5min":1.4810000000000001,"15min":1.1160000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":40.357999999999997,"5min":40.357999999999997,"15min":40.357999999999997},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.0409999999999999,"15min":1.03},"min":{"1min":0.54000000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":4.165,"5min":4.165,"15min":8.9109999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.169,"15min":1.0880000000000001},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":11.484,"5min":11.484,"15min":11.484},"last":1.405}]},{"osd":7,"last update":"Fri Jun 9 20:19:04 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.216,"15min":2.004},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.501},"max":{"1min":3.5059999999999998,"5min":5.2309999999999999,"15min":174.10499999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.0680000000000001,"15min":2.0470000000000002},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.194,"5min":4.194,"15min":174.35900000000001},"last":0.96899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T20:19:50.665 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-06-09T11:11:56.004228+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=160, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=20, tm_min=19, tm_sec=31, tm_wday=4, tm_yday=160, tm_isdst=0) 2023-06-09T20:19:50.665 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-06-09T11:12:02.166272+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=11, tm_min=12, tm_sec=2, tm_wday=4, tm_yday=160, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=20, tm_min=19, tm_sec=31, tm_wday=4, tm_yday=160, tm_isdst=0) 2023-06-09T20:19:50.666 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-06-09T11:12:02.166272+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=11, tm_min=12, tm_sec=2, tm_wday=4, tm_yday=160, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=20, tm_min=19, tm_sec=31, tm_wday=4, tm_yday=160, tm_isdst=0) 2023-06-09T20:19:50.666 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-06-09T11:12:02.166272+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=11, tm_min=12, tm_sec=2, tm_wday=4, tm_yday=160, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=20, tm_min=19, tm_sec=31, tm_wday=4, tm_yday=160, tm_isdst=0) 2023-06-09T20:19:50.667 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-06-09T11:12:02.166272+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=11, tm_min=12, tm_sec=2, tm_wday=4, tm_yday=160, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=20, tm_min=19, tm_sec=31, tm_wday=4, tm_yday=160, tm_isdst=0) 2023-06-09T20:19:50.667 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-06-09T11:12:02.166272+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=11, tm_min=12, tm_sec=2, tm_wday=4, tm_yday=160, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=9, tm_hour=20, tm_min=19, tm_sec=31, tm_wday=4, tm_yday=160, tm_isdst=0) 2023-06-09T20:19:50.667 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-09T20:20:10.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T20:20:10.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.837+0000 7f8bc95a0700 1 Processor -- start 2023-06-09T20:20:10.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc95a0700 1 -- start start 2023-06-09T20:20:10.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc95a0700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8bc406a5e0 0x7f8bc40ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:10.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc95a0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bc40ca5c0 0x7f8bc40cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:10.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc95a0700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc40cb520 con 0x7f8bc4159530 2023-06-09T20:20:10.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc95a0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc40caa40 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc95a0700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc40cca40 con 0x7f8bc406a5e0 2023-06-09T20:20:10.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bc40ca5c0 0x7f8bc40cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:10.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bc40ca5c0 0x7f8bc40cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33658/0 (socket says 172.21.15.78:33658) 2023-06-09T20:20:10.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc37fe700 1 -- 172.21.15.78:0/3131682488 learned_addr learned my addr 172.21.15.78:0/3131682488 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:20:10.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc27fc700 1 --2- 172.21.15.78:0/3131682488 >> v2:172.21.15.187:3300/0 conn(0x7f8bc406a5e0 0x7f8bc40ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:10.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc37fe700 1 -- 172.21.15.78:0/3131682488 >> v2:172.21.15.187:3300/0 conn(0x7f8bc406a5e0 msgr2=0x7f8bc40ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:20:10.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc1ffb700 1 -- 172.21.15.78:0/3131682488 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767782159 0 0) 0x7f8bb4001490 con 0x7f8bc4159530 2023-06-09T20:20:10.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.841+0000 7f8bc37fe700 1 --2- 172.21.15.78:0/3131682488 >> v2:172.21.15.187:3300/0 conn(0x7f8bc406a5e0 0x7f8bc40ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:10.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc37fe700 1 -- 172.21.15.78:0/3131682488 >> v1:172.21.15.187:6789/0 conn(0x7f8bc4159530 legacy=0x7f8bc4069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:10.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc37fe700 1 -- 172.21.15.78:0/3131682488 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40cac80 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc37fe700 1 --2- 172.21.15.78:0/3131682488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40cced0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40b4db0 tx=0x7f8bbc00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffc83b8f66620f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:10.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc1ffb700 1 -- 172.21.15.78:0/3131682488 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00dd30 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc1ffb700 1 -- 172.21.15.78:0/3131682488 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00de90 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc1ffb700 1 -- 172.21.15.78:0/3131682488 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc010690 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 -- 172.21.15.78:0/3131682488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 msgr2=0x7f8bc40cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:10.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/3131682488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40cced0 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40b4db0 tx=0x7f8bbc00be90 comp rx=0 tx=0).stop 2023-06-09T20:20:10.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 -- 172.21.15.78:0/3131682488 shutdown_connections 2023-06-09T20:20:10.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/3131682488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40cced0 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:10.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/3131682488 >> v2:172.21.15.187:3300/0 conn(0x7f8bc406a5e0 0x7f8bc40ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:10.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 -- 172.21.15.78:0/3131682488 >> 172.21.15.78:0/3131682488 conn(0x7f8bc40b1480 msgr2=0x7f8bc40cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:20:10.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 -- 172.21.15.78:0/3131682488 shutdown_connections 2023-06-09T20:20:10.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.845+0000 7f8bc95a0700 1 -- 172.21.15.78:0/3131682488 wait complete. 2023-06-09T20:20:10.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 Processor -- start 2023-06-09T20:20:10.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 -- start start 2023-06-09T20:20:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bc406a5e0 0x7f8bc40b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:10.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bc4159530 0x7f8bc40acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:10.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc4154c10 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40c3740 con 0x7f8bc406a5e0 2023-06-09T20:20:10.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc95a0700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40c3460 con 0x7f8bc4159530 2023-06-09T20:20:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:10.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40aca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33662/0 (socket says 172.21.15.78:33662) 2023-06-09T20:20:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 -- 172.21.15.78:0/147201476 learned_addr learned my addr 172.21.15.78:0/147201476 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:20:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc2ffd700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bc406a5e0 0x7f8bc40b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc37fe700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bc4159530 0x7f8bc40acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:10.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 -- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bc4159530 msgr2=0x7f8bc40acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bc4159530 0x7f8bc40acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 -- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bc406a5e0 msgr2=0x7f8bc40b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bc406a5e0 0x7f8bc40b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 -- 172.21.15.78:0/147201476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc00b810 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.849+0000 7f8bc27fc700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40aca50 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800e9a0 tx=0x7f8bb800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.853+0000 7f8bab7fe700 1 -- 172.21.15.78:0/147201476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8009720 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.853+0000 7f8bab7fe700 1 -- 172.21.15.78:0/147201476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb800c850 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.853+0000 7f8bab7fe700 1 -- 172.21.15.78:0/147201476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800cc00 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.853+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc40cb240 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.853+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc40caf60 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.853+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc415d3b0 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.853+0000 7f8bab7fe700 1 -- 172.21.15.78:0/147201476 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8bb8013470 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.857+0000 7f8bab7fe700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bb00662f0 0x7f8bb00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.857+0000 7f8bab7fe700 1 -- 172.21.15.78:0/147201476 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8bb8083b30 con 0x7f8bc40ca5c0 2023-06-09T20:20:10.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.857+0000 7f8bc2ffd700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bb00662f0 0x7f8bb00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:10.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.857+0000 7f8bc2ffd700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bb00662f0 0x7f8bb00687a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40012e0 tx=0x7f8bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:10.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:10.865+0000 7f8bab7fe700 1 -- 172.21.15.78:0/147201476 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8bb8054cc0 con 0x7f8bc40ca5c0 2023-06-09T20:20:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.037+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 --> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bc40c3970 con 0x7f8bb00662f0 2023-06-09T20:20:11.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.045+0000 7f8bab7fe700 1 -- 172.21.15.78:0/147201476 <== mgr.4100 v2:172.21.15.187:6832/3679615404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70737 (secure 0 0 0) 0x7f8bc40c3970 con 0x7f8bb00662f0 2023-06-09T20:20:11.052 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:20:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bb00662f0 msgr2=0x7f8bb00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bb00662f0 0x7f8bb00687a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40012e0 tx=0x7f8bb4009040 comp rx=0 tx=0).stop 2023-06-09T20:20:11.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 msgr2=0x7f8bc40aca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40aca50 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800e9a0 tx=0x7f8bb800ed60 comp rx=0 tx=0).stop 2023-06-09T20:20:11.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 shutdown_connections 2023-06-09T20:20:11.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7f8bb00662f0 0x7f8bb00687a0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bc4159530 0x7f8bc40acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bc40ca5c0 0x7f8bc40aca50 unknown :-1 s=CLOSED pgs=3298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 --2- 172.21.15.78:0/147201476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bc406a5e0 0x7f8bc40b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 >> 172.21.15.78:0/147201476 conn(0x7f8bc40b1480 msgr2=0x7f8bc4069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:20:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 shutdown_connections 2023-06-09T20:20:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.049+0000 7f8bc95a0700 1 -- 172.21.15.78:0/147201476 wait complete. 2023-06-09T20:20:11.059 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-09T20:20:11.079 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":16474,"stamp":"2023-06-09T20:20:09.564202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":7136708,"kb_used_data":4996,"kb_used_omap":164701,"kb_used_meta":6966946,"kb_avail":747838012,"statfs":{"total":773094113280,"available":765786124288,"internally_reserved":0,"allocated":5115904,"data_stored":2834733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":168654543,"internal_metadata":7134153009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003466"},"pg_stats":[{"pgid":"1.0","version":"42'119","reported_seq":492,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:53.730535+0000","last_change":"2023-06-09T20:19:53.730676+0000","last_active":"2023-06-09T20:19:53.730535+0000","last_peered":"2023-06-09T20:19:53.730535+0000","last_clean":"2023-06-09T20:19:53.730535+0000","last_became_active":"2023-06-09T11:11:57.158708+0000","last_became_peered":"2023-06-09T11:11:57.158708+0000","last_unstale":"2023-06-09T20:19:53.730535+0000","last_undegraded":"2023-06-09T20:19:53.730535+0000","last_fullsized":"2023-06-09T20:19:53.730535+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'119","last_scrub_stamp":"2023-06-09T20:19:53.730310+0000","last_deep_scrub":"42'119","last_deep_scrub_stamp":"2023-06-09T20:19:53.730310+0000","last_clean_scrub_stamp":"2023-06-09T20:19:53.730310+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T03:55:27.079189+0000","scrub_duration":2.9825590719999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":328,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:51.920437+0000","last_change":"2023-06-09T20:19:51.920610+0000","last_active":"2023-06-09T20:19:51.920437+0000","last_peered":"2023-06-09T20:19:51.920437+0000","last_clean":"2023-06-09T20:19:51.920437+0000","last_became_active":"2023-06-09T11:12:03.192077+0000","last_became_peered":"2023-06-09T11:12:03.192077+0000","last_unstale":"2023-06-09T20:19:51.920437+0000","last_undegraded":"2023-06-09T20:19:51.920437+0000","last_fullsized":"2023-06-09T20:19:51.920437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:51.920145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:51.920145+0000","last_clean_scrub_stamp":"2023-06-09T20:19:51.920145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T02:55:58.190442+0000","scrub_duration":2.2365675120000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":334,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:20:06.946796+0000","last_change":"2023-06-09T20:20:06.946891+0000","last_active":"2023-06-09T20:20:06.946796+0000","last_peered":"2023-06-09T20:20:06.946796+0000","last_clean":"2023-06-09T20:20:06.946796+0000","last_became_active":"2023-06-09T11:12:03.197814+0000","last_became_peered":"2023-06-09T11:12:03.197814+0000","last_unstale":"2023-06-09T20:20:06.946796+0000","last_undegraded":"2023-06-09T20:20:06.946796+0000","last_fullsized":"2023-06-09T20:20:06.946796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:20:06.946510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:20:06.946510+0000","last_clean_scrub_stamp":"2023-06-09T20:20:06.946510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T02:54:36.438374+0000","scrub_duration":2.2369335829999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":324,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:42.464456+0000","last_change":"2023-06-09T20:19:42.464572+0000","last_active":"2023-06-09T20:19:42.464456+0000","last_peered":"2023-06-09T20:19:42.464456+0000","last_clean":"2023-06-09T20:19:42.464456+0000","last_became_active":"2023-06-09T11:12:03.353573+0000","last_became_peered":"2023-06-09T11:12:03.353573+0000","last_unstale":"2023-06-09T20:19:42.464456+0000","last_undegraded":"2023-06-09T20:19:42.464456+0000","last_fullsized":"2023-06-09T20:19:42.464456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:42.464231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:42.464231+0000","last_clean_scrub_stamp":"2023-06-09T20:19:42.464231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T02:37:38.619136+0000","scrub_duration":2.2381781950000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":329,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:54.985914+0000","last_change":"2023-06-09T20:19:54.985914+0000","last_active":"2023-06-09T20:19:54.985914+0000","last_peered":"2023-06-09T20:19:54.985914+0000","last_clean":"2023-06-09T20:19:54.985914+0000","last_became_active":"2023-06-09T11:12:03.197132+0000","last_became_peered":"2023-06-09T11:12:03.197132+0000","last_unstale":"2023-06-09T20:19:54.985914+0000","last_undegraded":"2023-06-09T20:19:54.985914+0000","last_fullsized":"2023-06-09T20:19:54.985914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:54.985540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:54.985540+0000","last_clean_scrub_stamp":"2023-06-09T20:19:54.985540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T22:55:23.513562+0000","scrub_duration":2.284954844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":324,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:39.118863+0000","last_change":"2023-06-09T20:19:39.118863+0000","last_active":"2023-06-09T20:19:39.118863+0000","last_peered":"2023-06-09T20:19:39.118863+0000","last_clean":"2023-06-09T20:19:39.118863+0000","last_became_active":"2023-06-09T11:12:03.351628+0000","last_became_peered":"2023-06-09T11:12:03.351628+0000","last_unstale":"2023-06-09T20:19:39.118863+0000","last_undegraded":"2023-06-09T20:19:39.118863+0000","last_fullsized":"2023-06-09T20:19:39.118863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:39.118312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:39.118312+0000","last_clean_scrub_stamp":"2023-06-09T20:19:39.118312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T03:48:46.725428+0000","scrub_duration":2.3058696960000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":323,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:57.053017+0000","last_change":"2023-06-09T20:19:57.053132+0000","last_active":"2023-06-09T20:19:57.053017+0000","last_peered":"2023-06-09T20:19:57.053017+0000","last_clean":"2023-06-09T20:19:57.053017+0000","last_became_active":"2023-06-09T11:12:03.352131+0000","last_became_peered":"2023-06-09T11:12:03.352131+0000","last_unstale":"2023-06-09T20:19:57.053017+0000","last_undegraded":"2023-06-09T20:19:57.053017+0000","last_fullsized":"2023-06-09T20:19:57.053017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:57.052731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:57.052731+0000","last_clean_scrub_stamp":"2023-06-09T20:19:57.052731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T23:39:49.044300+0000","scrub_duration":2.2962486719999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":316,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:19:42.338555+0000","last_change":"2023-06-09T20:19:42.338730+0000","last_active":"2023-06-09T20:19:42.338555+0000","last_peered":"2023-06-09T20:19:42.338555+0000","last_clean":"2023-06-09T20:19:42.338555+0000","last_became_active":"2023-06-09T11:12:03.198337+0000","last_became_peered":"2023-06-09T11:12:03.198337+0000","last_unstale":"2023-06-09T20:19:42.338555+0000","last_undegraded":"2023-06-09T20:19:42.338555+0000","last_fullsized":"2023-06-09T20:19:42.338555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:19:42.338236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:19:42.338236+0000","last_clean_scrub_stamp":"2023-06-09T20:19:42.338236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T21:02:16.804104+0000","scrub_duration":2.5441879919999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":312,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-09T20:20:00.786227+0000","last_change":"2023-06-09T20:20:00.786417+0000","last_active":"2023-06-09T20:20:00.786227+0000","last_peered":"2023-06-09T20:20:00.786227+0000","last_clean":"2023-06-09T20:20:00.786227+0000","last_became_active":"2023-06-09T11:12:03.197993+0000","last_became_peered":"2023-06-09T11:12:03.197993+0000","last_unstale":"2023-06-09T20:20:00.786227+0000","last_undegraded":"2023-06-09T20:20:00.786227+0000","last_fullsized":"2023-06-09T20:20:00.786227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T20:20:00.785879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T20:20:00.785879+0000","last_clean_scrub_stamp":"2023-06-09T20:20:00.785879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T04:25:21.288734+0000","scrub_duration":2.8702039900000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834581414,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":762604,"kb_used_data":1060,"kb_used_omap":15347,"kb_used_meta":746188,"kb_avail":93609236,"statfs":{"total":96636764160,"available":95855857664,"internally_reserved":0,"allocated":1085440,"data_stored":797245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15715521,"internal_metadata":764097343},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":3.2189999999999999,"5min":1.238,"15min":0.94999999999999996},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":37.523000000000003,"5min":37.523000000000003,"15min":37.523000000000003},"last":0.79700000000000004},{"interface":"front","average":{"1min":2.8650000000000002,"5min":1.1379999999999999,"15min":0.91900000000000004},"min":{"1min":0.41199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":31.436,"5min":31.436,"15min":31.436},"last":1.1240000000000001}]},{"osd":1,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":2.0369999999999999,"15min":1.2729999999999999},"min":{"1min":0.58299999999999996,"5min":0.371,"15min":0.33500000000000002},"max":{"1min":1.9199999999999999,"5min":106.97,"15min":106.97},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.125,"5min":2.0219999999999998,"15min":1.2889999999999999},"min":{"1min":0.65100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.9339999999999999,"5min":107.06100000000001,"15min":107.06100000000001},"last":1.343}]},{"osd":2,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.86899999999999999,"15min":0.91700000000000004},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.38700000000000001},"max":{"1min":1.0369999999999999,"5min":4.0949999999999998,"15min":11.923},"last":1.395},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.876,"15min":0.91500000000000004},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.972,"5min":3.4470000000000001,"15min":6.5880000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96199999999999997,"15min":1.1439999999999999},"min":{"1min":0.53100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.982,"5min":4.1459999999999999,"15min":59.793999999999997},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.105,"5min":0.95099999999999996,"15min":1.175},"min":{"1min":0.50700000000000001,"5min":0.45700000000000002,"15min":0.45200000000000001},"max":{"1min":3.02,"5min":3.484,"15min":60.773000000000003},"last":1.095}]},{"osd":4,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.556,"15min":1.165},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.9390000000000001,"5min":54.104999999999997,"15min":54.104999999999997},"last":1.2470000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.655,"15min":1.2050000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.39500000000000002},"max":{"1min":3.3420000000000001,"5min":53.810000000000002,"15min":53.810000000000002},"last":1.52}]},{"osd":5,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":2.601,"15min":1.5720000000000001},"min":{"1min":0.54600000000000004,"5min":0.47399999999999998,"15min":0.42399999999999999},"max":{"1min":12.439,"5min":131.97200000000001,"15min":131.97200000000001},"last":1.179},{"interface":"front","average":{"1min":1.8759999999999999,"5min":2.7269999999999999,"15min":1.728},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.434},"max":{"1min":15.169,"5min":134.97499999999999,"15min":134.97499999999999},"last":1.659}]},{"osd":6,"last update":"Fri Jun 9 20:19:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.0669999999999999,"15min":1.294},"min":{"1min":0.58999999999999997,"5min":0.55700000000000005,"15min":0.499},"max":{"1min":6.274,"5min":6.274,"15min":61.345999999999997},"last":1.766},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.163,"15min":1.3100000000000001},"min":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":6.2279999999999998,"5min":6.2279999999999998,"15min":60.165999999999997},"last":1.73}]}]},{"osd":6,"up_from":13,"seq":55834581411,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1165672,"kb_used_data":480,"kb_used_omap":10585,"kb_used_meta":1154598,"kb_avail":93206168,"statfs":{"total":96636764160,"available":95443116032,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10840012,"internal_metadata":1182308404},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.7390000000000001,"5min":3.1760000000000002,"15min":7.4050000000000002},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.89000000000000001},"min":{"1min":0.42099999999999999,"5min":0.35099999999999998,"15min":0.32000000000000001},"max":{"1min":2.278,"5min":26.532,"15min":26.532},"last":1.4279999999999999}]},{"osd":1,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.778,"5min":1.036,"15min":0.93999999999999995},"min":{"1min":0.495,"5min":0.375,"15min":0.375},"max":{"1min":17.495000000000001,"5min":17.495000000000001,"15min":17.495000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":2.0379999999999998,"5min":1.1279999999999999,"15min":0.95899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.33700000000000002},"max":{"1min":23.216000000000001,"5min":23.216000000000001,"15min":23.216000000000001},"last":1.2789999999999999}]},{"osd":2,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.92100000000000004,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":3.5110000000000001,"5min":7.5259999999999998,"15min":14.003},"last":1.492},{"interface":"front","average":{"1min":1.1819999999999999,"5min":0.88800000000000001,"15min":0.89000000000000001},"min":{"1min":0.51800000000000002,"5min":0.41799999999999998,"15min":0.40100000000000002},"max":{"1min":5.4429999999999996,"5min":5.4429999999999996,"15min":6.4199999999999999},"last":1.2130000000000001}]},{"osd":3,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3979999999999999,"15min":1.0840000000000001},"min":{"1min":0.54100000000000004,"5min":0.439,"15min":0.42199999999999999},"max":{"1min":9.4649999999999999,"5min":39.442999999999998,"15min":39.442999999999998},"last":1.393},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.119},"min":{"1min":0.628,"5min":0.441,"15min":0.441},"max":{"1min":1.615,"5min":39.011000000000003,"15min":39.011000000000003},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90600000000000003,"15min":1.526},"min":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.33000000000000002},"max":{"1min":2.0379999999999998,"5min":4.0659999999999998,"15min":162.25399999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.89000000000000001,"15min":1.5940000000000001},"min":{"1min":0.53700000000000003,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":2.867,"5min":3.294,"15min":162.19900000000001},"last":1.236}]},{"osd":5,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4690000000000001,"15min":1.5840000000000001},"min":{"1min":0.48299999999999998,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":9.4670000000000005,"5min":47.223999999999997,"15min":126.22},"last":1.296},{"interface":"front","average":{"1min":1.8680000000000001,"5min":1.9950000000000001,"15min":1.786},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38800000000000001},"max":{"1min":19.411000000000001,"5min":47.131,"15min":133.33000000000001},"last":1.077}]},{"osd":7,"last update":"Fri Jun 9 20:19:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.98299999999999998,"15min":1.7509999999999999},"min":{"1min":0.66600000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.5710000000000002,"5min":3.907,"15min":96.753},"last":1.341},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.0089999999999999,"15min":1.758},"min":{"1min":0.499,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.8320000000000001,"5min":3.4670000000000001,"15min":101.806},"last":1.5269999999999999}]}]},{"osd":5,"up_from":13,"seq":55834581408,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072936,"kb_used_data":480,"kb_used_omap":31576,"kb_used_meta":1040871,"kb_avail":93298904,"statfs":{"total":96636764160,"available":95538077696,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32334646,"internal_metadata":1065852106},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.79800000000000004,"15min":1.7250000000000001},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.31},"max":{"1min":1.498,"5min":8.2210000000000001,"15min":150.52699999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.95099999999999996,"15min":1.821},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.33000000000000002},"max":{"1min":1.5349999999999999,"5min":4.1779999999999999,"15min":151.72900000000001},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Jun 9 20:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.6040000000000001,"15min":1.079},"min":{"1min":0.51000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.5459999999999998,"5min":53.021999999999998,"15min":53.021999999999998},"last":1.163},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.833,"15min":1.1930000000000001},"min":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.376},"max":{"1min":2.5640000000000001,"5min":53.197000000000003,"15min":53.197000000000003},"last":1.206}]},{"osd":2,"last update":"Fri Jun 9 20:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.91800000000000004,"15min":1.2230000000000001},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.38500000000000001},"max":{"1min":2.1880000000000002,"5min":8.173,"15min":97.159999999999997},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.159,"5min":0.79500000000000004,"15min":1.204},"min":{"1min":0.54900000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":97.531000000000006},"last":1.2629999999999999}]},{"osd":3,"last update":"Fri Jun 9 20:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.1679999999999999,"15min":1.004},"min":{"1min":0.52100000000000002,"5min":0.45200000000000001,"15min":0.41499999999999998},"max":{"1min":2.9750000000000001,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.387,"5min":1.0649999999999999,"15min":0.999},"min":{"1min":0.54700000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3,"5min":8.2889999999999997,"15min":8.2889999999999997},"last":1.5149999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0740000000000001,"15min":1.486},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.36399999999999999},"max":{"1min":1.694,"5min":8.2569999999999997,"15min":136.20500000000001},"last":1.397},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.96599999999999997,"15min":1.456},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.36599999999999999},"max":{"1min":1.71,"5min":5.8079999999999998,"15min":135.35400000000001},"last":1.0389999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.2729999999999999,"15min":1.0820000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.41899999999999998},"max":{"1min":2.0449999999999999,"5min":20.053999999999998,"15min":20.053999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.073,"5min":0.93200000000000005,"15min":1.04},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.39800000000000002},"max":{"1min":1.821,"5min":3.9049999999999998,"15min":6.0339999999999998},"last":1.554}]},{"osd":7,"last update":"Fri Jun 9 20:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.105,"15min":1.085},"min":{"1min":0.497,"5min":0.497,"15min":0.44400000000000001},"max":{"1min":1.9339999999999999,"5min":4.2229999999999999,"15min":6.0720000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.198,"5min":1.1339999999999999,"15min":1.123},"min":{"1min":0.58999999999999997,"5min":0.45000000000000001,"15min":0.40899999999999997},"max":{"1min":1.825,"5min":11.916,"15min":11.916},"last":1.633}]}]},{"osd":4,"up_from":13,"seq":55834581411,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":810536,"kb_used_data":480,"kb_used_omap":33020,"kb_used_meta":777027,"kb_avail":93561304,"statfs":{"total":96636764160,"available":95806775296,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33813444,"internal_metadata":795675708},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.79800000000000004,"15min":0.747},"min":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.29499999999999998},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.2930000000000001,"5min":1.044,"15min":0.91500000000000004},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.37},"max":{"1min":15.125,"5min":15.125,"15min":15.125},"last":1.266}]},{"osd":1,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.1100000000000001,"15min":1.4159999999999999},"min":{"1min":0.53500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.8689999999999998,"5min":10.677,"15min":121.21599999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1000000000000001,"15min":1.3280000000000001},"min":{"1min":0.50600000000000001,"5min":0.45700000000000002,"15min":0.35199999999999998},"max":{"1min":6.8869999999999996,"5min":10.699,"15min":121.19799999999999},"last":0.94399999999999995}]},{"osd":2,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":4.7320000000000002,"5min":2.1669999999999998,"15min":1.669},"min":{"1min":0.49399999999999999,"5min":0.41499999999999998,"15min":0.40300000000000002},"max":{"1min":63.813000000000002,"5min":63.813000000000002,"15min":120.88800000000001},"last":1.022},{"interface":"front","average":{"1min":4.4960000000000004,"5min":1.984,"15min":1.716},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.40300000000000002},"max":{"1min":63.460000000000001,"5min":63.460000000000001,"15min":122.483},"last":1.4079999999999999}]},{"osd":3,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.014,"15min":1.3169999999999999},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.42699999999999999},"max":{"1min":10.083,"5min":10.083,"15min":119.94199999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.167,"15min":1.4139999999999999},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.45200000000000001},"max":{"1min":9.9770000000000003,"5min":9.9770000000000003,"15min":129.40199999999999},"last":1.1930000000000001}]},{"osd":5,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7509999999999999,"5min":1.1439999999999999,"15min":1.367},"min":{"1min":0.53500000000000003,"5min":0.39600000000000002,"15min":0.39000000000000001},"max":{"1min":13.957000000000001,"5min":13.957000000000001,"15min":105.523},"last":1.46},{"interface":"front","average":{"1min":1.54,"5min":1.1259999999999999,"15min":1.387},"min":{"1min":0.46500000000000002,"5min":0.44,"15min":0.40699999999999997},"max":{"1min":14.122999999999999,"5min":14.122999999999999,"15min":104.76300000000001},"last":1.147}]},{"osd":6,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.1020000000000001,"15min":0.99199999999999999},"min":{"1min":0.53000000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.1890000000000001,"5min":9.0280000000000005,"15min":9.0280000000000005},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.1060000000000001,"15min":1.0860000000000001},"min":{"1min":0.64000000000000001,"5min":0.499,"15min":0.48499999999999999},"max":{"1min":2.5230000000000001,"5min":8.2249999999999996,"15min":8.2249999999999996},"last":1.5189999999999999}]},{"osd":7,"last update":"Fri Jun 9 20:19:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":2.9860000000000002,"15min":1.6699999999999999},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.432},"max":{"1min":3.794,"5min":196.364,"15min":196.364},"last":1.22},{"interface":"front","average":{"1min":1.181,"5min":3.0579999999999998,"15min":1.681},"min":{"1min":0.62,"5min":0.47599999999999998,"15min":0.44400000000000001},"max":{"1min":4.0469999999999997,"5min":192.33199999999999,"15min":192.33199999999999},"last":1.109}]}]},{"osd":3,"up_from":13,"seq":55834581402,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":793384,"kb_used_data":480,"kb_used_omap":17824,"kb_used_meta":775071,"kb_avail":93578456,"statfs":{"total":96636764160,"available":95824338944,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18251807,"internal_metadata":793673697},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.28499999999999998,"5min":0.27400000000000002,"15min":0.251},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.74099999999999999,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.29899999999999999,"15min":0.28100000000000003},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":0.92900000000000005,"15min":0.83999999999999997},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.27900000000000003},"max":{"1min":6.0659999999999998,"5min":8.25,"15min":8.25},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.91400000000000003,"15min":0.86599999999999999},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.32000000000000001},"max":{"1min":4.9930000000000003,"5min":8.2040000000000006,"15min":8.2040000000000006},"last":1.054}]},{"osd":2,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.8200000000000001,"15min":1.1659999999999999},"min":{"1min":0.44700000000000001,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":6.1029999999999998,"5min":84.156000000000006,"15min":84.156000000000006},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.859,"15min":1.173},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.34799999999999998},"max":{"1min":5.0270000000000001,"5min":90.442999999999998,"15min":90.442999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.0109999999999999,"15min":0.92700000000000005},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":1.175},{"interface":"front","average":{"1min":1.506,"5min":1.0449999999999999,"15min":0.98299999999999998},"min":{"1min":0.54600000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":10.448,"5min":10.448,"15min":10.448},"last":1.288}]},{"osd":5,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.92600000000000005,"15min":1.167},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.48799999999999999},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":55.159999999999997},"last":1.631},{"interface":"front","average":{"1min":1.6160000000000001,"5min":0.997,"15min":1.1679999999999999},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":13.651999999999999,"5min":13.651999999999999,"15min":54.234999999999999},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.107,"15min":1.075},"min":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.47099999999999997},"max":{"1min":5.8680000000000003,"5min":6.2869999999999999,"15min":6.2869999999999999},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.0049999999999999,"15min":1.0860000000000001},"min":{"1min":0.64500000000000002,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":6.3780000000000001,"5min":6.3780000000000001,"15min":12.545999999999999},"last":1.7350000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:19:25 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.0640000000000001,"15min":1.627},"min":{"1min":0.70399999999999996,"5min":0.56000000000000005,"15min":0.53500000000000003},"max":{"1min":6.2569999999999997,"5min":6.2569999999999997,"15min":187.14099999999999},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.0820000000000001,"15min":1.6419999999999999},"min":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":187.03},"last":1.681}]}]},{"osd":2,"up_from":13,"seq":55834581408,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340520,"kb_used_data":480,"kb_used_omap":11211,"kb_used_meta":328820,"kb_avail":94031320,"statfs":{"total":96636764160,"available":96288071680,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11481051,"internal_metadata":336711717},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:51 2023","interfaces":[{"interface":"back","average":{"1min":6.5030000000000001,"5min":1.895,"15min":1.1080000000000001},"min":{"1min":0.28100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":74.998999999999995,"5min":74.998999999999995,"15min":74.998999999999995},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.204,"5min":0.77100000000000002,"15min":0.71199999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Jun 9 20:19:51 2023","interfaces":[{"interface":"back","average":{"1min":1.859,"5min":1.113,"15min":0.89400000000000002},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.27800000000000002},"max":{"1min":12.955,"5min":12.955,"15min":12.955},"last":1.016},{"interface":"front","average":{"1min":2.395,"5min":1.1870000000000001,"15min":0.998},"min":{"1min":0.40999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":15.765000000000001,"5min":15.765000000000001,"15min":15.765000000000001},"last":1.2310000000000001}]},{"osd":3,"last update":"Fri Jun 9 20:19:51 2023","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":1.226,"15min":1.032},"min":{"1min":0.42099999999999999,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":16.132000000000001,"5min":16.132000000000001,"15min":16.132000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.2010000000000001,"15min":1.0089999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34399999999999997},"max":{"1min":12.109999999999999,"5min":12.109999999999999,"15min":12.109999999999999},"last":1.349}]},{"osd":4,"last update":"Fri Jun 9 20:19:51 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.284,"15min":1.026},"min":{"1min":0.46999999999999997,"5min":0.46400000000000002,"15min":0.435},"max":{"1min":3.9399999999999999,"5min":30.73,"15min":30.73},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.466,"15min":1.1220000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.44800000000000001},"max":{"1min":4.5590000000000002,"5min":30.786000000000001,"15min":30.786000000000001},"last":1.204}]},{"osd":5,"last update":"Fri Jun 9 20:19:51 2023","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.2490000000000001,"15min":1.03},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.797000000000001,"5min":15.797000000000001,"15min":15.797000000000001},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.0620000000000001,"15min":1.0129999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":3.992,"5min":4.4669999999999996,"15min":7.3650000000000002},"last":1.4730000000000001}]},{"osd":6,"last update":"Fri Jun 9 20:19:51 2023","interfaces":[{"interface":"back","average":{"1min":3.0979999999999999,"5min":1.5620000000000001,"15min":1.8080000000000001},"min":{"1min":0.72599999999999998,"5min":0.497,"15min":0.44500000000000001},"max":{"1min":30.975999999999999,"5min":30.975999999999999,"15min":88.555999999999997},"last":1.3169999999999999},{"interface":"front","average":{"1min":3.5680000000000001,"5min":1.585,"15min":1.829},"min":{"1min":0.56599999999999995,"5min":0.51600000000000001,"15min":0.47299999999999998},"max":{"1min":29.460999999999999,"5min":29.460999999999999,"15min":88.912000000000006},"last":1.6830000000000001}]},{"osd":7,"last update":"Fri Jun 9 20:19:51 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":1.5489999999999999,"15min":1.1910000000000001},"min":{"1min":0.66500000000000004,"5min":0.57299999999999995,"15min":0.53200000000000003},"max":{"1min":29.219999999999999,"5min":29.219999999999999,"15min":29.219999999999999},"last":1.554},{"interface":"front","average":{"1min":3.3540000000000001,"5min":1.651,"15min":1.286},"min":{"1min":0.68899999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":29.265000000000001,"5min":29.265000000000001,"15min":29.265000000000001},"last":1.5369999999999999}]}]},{"osd":1,"up_from":13,"seq":55834581417,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1084200,"kb_used_data":480,"kb_used_omap":24790,"kb_used_meta":1058921,"kb_avail":93287640,"statfs":{"total":96636764160,"available":95526543360,"internally_reserved":0,"allocated":491520,"data_stored":206877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25385484,"internal_metadata":1084335604},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":0.99299999999999999,"15min":0.73799999999999999},"min":{"1min":0.33700000000000002,"5min":0.27400000000000002,"15min":0.245},"max":{"1min":18.120999999999999,"5min":18.120999999999999,"15min":18.120999999999999},"last":1.232},{"interface":"front","average":{"1min":2.427,"5min":1.0389999999999999,"15min":0.84799999999999998},"min":{"1min":0.45300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":18.346,"5min":18.346,"15min":18.346},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":0.81100000000000005,"15min":0.746},"min":{"1min":0.316,"5min":0.30499999999999999,"15min":0.29399999999999998},"max":{"1min":15.304,"5min":15.304,"15min":15.304},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":0.876,"15min":0.84999999999999998},"min":{"1min":0.40300000000000002,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":11.759,"5min":11.759,"15min":11.759},"last":1.403}]},{"osd":3,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":7.7720000000000002,"5min":2.1949999999999998,"15min":1.2669999999999999},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":114.809,"5min":114.809,"15min":114.809},"last":1.329},{"interface":"front","average":{"1min":8.234,"5min":2.2490000000000001,"15min":1.3029999999999999},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":119.399,"5min":119.399,"15min":119.399},"last":0.91500000000000004}]},{"osd":4,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":2.585,"5min":1.177,"15min":1.044},"min":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.435},"max":{"1min":23.172000000000001,"5min":23.172000000000001,"15min":23.172000000000001},"last":1.272},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.1120000000000001,"15min":1.0489999999999999},"min":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":11.667999999999999,"5min":11.667999999999999,"15min":11.667999999999999},"last":1.5209999999999999}]},{"osd":5,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.51700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.5300000000000002},"last":1.383},{"interface":"front","average":{"1min":1.369,"5min":1.032,"15min":1.0029999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":10.535,"5min":10.535,"15min":10.535},"last":1.423}]},{"osd":6,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4790000000000001,"5min":1.0960000000000001,"15min":1.0629999999999999},"min":{"1min":0.66000000000000003,"5min":0.54500000000000004,"15min":0.50700000000000001},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.5720000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.0329999999999999,"15min":1.0580000000000001},"min":{"1min":0.56200000000000006,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":10.582000000000001,"5min":10.582000000000001,"15min":10.582000000000001},"last":1.361}]},{"osd":7,"last update":"Fri Jun 9 20:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.083,"15min":1.2},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":3.6070000000000002,"5min":6.0599999999999996,"15min":41.878999999999998},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.71,"5min":1.125,"15min":1.268},"min":{"1min":0.69199999999999995,"5min":0.55600000000000005,"15min":0.54500000000000004},"max":{"1min":5.5099999999999998,"5min":5.5099999999999998,"15min":41.908000000000001},"last":1.2989999999999999}]}]},{"osd":0,"up_from":13,"seq":55834581408,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1106856,"kb_used_data":1056,"kb_used_omap":20344,"kb_used_meta":1085447,"kb_avail":93264984,"statfs":{"total":96636764160,"available":95503343616,"internally_reserved":0,"allocated":1081344,"data_stored":796226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20832578,"internal_metadata":1111498430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":1.538,"15min":0.98299999999999998},"min":{"1min":0.35399999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":1.1990000000000001,"5min":65.247,"15min":65.247},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.5880000000000001,"15min":1.004},"min":{"1min":0.41799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.8200000000000001,"5min":63.713999999999999,"15min":63.713999999999999},"last":1.248}]},{"osd":2,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.103,"15min":0.90500000000000003},"min":{"1min":0.47799999999999998,"5min":0.312,"15min":0.31},"max":{"1min":3.9940000000000002,"5min":17.765999999999998,"15min":17.765999999999998},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.2070000000000001,"15min":0.876},"min":{"1min":0.39600000000000002,"5min":0.35299999999999998,"15min":0.32100000000000001},"max":{"1min":3.7490000000000001,"5min":32.375,"15min":32.375},"last":1.0369999999999999}]},{"osd":3,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.296,"15min":0.995},"min":{"1min":0.38900000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":2.012,"5min":35.847999999999999,"15min":35.847999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.075,"5min":1.341,"15min":1.0169999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.38400000000000001},"max":{"1min":1.5189999999999999,"5min":35.762,"15min":35.762},"last":1.1910000000000001}]},{"osd":4,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":0.94999999999999996,"15min":1.478},"min":{"1min":0.46400000000000002,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":1.7150000000000001,"5min":2.8559999999999999,"15min":174.31299999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.133,"5min":0.98299999999999998,"15min":1.54},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.1280000000000001,"5min":4.0750000000000002,"15min":174.25299999999999},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.4870000000000001,"15min":1.133},"min":{"1min":0.68400000000000005,"5min":0.432,"15min":0.432},"max":{"1min":3.9049999999999998,"5min":40.771000000000001,"15min":40.771000000000001},"last":1.222},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.4319999999999999,"15min":1.121},"min":{"1min":0.52900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.839,"5min":40.357999999999997,"15min":40.357999999999997},"last":1.5049999999999999}]},{"osd":6,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":3.8639999999999999,"5min":1.6439999999999999,"15min":1.2230000000000001},"min":{"1min":0.69699999999999995,"5min":0.5,"15min":0.46999999999999997},"max":{"1min":46.582999999999998,"5min":46.582999999999998,"15min":46.582999999999998},"last":1.179},{"interface":"front","average":{"1min":4.1319999999999997,"5min":1.8,"15min":1.2709999999999999},"min":{"1min":0.65100000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":46.625999999999998,"5min":46.625999999999998,"15min":46.625999999999998},"last":1.466}]},{"osd":7,"last update":"Fri Jun 9 20:20:04 2023","interfaces":[{"interface":"back","average":{"1min":3.919,"5min":1.7150000000000001,"15min":1.8360000000000001},"min":{"1min":0.73299999999999998,"5min":0.501,"15min":0.501},"max":{"1min":46.415999999999997,"5min":46.415999999999997,"15min":174.10499999999999},"last":1.6100000000000001},{"interface":"front","average":{"1min":3.9860000000000002,"5min":1.6899999999999999,"15min":1.873},"min":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.49099999999999999},"max":{"1min":46.384,"5min":46.384,"15min":174.35900000000001},"last":1.5449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T20:20:11.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-06-09T20:20:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.245+0000 7ff165a6d700 1 Processor -- start 2023-06-09T20:20:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.245+0000 7ff165a6d700 1 -- start start 2023-06-09T20:20:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff165a6d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff16015c560 0x7ff1600b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff165a6d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff16015c930 0x7ff16015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff165a6d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16006b6e0 con 0x7ff1601600b0 2023-06-09T20:20:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff165a6d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600b29e0 con 0x7ff16015c560 2023-06-09T20:20:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff165a6d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16006adb0 con 0x7ff16015c930 2023-06-09T20:20:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff16015c560 0x7ff1600b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff16015c560 0x7ff1600b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33668/0 (socket says 172.21.15.78:33668) 2023-06-09T20:20:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 -- 172.21.15.78:0/2507086947 learned_addr learned my addr 172.21.15.78:0/2507086947 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:20:11.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff15ffff700 1 --2- 172.21.15.78:0/2507086947 >> v2:172.21.15.187:3300/0 conn(0x7ff16015c930 0x7ff16015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 -- 172.21.15.78:0/2507086947 >> v2:172.21.15.187:3300/0 conn(0x7ff16015c930 msgr2=0x7ff16015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:20:11.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 --2- 172.21.15.78:0/2507086947 >> v2:172.21.15.187:3300/0 conn(0x7ff16015c930 0x7ff16015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 -- 172.21.15.78:0/2507086947 >> v1:172.21.15.187:6789/0 conn(0x7ff1601600b0 legacy=0x7ff1601604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 -- 172.21.15.78:0/2507086947 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16006b090 con 0x7ff16015c560 2023-06-09T20:20:11.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff164a6b700 1 --2- 172.21.15.78:0/2507086947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff16015c560 0x7ff1600b1a80 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7ff1600b1740 tx=0x7ff154009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e95e2ebea74ba05 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff15f7fe700 1 -- 172.21.15.78:0/2507086947 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154011830 con 0x7ff16015c560 2023-06-09T20:20:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff15f7fe700 1 -- 172.21.15.78:0/2507086947 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154011990 con 0x7ff16015c560 2023-06-09T20:20:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.249+0000 7ff15f7fe700 1 -- 172.21.15.78:0/2507086947 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154011d20 con 0x7ff16015c560 2023-06-09T20:20:11.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 -- 172.21.15.78:0/2507086947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff16015c560 msgr2=0x7ff1600b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 --2- 172.21.15.78:0/2507086947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff16015c560 0x7ff1600b1a80 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7ff1600b1740 tx=0x7ff154009bf0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 -- 172.21.15.78:0/2507086947 shutdown_connections 2023-06-09T20:20:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 --2- 172.21.15.78:0/2507086947 >> v2:172.21.15.187:3300/0 conn(0x7ff16015c930 0x7ff16015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 --2- 172.21.15.78:0/2507086947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff16015c560 0x7ff1600b1a80 unknown :-1 s=CLOSED pgs=3299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 -- 172.21.15.78:0/2507086947 >> 172.21.15.78:0/2507086947 conn(0x7ff1600b0780 msgr2=0x7ff1600b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:20:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 -- 172.21.15.78:0/2507086947 shutdown_connections 2023-06-09T20:20:11.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.253+0000 7ff165a6d700 1 -- 172.21.15.78:0/2507086947 wait complete. 2023-06-09T20:20:11.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 Processor -- start 2023-06-09T20:20:11.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 -- start start 2023-06-09T20:20:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff16015c560 0x7ff16014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16015c930 0x7ff16015e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1601600b0 0x7ff1600c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600cc2f0 con 0x7ff1601600b0 2023-06-09T20:20:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16014e8b0 con 0x7ff16015c560 2023-06-09T20:20:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff165a6d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16015f930 con 0x7ff16015c930 2023-06-09T20:20:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff16526c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1601600b0 0x7ff1600c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff16526c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1601600b0 0x7ff1600c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33682/0 (socket says 172.21.15.78:33682) 2023-06-09T20:20:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff16526c700 1 -- 172.21.15.78:0/197742940 learned_addr learned my addr 172.21.15.78:0/197742940 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:20:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff164a6b700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff16015c560 0x7ff16014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff15ffff700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16015c930 0x7ff16015e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff164a6b700 1 -- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16015c930 msgr2=0x7ff16015e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff164a6b700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16015c930 0x7ff16015e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff164a6b700 1 -- 172.21.15.78:0/197742940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1601600b0 msgr2=0x7ff1600c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff164a6b700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1601600b0 0x7ff1600c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff164a6b700 1 -- 172.21.15.78:0/197742940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154009570 con 0x7ff16015c560 2023-06-09T20:20:11.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.257+0000 7ff16526c700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1601600b0 0x7ff1600c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T20:20:11.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.261+0000 7ff164a6b700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff16015c560 0x7ff16014e370 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff154016000 tx=0x7ff154004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:11.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.261+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154004450 con 0x7ff16015c560 2023-06-09T20:20:11.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.261+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15401f070 con 0x7ff16015c560 2023-06-09T20:20:11.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.261+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154003900 con 0x7ff16015c560 2023-06-09T20:20:11.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.261+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16015d8c0 con 0x7ff16015c560 2023-06-09T20:20:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.261+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16006b370 con 0x7ff16015c560 2023-06-09T20:20:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.261+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16015d2f0 con 0x7ff16015c560 2023-06-09T20:20:11.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.265+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff154003a60 con 0x7ff16015c560 2023-06-09T20:20:11.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.265+0000 7ff15d7fa700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff1440662f0 0x7ff1440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.265+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff154021070 con 0x7ff16015c560 2023-06-09T20:20:11.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.265+0000 7ff15ffff700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff1440662f0 0x7ff1440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.265+0000 7ff15ffff700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff1440662f0 0x7ff1440687a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff1600cbd70 tx=0x7ff14c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:11.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.273+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff154052900 con 0x7ff16015c560 2023-06-09T20:20:11.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.445+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff1600cc430 con 0x7ff16015c560 2023-06-09T20:20:11.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff154010380 con 0x7ff16015c560 2023-06-09T20:20:11.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff15d7fa700 1 -- 172.21.15.78:0/197742940 <== mon.1 v2:172.21.15.187:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff1540150c0 con 0x7ff16015c560 2023-06-09T20:20:11.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff1440662f0 msgr2=0x7ff1440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff1440662f0 0x7ff1440687a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff1600cbd70 tx=0x7ff14c009240 comp rx=0 tx=0).stop 2023-06-09T20:20:11.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff16015c560 msgr2=0x7ff16014e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff16015c560 0x7ff16014e370 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff154016000 tx=0x7ff154004770 comp rx=0 tx=0).stop 2023-06-09T20:20:11.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 shutdown_connections 2023-06-09T20:20:11.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7ff1440662f0 0x7ff1440687a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1601600b0 0x7ff1600c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16015c930 0x7ff16015e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 --2- 172.21.15.78:0/197742940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff16015c560 0x7ff16014e370 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 >> 172.21.15.78:0/197742940 conn(0x7ff1600b0780 msgr2=0x7ff16015b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:20:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 shutdown_connections 2023-06-09T20:20:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.533+0000 7ff165a6d700 1 -- 172.21.15.78:0/197742940 wait complete. 2023-06-09T20:20:11.558 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T20:20:11.559 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T20:20:11.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.685+0000 7febda028700 1 Processor -- start 2023-06-09T20:20:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.685+0000 7febda028700 1 -- start start 2023-06-09T20:20:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7febd406fc80 0x7febd4070050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febd415c880 0x7febd406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40c87a0 con 0x7febd40c7cb0 2023-06-09T20:20:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd4070590 con 0x7febd415c880 2023-06-09T20:20:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd40c81e0 con 0x7febd406fc80 2023-06-09T20:20:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febd415c880 0x7febd406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7febd415c880 0x7febd406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33684/0 (socket says 172.21.15.78:33684) 2023-06-09T20:20:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 -- 172.21.15.78:0/3891951135 learned_addr learned my addr 172.21.15.78:0/3891951135 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:20:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 -- 172.21.15.78:0/3891951135 >> v2:172.21.15.187:3300/0 conn(0x7febd406fc80 msgr2=0x7febd4070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:20:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 --2- 172.21.15.78:0/3891951135 >> v2:172.21.15.187:3300/0 conn(0x7febd406fc80 0x7febd4070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 -- 172.21.15.78:0/3891951135 >> v1:172.21.15.187:6789/0 conn(0x7febd40c7cb0 legacy=0x7febd406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T20:20:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 -- 172.21.15.78:0/3891951135 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd40c84c0 con 0x7febd415c880 2023-06-09T20:20:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febd8825700 1 --2- 172.21.15.78:0/3891951135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd415c880 0x7febd406df50 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 crypto rx=0x7febc4009910 tx=0x7febc4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7692a6edd1d1ccab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febcbfff700 1 -- 172.21.15.78:0/3891951135 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4004230 con 0x7febd415c880 2023-06-09T20:20:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febcbfff700 1 -- 172.21.15.78:0/3891951135 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7febc4004390 con 0x7febd415c880 2023-06-09T20:20:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febcbfff700 1 -- 172.21.15.78:0/3891951135 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4009e60 con 0x7febd415c880 2023-06-09T20:20:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- 172.21.15.78:0/3891951135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd415c880 msgr2=0x7febd406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 --2- 172.21.15.78:0/3891951135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd415c880 0x7febd406df50 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 crypto rx=0x7febc4009910 tx=0x7febc4009c20 comp rx=0 tx=0).stop 2023-06-09T20:20:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- 172.21.15.78:0/3891951135 shutdown_connections 2023-06-09T20:20:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 --2- 172.21.15.78:0/3891951135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd415c880 0x7febd406df50 unknown :-1 s=CLOSED pgs=3300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 --2- 172.21.15.78:0/3891951135 >> v2:172.21.15.187:3300/0 conn(0x7febd406fc80 0x7febd4070050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- 172.21.15.78:0/3891951135 >> 172.21.15.78:0/3891951135 conn(0x7febd40cf870 msgr2=0x7febd40cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:20:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- 172.21.15.78:0/3891951135 shutdown_connections 2023-06-09T20:20:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.689+0000 7febda028700 1 -- 172.21.15.78:0/3891951135 wait complete. 2023-06-09T20:20:11.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 Processor -- start 2023-06-09T20:20:11.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 -- start start 2023-06-09T20:20:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd406fc80 0x7febd40b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd40c7cb0 0x7febd415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd415c880 0x7febd41f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40cecf0 con 0x7febd40c7cb0 2023-06-09T20:20:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd415ea20 con 0x7febd406fc80 2023-06-09T20:20:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd415dbd0 con 0x7febd415c880 2023-06-09T20:20:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd40c7cb0 0x7febd415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd40c7cb0 0x7febd415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33698/0 (socket says 172.21.15.78:33698) 2023-06-09T20:20:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 -- 172.21.15.78:0/513925276 learned_addr learned my addr 172.21.15.78:0/513925276 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-09T20:20:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd9026700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd406fc80 0x7febd40b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd9827700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd415c880 0x7febd41f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 -- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd415c880 msgr2=0x7febd41f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd415c880 0x7febd41f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 -- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd406fc80 msgr2=0x7febd40b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd406fc80 0x7febd40b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 -- 172.21.15.78:0/513925276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4009570 con 0x7febd40c7cb0 2023-06-09T20:20:11.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febd8825700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd40c7cb0 0x7febd415d690 secure :-1 s=READY pgs=3301 cs=0 l=1 rev1=1 crypto rx=0x7febc4009150 tx=0x7febc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:11.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febc9ffb700 1 -- 172.21.15.78:0/513925276 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400be10 con 0x7febd40c7cb0 2023-06-09T20:20:11.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febc9ffb700 1 -- 172.21.15.78:0/513925276 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7febc401f070 con 0x7febd40c7cb0 2023-06-09T20:20:11.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febc9ffb700 1 -- 172.21.15.78:0/513925276 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4003920 con 0x7febd40c7cb0 2023-06-09T20:20:11.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.693+0000 7febda028700 1 -- 172.21.15.78:0/513925276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd406a350 con 0x7febd40c7cb0 2023-06-09T20:20:11.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.697+0000 7febda028700 1 -- 172.21.15.78:0/513925276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd406a070 con 0x7febd40c7cb0 2023-06-09T20:20:11.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.697+0000 7febda028700 1 -- 172.21.15.78:0/513925276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd406e490 con 0x7febd40c7cb0 2023-06-09T20:20:11.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.697+0000 7febc9ffb700 1 -- 172.21.15.78:0/513925276 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febc4021030 con 0x7febd40c7cb0 2023-06-09T20:20:11.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.697+0000 7febc9ffb700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7febb80662f0 0x7febb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T20:20:11.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.697+0000 7febc9ffb700 1 -- 172.21.15.78:0/513925276 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7febc4085220 con 0x7febd40c7cb0 2023-06-09T20:20:11.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.697+0000 7febd9026700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7febb80662f0 0x7febb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T20:20:11.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.701+0000 7febd9026700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7febb80662f0 0x7febb80687a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7febd0009990 tx=0x7febd0009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T20:20:11.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.701+0000 7febc9ffb700 1 -- 172.21.15.78:0/513925276 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7febc4052890 con 0x7febd40c7cb0 2023-06-09T20:20:11.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.917+0000 7febda028700 1 -- 172.21.15.78:0/513925276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febd406e490 con 0x7febd40c7cb0 2023-06-09T20:20:11.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.917+0000 7febc9ffb700 1 -- 172.21.15.78:0/513925276 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3529 (secure 0 0 0) 0x7febc4055eb0 con 0x7febd40c7cb0 2023-06-09T20:20:11.926 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-09T20:20:11.926 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4856,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3399791462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3399791462},{"type":"v1","addr":"172.21.15.187:6837","nonce":3399791462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5100,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/658938311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":658938311},{"type":"v1","addr":"172.21.15.78:6834","nonce":658938311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5103,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/952789446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":952789446},{"type":"v1","addr":"172.21.15.78:6835","nonce":952789446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3804631826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3804631826},{"type":"v1","addr":"172.21.15.187:6835","nonce":3804631826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-06-09T20:20:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.921+0000 7febda028700 1 -- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7febb80662f0 msgr2=0x7febb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.921+0000 7febda028700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7febb80662f0 0x7febb80687a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7febd0009990 tx=0x7febd0009110 comp rx=0 tx=0).stop 2023-06-09T20:20:11.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.921+0000 7febda028700 1 -- 172.21.15.78:0/513925276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd40c7cb0 msgr2=0x7febd415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T20:20:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.921+0000 7febda028700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd40c7cb0 0x7febd415d690 secure :-1 s=READY pgs=3301 cs=0 l=1 rev1=1 crypto rx=0x7febc4009150 tx=0x7febc4004770 comp rx=0 tx=0).stop 2023-06-09T20:20:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 -- 172.21.15.78:0/513925276 shutdown_connections 2023-06-09T20:20:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:6832/3679615404,v1:172.21.15.187:6833/3679615404] conn(0x7febb80662f0 0x7febb80687a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd415c880 0x7febd41f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd40c7cb0 0x7febd415d690 unknown :-1 s=CLOSED pgs=3301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 --2- 172.21.15.78:0/513925276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd406fc80 0x7febd40b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T20:20:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 -- 172.21.15.78:0/513925276 >> 172.21.15.78:0/513925276 conn(0x7febd40cf870 msgr2=0x7febd40cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T20:20:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 -- 172.21.15.78:0/513925276 shutdown_connections 2023-06-09T20:20:11.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-09T20:20:11.925+0000 7febda028700 1 -- 172.21.15.78:0/513925276 wait complete. 2023-06-09T20:20:11.934 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2023-06-09T20:20:11.952 DEBUG:tasks.cephfs.filesystem:already dead... 2023-06-09T20:20:11.953 INFO:teuthology.misc:Shutting down mds daemons... 2023-06-09T20:20:11.953 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-09T20:20:11.954 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:15.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-06-09T20:20:16.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:20:16.524 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:20:18.056 INFO:tasks.ceph.mds.a:Stopped 2023-06-09T20:20:18.056 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-09T20:20:18.057 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:22.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-06-09T20:20:22.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-06-09T20:20:24.158 INFO:tasks.ceph.mds.c:Stopped 2023-06-09T20:20:24.159 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-09T20:20:24.159 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:28.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-06-09T20:20:28.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-06-09T20:20:30.261 INFO:tasks.ceph.mds.b:Stopped 2023-06-09T20:20:30.262 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-09T20:20:30.262 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:34.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-06-09T20:20:34.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-06-09T20:20:36.364 INFO:tasks.ceph.mds.d:Stopped 2023-06-09T20:20:36.364 INFO:teuthology.misc:Shutting down osd daemons... 2023-06-09T20:20:36.365 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-06-09T20:20:36.365 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:40.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-06-09T20:20:40.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-06-09T20:20:42.467 INFO:tasks.ceph.osd.0:Stopped 2023-06-09T20:20:42.467 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-06-09T20:20:42.468 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:46.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:20:46.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:20:47.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-06-09T20:20:47.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-06-09T20:20:48.569 INFO:tasks.ceph.osd.1:Stopped 2023-06-09T20:20:48.570 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-06-09T20:20:48.571 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:53.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-06-09T20:20:53.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-06-09T20:20:54.672 INFO:tasks.ceph.osd.2:Stopped 2023-06-09T20:20:54.674 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-06-09T20:20:54.674 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:20:58.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-06-09T20:20:58.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-06-09T20:21:00.775 INFO:tasks.ceph.osd.3:Stopped 2023-06-09T20:21:00.776 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-06-09T20:21:00.777 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:04.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-06-09T20:21:04.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-06-09T20:21:06.879 INFO:tasks.ceph.osd.4:Stopped 2023-06-09T20:21:06.879 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-06-09T20:21:06.880 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:10.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-06-09T20:21:10.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-06-09T20:21:12.982 INFO:tasks.ceph.osd.5:Stopped 2023-06-09T20:21:12.983 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-06-09T20:21:12.983 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:16.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-06-09T20:21:16.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-06-09T20:21:16.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:21:16.746 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:21:19.085 INFO:tasks.ceph.osd.6:Stopped 2023-06-09T20:21:19.085 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-06-09T20:21:19.086 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:21.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-06-09T20:21:21.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-06-09T20:21:25.188 INFO:tasks.ceph.osd.7:Stopped 2023-06-09T20:21:25.188 INFO:teuthology.misc:Shutting down mgr daemons... 2023-06-09T20:21:25.189 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-06-09T20:21:25.189 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:27.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-06-09T20:21:27.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-06-09T20:21:31.290 INFO:tasks.ceph.mgr.y:Stopped 2023-06-09T20:21:31.291 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-06-09T20:21:31.292 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:32.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-06-09T20:21:32.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-06-09T20:21:37.393 INFO:tasks.ceph.mgr.x:Stopped 2023-06-09T20:21:37.394 INFO:teuthology.misc:Shutting down mon daemons... 2023-06-09T20:21:37.394 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-06-09T20:21:37.395 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:37.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-06-09T20:21:42.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-06-09T20:21:43.496 INFO:tasks.ceph.mon.a:Stopped 2023-06-09T20:21:43.497 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-06-09T20:21:43.498 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:46.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:21:46.830 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:21:47.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-06-09T20:21:47.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-06-09T20:21:49.600 INFO:tasks.ceph.mon.b:Stopped 2023-06-09T20:21:49.601 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-06-09T20:21:49.601 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T20:21:52.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-06-09T20:21:52.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-06-09T20:21:55.702 INFO:tasks.ceph.mon.c:Stopped 2023-06-09T20:21:55.703 INFO:tasks.ceph:Checking cluster log for badness... 2023-06-09T20:21:55.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-06-09T20:21:55.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T20:21:55.824 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-06-09T20:21:56.408 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T20:21:56.408 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-06-09T20:21:57.084 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T20:21:57.085 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-06-09T20:21:57.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T20:21:57.785 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-06-09T20:21:57.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-06-09T20:21:58.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T20:21:58.468 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-06-09T20:21:59.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T20:21:59.222 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-06-09T20:21:59.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T20:21:59.848 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-06-09T20:22:00.400 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T20:22:00.401 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-06-09T20:22:01.004 INFO:tasks.ceph:Archiving mon data... 2023-06-09T20:22:01.006 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/data/mon.a.tgz 2023-06-09T20:22:01.006 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-06-09T20:22:01.025 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.oy4k6ZCl4E 2023-06-09T20:22:01.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oy4k6ZCl4E 2023-06-09T20:22:01.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.oy4k6ZCl4E 2023-06-09T20:22:01.513 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.oy4k6ZCl4E is 608KB 2023-06-09T20:22:01.593 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.oy4k6ZCl4E 2023-06-09T20:22:01.610 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/data/mon.b.tgz 2023-06-09T20:22:01.610 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-06-09T20:22:01.929 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.WBGu2qNPDv 2023-06-09T20:22:01.930 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WBGu2qNPDv 2023-06-09T20:22:02.102 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.WBGu2qNPDv 2023-06-09T20:22:02.243 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.WBGu2qNPDv is 612KB 2023-06-09T20:22:02.325 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.WBGu2qNPDv 2023-06-09T20:22:02.344 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/data/mon.c.tgz 2023-06-09T20:22:02.344 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-06-09T20:22:02.407 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.QCCBZCDpkn 2023-06-09T20:22:02.407 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QCCBZCDpkn 2023-06-09T20:22:02.603 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.QCCBZCDpkn 2023-06-09T20:22:02.694 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.QCCBZCDpkn is 612KB 2023-06-09T20:22:02.727 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.QCCBZCDpkn 2023-06-09T20:22:02.743 INFO:tasks.ceph:Cleaning ceph cluster... 2023-06-09T20:22:02.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-09T20:22:02.751 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-09T20:22:02.872 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-06-09T20:22:02.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-09T20:22:02.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-09T20:22:02.931 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-09T20:22:02.931 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-09T20:22:02.945 INFO:tasks.ceph:Archiving crash dumps... 2023-06-09T20:22:02.947 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/remote/smithi078/crash 2023-06-09T20:22:02.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-09T20:22:02.983 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/remote/smithi187/crash 2023-06-09T20:22:02.984 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-09T20:22:03.017 INFO:tasks.ceph:Shutting down logrotate 2023-06-09T20:22:03.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:22:03.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T20:22:03.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-09T20:22:03.184 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-09T20:22:03.232 INFO:tasks.ceph:Compressing logs... 2023-06-09T20:22:03.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-09T20:22:03.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-09T20:27:53.900 INFO:tasks.ceph:Archiving logs... 2023-06-09T20:27:53.901 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/remote/smithi078/log 2023-06-09T20:27:53.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-09T20:33:02.840 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/remote/smithi187/log 2023-06-09T20:33:02.846 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-09T20:43:32.439 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-06-09T20:43:32.495 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-06-09T20:43:32.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-09T20:43:32.503 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-09T20:43:32.608 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-06-09T20:43:32.617 INFO:teuthology.task.clock:Checking final clock skew... 2023-06-09T20:43:32.617 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T20:43:32.624 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T20:43:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T20:43:32.727 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-06-09T20:43:32.727 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 44.4.53.2 2 u 409 1024 377 0.185 -1.273 1.772 2023-06-09T20:43:32.728 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 248 1024 377 0.267 -0.406 2.083 2023-06-09T20:43:32.728 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 299 1024 377 0.236 -3.212 0.810 2023-06-09T20:43:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-06-09T20:43:32.741 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T20:43:32.741 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2023-06-09T20:43:32.741 INFO:teuthology.orchestra.run.smithi187.stdout:*hv01.front.sepi 44.4.53.2 2 u 29 1024 377 0.141 -1.355 0.421 2023-06-09T20:43:32.742 INFO:teuthology.orchestra.run.smithi187.stdout:+hv02.front.sepi 63.231.80.2 3 u 6 1024 377 0.152 0.647 0.408 2023-06-09T20:43:32.742 INFO:teuthology.orchestra.run.smithi187.stdout:+hv03.front.sepi 74.6.168.72 3 u 655 1024 377 0.141 -3.291 0.215 2023-06-09T20:43:32.742 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-06-09T20:43:32.743 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-09T20:43:32.752 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-09T20:43:32.753 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-09T20:43:32.761 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-09T20:43:32.770 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-09T20:43:32.778 INFO:teuthology.task.internal:Duration was 35052.652732 seconds 2023-06-09T20:43:32.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-09T20:43:32.787 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-09T20:43:32.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-09T20:43:32.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-09T20:43:33.085 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-09T20:43:33.085 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-06-09T20:43:33.086 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-09T20:43:33.163 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2023-06-09T20:43:33.163 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-09T20:43:33.210 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-09T20:43:33.210 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-09T20:43:33.217 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-09T20:43:33.348 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-09T20:43:33.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-09T20:43:33.355 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-09T20:43:34.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-09T20:43:34.127 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-09T20:43:34.127 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-09T20:43:34.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-09T20:43:34.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-09T20:43:34.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-09T20:43:34.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-09T20:43:34.259 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-06-09T20:43:34.284 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2023-06-09T20:43:34.343 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-09T20:43:34.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T20:43:34.364 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-09T20:43:34.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T20:43:34.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-09T20:43:34.412 INFO:teuthology.task.internal:Transferring archived files... 2023-06-09T20:43:34.414 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/remote/smithi078 2023-06-09T20:43:34.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-09T20:43:34.456 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879/remote/smithi187 2023-06-09T20:43:34.457 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-09T20:43:34.498 INFO:teuthology.task.internal:Removing archive directory... 2023-06-09T20:43:34.499 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-09T20:43:34.504 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-09T20:43:34.562 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-09T20:43:34.580 INFO:teuthology.task.internal:Not uploading archives. 2023-06-09T20:43:34.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-09T20:43:34.590 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-09T20:43:34.591 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-09T20:43:34.598 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-09T20:43:34.612 INFO:teuthology.orchestra.run.smithi078.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 9 20:43 /home/ubuntu/cephtest 2023-06-09T20:43:34.632 INFO:teuthology.orchestra.run.smithi187.stdout: 1048602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 9 20:43 /home/ubuntu/cephtest 2023-06-09T20:43:34.638 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-09T20:43:34.648 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-09T20:43:34.669 INFO:teuthology.nuke:Checking targets against current locks 2023-06-09T20:43:34.698 DEBUG:teuthology.nuke:shortname: smithi078 2023-06-09T20:43:34.699 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T20:43:34.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 10:19:56.358789', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-09T20:43:34.729 DEBUG:teuthology.nuke:shortname: smithi187 2023-06-09T20:43:34.729 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T20:43:34.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-09_10:19:22-fs-wip-rishabh-2023Jun9-1308-testing-default-smithi/7299879', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 10:19:56.356904', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-09T20:43:34.779 INFO:teuthology.orchestra.console:Power off smithi078 2023-06-09T20:43:34.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-09T20:43:34.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-09T20:43:34.831 INFO:teuthology.orchestra.console:Power off smithi187 2023-06-09T20:43:34.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-09T20:43:34.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-09T20:43:38.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-09T20:43:38.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-09T20:43:42.959 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-09T20:43:42.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-09T20:43:43.172 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-06-09T20:43:43.200 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-06-09T20:43:43.305 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 10b2f20a4f46c803bb730efc73498f97d45082e7 client.1-kernel-sha1: 10b2f20a4f46c803bb730efc73498f97d45082e7 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 35052.65273189545 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=dcf1a1530664423180f01bb686913676 status: fail success: false 2023-06-09T20:43:43.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-09T20:43:43.404 INFO:teuthology.run:FAIL